Vote #75148: Optimizing CSV export - redmineorg-copy202205 - Redmine

編集操作

リンクをコピー

Vote #75148

未完了

Optimizing CSV export

Admin Redmine さんが約4年前に追加. 約4年前に更新.

ステータス:

New

優先度:

通常

担当者:

カテゴリ:

Performance_53

対象バージョン:

開始日:

2022/05/09

期日:

進捗率:

予定工数:

Redmineorg_URL:

https://www.redmine.org/issues/16638

category_id:

version_id:

issue_org_id:

16638

author_id:

32550

assigned_to_id:

comments:

status_id:

tracker_id:

plus1:

affected_version:

closed_on:

affected_version_id:

ステータス-->[New]

引用

説明

#16091 closed, i open this new request

When exporting CSV export thousands of issues with tens of custom field export CSV is very very long.

When looking for generated sql request we can see there are thousands similar requests

SELECT  `issues`.* FROM `issues`  WHERE `issues`.`id` =

=> there is one of this request for each issue exported

Why not do one grouped request Like as request for custom fields

=> SELECT  `issues`.* FROM `issues`  WHERE `issues`.`id` IN(  ,,)

?
thanks

journals

please give me feedback...

thanks
--------------------------------------------------------------------------------

--------------------------------------------------------------------------------
Same problem here, with Redmine 3.3.0-stable. It goes on and on for thousand of log lines:

<pre>
CACHE (0.0ms) SELECT `users`.* FROM `users` WHERE `users`.`type` IN ('User', 'AnonymousUser') AND `users`.`id` = 87 LIMIT 1 [["id", 87]]
(0.4ms) SELECT SUM(`time_entries`.`hours`) FROM `time_entries` WHERE `time_entries`.`issue_id` = 93903
IssueRelation Load (0.2ms) SELECT `issue_relations`.* FROM `issue_relations` WHERE `issue_relations`.`issue_from_id` = 93903
IssueRelation Load (0.2ms) SELECT `issue_relations`.* FROM `issue_relations` WHERE `issue_relations`.`issue_to_id` = 93903
(0.4ms) SELECT SUM(CAST(custom_values.value AS decimal(30,3))) FROM `issues` INNER JOIN `custom_values` ON `custom_values`.`customized_id` = `issues`.`id` AND `custom_values`.`customized_type` = 'Issue' WHERE `issues`.`root_id` = 93903 AND (issues.lft >= 1 AND issues.rgt <= 2) AND `custom_values`.`custom_field_id` = 410 AND (`custom_values`.`value` != '')
Issue Load (0.2ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `users`.* FROM `users` WHERE `users`.`type` IN ('User', 'AnonymousUser') AND `users`.`id` = 0 LIMIT 1 [["id", 0]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93903 LIMIT 1 [["id", 93903]]
CACHE (0.0ms) SELECT `users`.* FROM `users` WHERE `users`.`type` IN ('User', 'AnonymousUser') AND `users`.`id` = 604 LIMIT 1 [["id", 604]]
CACHE (0.0ms) SELECT `users`.* FROM `users` WHERE `users`.`type` IN ('User', 'AnonymousUser') AND `users`.`id` = 87 LIMIT 1 [["id", 87]]
(0.4ms) SELECT SUM(`time_entries`.`hours`) FROM `time_entries` WHERE `time_entries`.`issue_id` = 93902
IssueRelation Load (0.2ms) SELECT `issue_relations`.* FROM `issue_relations` WHERE `issue_relations`.`issue_from_id` = 93902
IssueRelation Load (0.2ms) SELECT `issue_relations`.* FROM `issue_relations` WHERE `issue_relations`.`issue_to_id` = 93902
(0.5ms) SELECT SUM(CAST(custom_values.value AS decimal(30,3))) FROM `issues` INNER JOIN `custom_values` ON `custom_values`.`customized_id` = `issues`.`id` AND `custom_values`.`customized_type` = 'Issue' WHERE `issues`.`root_id` = 93902 AND (issues.lft >= 1 AND issues.rgt <= 2) AND `custom_values`.`custom_field_id` = 410 AND (`custom_values`.`value` != '')
Issue Load (0.2ms) SELECT `issues`.* FROM `issues` WHERE `issues`.`id` = 93902 LIMIT 1
</pre>
--------------------------------------------------------------------------------

--------------------------------------------------------------------------------
Stephane Evr wrote:
> Same problem here, with Redmine 3.3.0-stable. It goes on and on for thousand of log lines:
>
> [...]

FTR: #24473.

--------------------------------------------------------------------------------

related_issues

relates,Closed,16091,Export CSV with many custom field runs many queries

操作

リンクをコピー

Admin Redmine さんが約4年前に更新

カテゴリ を Performance_53 にセット

編集操作

リンクをコピー

他の形式にエクスポート: Atom PDF

プロジェクト

全般

プロフィール

redmineorg-copy202205

カスタムクエリ

Vote #75148

Optimizing CSV export

Admin Redmine さんが約4年前に更新

編集

unofficial-redmine.org デモサイト¶

Redmine.org上のチケットplus1数を集計し、検索用に公開しています。( 2022/5 Redmine5.0 リリース記念版)¶