The idea of this ticket is make my plans for DataFusion visible, largely for my own personal organizational needs, but also to:
- Try some different ways to communicate / coordinate in the community
- Help provide an interesting summary of what is happening in DataFusion this week
It would be great if anyone else who has plans like this for DataFusion could try to make them visible somehow as well
Plans for this week personally:
My plans for next week
Major projects I intend to help review and coordinate
Algorithm for (my) prioritizing PRs
Note there are many committers who can review and merge PRs as well, so this is not the priorities of the project as a whole, just the approximate algorithm I am using
Priority:
- Bug fixes (where something is just incorrect), especially regressions (where it used to work and now does not)
- Improvements directly related to stuff needed for InfluxDB (as I am employed by them)
- Documentation and test improvements (I view these as very strategically important)
- PRs that I think are strategically important
- Other new features / additions to functionality
The current strategically important projects in my head are:
Note that adding new array functionality (e.g. #6980 and its children) is very low on my priority list, not because I don't think they are valuable, but because I think they are less valuable than the other projects going on
Thus, if you are interested in contributing to DataFusion and are interested in a fast turn around time I would recommend looking into bug fixes / test improvements.
If you propose adding new functionality, the review cycle will be longer. You can make it a shorter cycle by looking at the comments on other recent PRs and following the same model (e.g. ensure there are tests in sqllogictest for example)
The idea of this ticket is make my plans for DataFusion visible, largely for my own personal organizational needs, but also to:
It would be great if anyone else who has plans like this for DataFusion could try to make them visible somehow as well
Plans for this week personally:
0.40.0datafusion-sqlparser-rs#1030BuiltInScalarFunction) #8045My plans for next week
JoinHashMapforHashJoin#8130, in support of memory explosion in HashJoin outputs:HashJoinStreammemory tracking insufficient #7848 with @korowaMajor projects I intend to help review and coordinate
BuiltInScalarFunction) #8045 with @2010YOUY01ARRAYfunction hardening: [Epic] General ticket for the concept of the practical implementation ofARRAY#6980 / https://github.com/apache/arrow-datafusion/issues/7988with @jayzhan211 @Veeupup @edmondop and @xudong963Algorithm for (my) prioritizing PRs
Note there are many committers who can review and merge PRs as well, so this is not the priorities of the project as a whole, just the approximate algorithm I am using
Priority:
The current strategically important projects in my head are:
BuiltInScalarFunction) #8045Note that adding new array functionality (e.g. #6980 and its children) is very low on my priority list, not because I don't think they are valuable, but because I think they are less valuable than the other projects going on
Thus, if you are interested in contributing to DataFusion and are interested in a fast turn around time I would recommend looking into bug fixes / test improvements.
If you propose adding new functionality, the review cycle will be longer. You can make it a shorter cycle by looking at the comments on other recent PRs and following the same model (e.g. ensure there are tests in sqllogictest for example)