Skip to content

Commit

Permalink
fix: correct doc
Browse files Browse the repository at this point in the history
  • Loading branch information
hbruch committed Oct 25, 2023
1 parent 770da6e commit 279dfdd
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions pipeline/assets/sharing.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,8 +64,8 @@ def vehicles(context, lamassu: LamassuResource) -> pd.DataFrame:

'''
Default execution mode (which could be overriden for the whole code location)
is multiprocess, resulting in a new process startet for every new job execution.
That results in a large overhead for launching aa new process, initializing db connections etc.,
is multiprocess, resulting in a new process started for every new job execution.
That results in a large overhead for launching a new process, initializing db connections etc.,
so we want high frequency jobs to be execucted in process.
Note: this config has to be provided for job definitions and for RunRequests.
'''
Expand All @@ -85,8 +85,7 @@ def vehicles(context, lamassu: LamassuResource) -> pd.DataFrame:
@schedule(job=stations_and_vehicles_job, cron_schedule='* * * * *', default_status=DefaultScheduleStatus.RUNNING)
def update_stations_and_vehicles_minutely(context):
"""
For currently registered systems (which we treat as partition),
the stations_and_vehicles_job is run on the provided schedule (minutely).
Run stations_and_vehicles_job in process on the provided schedule (minutely).
"""
return [
RunRequest(run_config=in_process_job_config)
Expand Down

0 comments on commit 279dfdd

Please sign in to comment.