Collect GTFS-RT data from a JSON feed at regular intervals

Usage

rt_collect_json(
  gtfs_rt_url,
  destination_file,
  header_key = "header",
  entity_key = "entity",
  fields_collect = c("id", "vehicle.trip.trip_id", "vehicle.position.latitude",
    "vehicle.position.longitude", "vehicle.position.speed", "vehicle.timestamp",
    "vehicle.current_status", "vehicle.current_stop_sequence", "vehicle.stop_id"),
  scrape_interval = 60,
  log_file = NA,
  headers = NULL
)

Arguments

gtfs_rt_url: String. URL of the GTFS-RT feed in JSON format.
destination_file: String. File to save the downloaded GTFS-RT data. Content is appended in each iteration.
header_key: String (Default "header"). Key in the JSON corresponding to the feed header. Set to NA if not present.
entity_key: String (Default "entity"). Key in the JSON corresponding to the feed entities. Set to NA if response is a flat list. Use "." for nested keys.
fields_collect: Character vector. Fields to extract from each entity in the feed. Use "." for nested keys.
scrape_interval: Integer (Default 60). Interval in seconds between each download. Negative to run only once.
log_file: String (Optional). Path to a log file to save download logs.
headers: Named list or character vector (Optional). Custom HTTP headers for credentials when accessing the GTFS-RT feed URL.

Value

String. The location of the file where data was collected.

Details

Downloads GTFS-RT data from the specified URL at regular intervals and saves them to the destination file.

This function will run indefinitely until manually stopped (CTRL + C).

Examples

# Create file
destination_file <- withr::local_tempfile(fileext = ".csv")

# Collect data
GTFShift::rt_collect_json(
  gtfs_rt_url = "https://go.tmlmobilidade.pt/hub/api/v1/realtime/vehicles/positions/gtfs",
  entity_key = "data.entity",
  destination_file = destination_file,
  scrape_interval = -1 # Negative to run only once
)
#> [2026-07-30 16:12:58] Starting GTFS-RT data collection from https://go.tmlmobilidade.pt/hub/api/v1/realtime/vehicles/positions/gtfs
#> [20260730_161258] Iteration 1 completed
#> [1] "/tmp/Rtmpmh4xWj/file1f281a0b285c.csv"

# Read data
collection <- read.csv(destination_file)

names(collection)
#> [1] "id"                            "vehicle.trip.trip_id"         
#> [3] "vehicle.position.latitude"     "vehicle.position.longitude"   
#> [5] "vehicle.position.speed"        "vehicle.timestamp"            
#> [7] "vehicle.current_status"        "vehicle.current_stop_sequence"
#> [9] "vehicle.stop_id"              

head(
  collection |>
    dplyr::select("vehicle.trip.trip_id", "vehicle.position.latitude", "vehicle.position.longitude")
)
#>                   vehicle.trip.trip_id vehicle.position.latitude
#> 1     [8TCHD][A2L1N]4501_1_2|3000|1705                  38.71937
#> 2 [07MSC][LA77N]1710_3_1_1700_1729_0_7                  38.79796
#> 3 [07MSC][LA77N]1523_0_2_1630_1659_1_7                  38.71394
#> 4     [8TCHD][A2L1N]4401_0_1|3000|1700                  38.53009
#> 5 [07MSC][LA77N]1716_0_1_1630_1659_0_7                  38.73207
#> 6 [07MSC][LA77N]1108_0_1_1700_1729_0_7                  38.70150
#>   vehicle.position.longitude
#> 1                  -8.998730
#> 2                  -9.229838
#> 3                  -9.304010
#> 4                  -8.879375
#> 5                  -9.222693
#> 6                  -9.227297