Dan Paulat
9416ff1546
Level 2 bucket name changed
...
The NEXRAD Level II archive data is moving to a new bucket: unidata-nexrad-level2 and SNS topic: arn:aws:sns:us-east-1:684042711724:NewNEXRADLevel2Archive. The old bucket and SNS topic are now deprecated and will no longer be available starting September 1, 2025.
2025-09-06 20:40:58 -05:00
Dan Paulat
f4226b487d
Initial moving of product listing to the background for level 3
2025-08-30 16:28:19 -05:00
Dan Paulat
bd27d0e562
Update most instances of current time to use a time offset
2025-08-22 23:42:08 -05:00
AdenKoperczak
969267b661
Added back logging as traces for level_2_chunks
2025-05-10 09:50:54 -04:00
AdenKoperczak
4906800a22
Resolve TODOs in level_2_chunks
2025-05-10 09:50:54 -04:00
AdenKoperczak
3d7da7d971
Disable logging for level 2 chunks
2025-05-10 09:50:54 -04:00
AdenKoperczak
2daf4d8ba4
Remove some unneded methods added in level_2_chunks
2025-05-10 09:50:53 -04:00
AdenKoperczak
759a9e4379
Parallelize the chunks loading and load from archive when possible
2025-05-10 09:50:53 -04:00
AdenKoperczak
e10ebdeb5e
switch level2 incoming elevation to optional
2025-05-10 09:50:53 -04:00
AdenKoperczak
309a5ed25e
Clean up some functions in chunks data provider
2025-05-10 09:50:52 -04:00
AdenKoperczak
1f0d2a7a66
Change the selection of the most recent level 2 scan to avoid certain
...
improper removal from causing issues.
2025-05-10 09:50:52 -04:00
AdenKoperczak
34eb3af698
Use static cast when getting elevations to convert from double to float
2025-05-10 09:50:52 -04:00
AdenKoperczak
0f95439b61
Initial clang format/tidy fixes for level_2_chunks
2025-05-10 09:50:52 -04:00
AdenKoperczak
0bda6296c0
Add indicator of what level is currently being updated with level 2 chunks.
2025-05-10 09:50:52 -04:00
AdenKoperczak
63585af26d
Get level2 chunks and archive working together, reduce logging of level2 chunks
2025-05-10 09:50:51 -04:00
AdenKoperczak
094d286b41
fully working merging of data from last and current scan
2025-05-10 09:50:51 -04:00
AdenKoperczak
8b7a3e9781
partiallaly complete merging of radar data
2025-05-10 09:50:51 -04:00
AdenKoperczak
ac6d6093ec
updated how the most recent scan was determined to ensure correctness
2025-05-10 09:50:51 -04:00
AdenKoperczak
add57ff26f
Minor updates to level2 chunks
2025-05-10 09:50:51 -04:00
AdenKoperczak
a754d66844
Setting up for merging last and current scan's, and having archive and chunks
2025-05-10 09:50:51 -04:00
AdenKoperczak
fc83a7a36f
working level2 chunks with auto rerendering
2025-05-10 09:50:51 -04:00
AdenKoperczak
7c99bbc185
Begin work on moving over to only storing last 2 scans in chunks
2025-05-10 09:50:51 -04:00
AdenKoperczak
ac12cce5f2
fix compilation errors with level_2_chunks for not gcc-13/clang-17
2025-05-10 09:50:50 -04:00
AdenKoperczak
7fef5789de
Temporarly use only the L2 Chunks data provider for L2 data
2025-05-10 09:50:50 -04:00
AdenKoperczak
9570dcf20e
Initial working level2 chunks data provider
2025-05-10 09:50:50 -04:00
AdenKoperczak
f0ef6b35dd
Slight rework to nexrad data provider interface
2025-05-10 09:50:46 -04:00
Dan Paulat
82ba51909e
Breaking circular header dependency
2025-05-04 23:10:21 -05:00
Dan Paulat
81f09e07f0
Archive warnings clang-tidy fixes
2025-05-04 23:10:21 -05:00
Dan Paulat
8cdd8526eb
Archive warning fixes for gcc
2025-05-04 23:10:21 -05:00
Dan Paulat
8dde98d2a9
Add debug log statements to archive warning loading
2025-05-04 23:10:21 -05:00
Dan Paulat
65e3a66750
Update IemApiProvider to use template functions
2025-05-04 23:10:21 -05:00
Dan Paulat
1a1c668d62
Finish windowed load. Not all polygon updates are shown on the map.
2025-05-04 23:10:21 -05:00
Dan Paulat
33e18765b7
Start of implementation to load a window of archive warning data, currently broken
2025-05-04 23:10:20 -05:00
Dan Paulat
e82fa93fb0
Use ranges instead of vectors for listing text products
2025-05-04 23:10:20 -05:00
Dan Paulat
7a8a0302e0
Provide interface to request multiple text product lists in parallel
2025-05-04 23:10:20 -05:00
Dan Paulat
b117d2088a
Add missing date includes to IEM API provider
2025-05-04 23:10:20 -05:00
Dan Paulat
33cfd4bc0e
Don't reload archive text products that have already been loaded
2025-05-04 23:10:20 -05:00
Dan Paulat
3f83c8e4a9
IEM API provider should use std::string instead of std::string_view for abseil compatibility
2025-05-04 23:10:20 -05:00
Dan Paulat
a6ba312f6b
Provide year/month hint to WMO header parser based on filename
2025-05-04 23:10:20 -05:00
Dan Paulat
46972e8769
Formatting iem_api_provider.cpp
2025-05-04 23:10:19 -05:00
Dan Paulat
c00016cb69
Warning file record should use filename, not URL
2025-05-04 23:10:19 -05:00
Dan Paulat
f9e79b3e40
Rename IEM warnings provider to IEM API provider
2025-05-04 23:10:19 -05:00
Dan Paulat
8da440ea1f
General linter cleanup
2025-05-04 23:10:19 -05:00
Dan Paulat
2720ad6a38
Add IEM load text product API functionality
2025-05-04 23:10:19 -05:00
Dan Paulat
59a8fdbf56
List NWS text products metadata
2025-05-04 23:10:19 -05:00
Dan Paulat
895e760fee
Create IemWarningsProvider class for archive warnings
2025-05-04 23:10:19 -05:00
Dan Paulat
d34cd68471
Warnings provider gcc fixes
2025-05-04 23:10:19 -05:00
Dan Paulat
a8da035566
Warnings provider clang-tidy fixes
2025-05-04 23:10:18 -05:00
Dan Paulat
87af6479d6
Rewrite warnings provider to use HEAD requests instead of directory listing to find recent warnings
2025-05-04 23:10:18 -05:00
Dan Paulat
f7949cc404
Avoid invalid iterator comparison after objects mutex is unlocked
2024-11-20 19:50:09 -06:00