Uploaded image for project: 'Cost Management'
  1. Cost Management
  2. COST-5420

[GlitchTip] TrinoExternalError: Partition no longer exists

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Minor Minor
    • 2024-Aug-23
    • None
    • None
    • 1
    • False
    • None
    • False

      We are getting several alerts in a specific pod.

       

      https://glitchtip.devshift.net/insights/issues/743415?project=83&query=is:resolved

       

      GlitchTip logs:

      {"message":"'Partition no longer exists: aws_source=889668d0-8bdc-4e96-84fe-4311b3514efb/ocp_source=c1ec92fb-6521-4d5f-abe5-d00bac6001f3/year=2024/month=8/day=17'","errorCode":"16777247","errorName":"'HIVE_PARTITION_DROPPED_DURING_QUERY'","errorType":"'EXTERNAL'","failureInfo":{"type":"'io.trino.spi.TrinoException'","stack":["'io.trino.plugin.hive.HiveSplitManager.lambda$getPartitionMetadata$5(HiveSplitManager.java:344)'","'com.google.common.collect.Iterators$6.transform(Iterators.java:829)'","'com.google.common.collect.TransformedIterator.next(TransformedIterator.java:52)'","'java.base/java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1950)'","'java.base/java.util.stream.StreamSpliterators$WrappingSpliterator.lambda$initPartialTraversalState$0(StreamSpliterators.java:292)'","'java.base/java.util.stream.StreamSpliterators$AbstractWrappingSpliterator.fillBuffer(StreamSpliterators.java:206)'","'java.base/java.util.stream.StreamSpliterators$AbstractWrappingSpliterator.doAdvance(StreamSpliterators.java:169)'","'java.base/java.util.stream.StreamSpliterators$WrappingSpliterator.tryAdvance(StreamSpliterators.java:298)'","'java.base/java.util.Spliterators$1Adapter.hasNext(Spliterators.java:681)'","'io.trino.plugin.hive.ConcurrentLazyQueue.isEmpty(ConcurrentLazyQueue.java:34)'"],"message":"'Partition no longer exists: aws_source=889668d0-8bdc-4e96-84fe-4311b3514efb/ocp_source=c1ec92fb-6521-4d5f-abe5-d00bac6001f3/year=2024/month=8/day=17'","errorInfo":
      {"code":"16777247","name":"'HIVE_PARTITION_DROPPED_DURING_QUERY'","type":"'EXTERNAL'"},"suppressed":[]}} 

       
      Pod logs:

      trino.exceptions.TrinoExternalError: TrinoExternalError(type=EXTERNAL, name=HIVE_PARTITION_DROPPED_DURING_QUERY, message="Partition no longer exists: aws_source=889668d0-8bdc-4e96-84fe-4311b3514efb/ocp_source=34ad4e63-ea2d-420d-a068-acc6c9863717/year=2024/month=8/day=18", query_id=20240819_230057_18710_jh3cg)
      [2024-08-19 23:00:58,567] WARNING 2a5c5506-8bd9-46ab-a011-aca97cb68068 356
      {'message': 'data validation trino query failed: TrinoExternalError(type=EXTERNAL, name=HIVE_PARTITION_DROPPED_DURING_QUERY, message="Partition no longer exists: aws_source=889668d0-8bdc-4e96-84fe-4311b3514efb/ocp_source=34ad4e63-ea2d-420d-a068-acc6c9863717/year=2024/month=8/day=18", query_id=20240819_230057_18710_jh3cg)', 'tracing_id': '', 'schema': 'acct7049367', 'ocp_provider_uuid': '5a50ad75-b4f0-4ebe-98ca-8d04bd3c692e', 'provider_type': 'AWS', 'provider_uuid': '889668d0-8bdc-4e96-84fe-4311b3514efb', 'start_date': '2024-08-15', 'end_date': '2024-08-19', 'manifest_id': 5106310, 'queue_name': None}
      

       

       
       

       

            rh-ee-lbacciot Lucas Bacciotti
            rh-ee-lbacciot Lucas Bacciotti
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved: