Aug 04 00:02:06.532149 ip-10-0-142-136 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 00:02:06.976742 ip-10-0-142-136 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 00:02:06.976742 ip-10-0-142-136 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 00:02:06.976742 ip-10-0-142-136 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 00:02:06.976742 ip-10-0-142-136 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 00:02:06.976742 ip-10-0-142-136 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 00:02:06.978865 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.978773    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 00:02:06.987472 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987443    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:06.987472 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987467    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:06.987472 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987472    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:06.987472 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987476    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:06.987472 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987480    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:06.987472 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987485    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987489    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987494    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987498    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987501    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987507    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987510    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987515    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987518    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987522    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987525    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987529    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987533    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987537    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987541    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987544    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987548    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987552    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987560    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987564    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:06.987864 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987567    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987570    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987575    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987579    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987582    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987586    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987590    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987629    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987635    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987640    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987645    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987649    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987654    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987659    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987664    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987669    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987673    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987677    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987682    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987686    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:06.988664 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987709    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987716    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987722    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987727    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987732    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987738    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987742    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987746    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987750    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987755    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987761    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987765    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987769    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987773    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987778    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987782    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987786    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987793    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987798    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:06.989522 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987803    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987807    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987811    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987815    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987819    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987824    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987828    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987833    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987838    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987842    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987846    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987851    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987855    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987859    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987863    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987869    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987874    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987878    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987883    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:06.990388 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987889    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987894    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987898    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987903    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987907    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987911    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987915    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987920    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987924    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987928    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987933    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987937    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987942    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987946    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987951    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.987955    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989154    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989165    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989169    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989174    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:06.991221 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989179    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989184    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989189    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989198    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989204    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989209    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989214    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989218    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989222    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989227    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989232    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989237    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989241    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989248    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989253    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989257    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989261    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989265    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989269    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989273    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:06.992178 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989278    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989282    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989286    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989291    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989296    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989300    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989304    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989308    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989312    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989316    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989321    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989325    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989330    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989335    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989339    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989344    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989348    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989352    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989356    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989361    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:06.992856 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989365    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989369    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989374    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989378    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989382    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989386    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989392    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989396    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989401    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989407    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989411    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989416    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989420    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989424    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989428    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989432    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989436    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989440    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989444    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989448    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:06.993436 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989452    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989456    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989460    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989465    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989470    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989475    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989479    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989483    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989487    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989491    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989496    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989500    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989504    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989508    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989513    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989519    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989523    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989527    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989530    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989535    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:06.994087 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989539    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989543    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989547    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989551    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989556    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989564    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989570    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989575    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989580    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989584    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989589    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989593    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989597    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989601    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.989606    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990264    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990274    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990278    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990283    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:06.994594 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990287    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990291    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990296    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990300    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990305    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990309    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990313    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990317    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990330    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990334    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990339    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990343    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990348    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990352    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990357    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990362    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990366    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990370    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990374    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:06.995125 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990378    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990383    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990389    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990395    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990400    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990404    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990409    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990413    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990419    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990425    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990435    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990440    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990444    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990449    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990453    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990457    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990463    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990467    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990471    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:06.995653 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990476    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990480    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990484    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990488    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990492    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990497    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990501    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990506    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990511    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990515    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990519    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990524    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990528    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990532    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990536    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990540    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990544    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990549    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990553    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990557    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:06.996234 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990561    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990567    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990573    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990579    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990583    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990587    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990592    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990597    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990601    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990605    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990609    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990613    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990617    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990621    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990625    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990629    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990634    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990638    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990642    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990646    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:06.996771 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990651    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990658    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990662    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990666    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990670    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990674    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990678    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990682    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990701    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990706    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990710    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990715    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990719    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990723    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990728    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990734    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.990739    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990843    2571 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990855    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990866    2571 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990879    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 00:02:06.997257 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990886    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990891    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990898    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990905    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990910    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990915    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990920    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990926    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990931    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990936    2571 flags.go:64] FLAG: --cgroup-root=""
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990940    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990945    2571 flags.go:64] FLAG: --client-ca-file=""
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990950    2571 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990956    2571 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990962    2571 flags.go:64] FLAG: --cluster-domain=""
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990966    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990971    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990979    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990984    2571 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990990    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.990995    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991000    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991005    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991010    2571 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 00:02:06.997790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991015    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991020    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991028    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991033    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991040    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991045    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991050    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991054    2571 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991059    2571 flags.go:64] FLAG: --enable-server="true"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991063    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991072    2571 flags.go:64] FLAG: --event-burst="100"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991077    2571 flags.go:64] FLAG: --event-qps="50"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991082    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991087    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991091    2571 flags.go:64] FLAG: --eviction-hard=""
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991097    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991102    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991107    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991112    2571 flags.go:64] FLAG: --eviction-soft=""
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991117    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991121    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991127    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991132    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991136    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991141    2571 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 00:02:06.998375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991147    2571 flags.go:64] FLAG: --feature-gates=""
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991153    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991158    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991163    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991168    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991173    2571 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991177    2571 flags.go:64] FLAG: --help="false"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991182    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-142-136.ec2.internal"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991187    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991193    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991198    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991204    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991209    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991214    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991218    2571 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991223    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991228    2571 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991232    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991237    2571 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991242    2571 flags.go:64] FLAG: --kube-reserved=""
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991246    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991251    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991256    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991261    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 00:02:06.999094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991267    2571 flags.go:64] FLAG: --lock-file=""
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991271    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991276    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991281    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991290    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991300    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991305    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991310    2571 flags.go:64] FLAG: --logging-format="text"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991315    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991320    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991325    2571 flags.go:64] FLAG: --manifest-url=""
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991330    2571 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991337    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991342    2571 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991349    2571 flags.go:64] FLAG: --max-pods="110"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991354    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991358    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991363    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991367    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991372    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991377    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991382    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991394    2571 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991398    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991403    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 00:02:06.999681 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991408    2571 flags.go:64] FLAG: --pod-cidr=""
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991412    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991421    2571 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991426    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991431    2571 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991435    2571 flags.go:64] FLAG: --port="10250"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991440    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991444    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b98e2bc008cd496c"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991449    2571 flags.go:64] FLAG: --qos-reserved=""
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991454    2571 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991459    2571 flags.go:64] FLAG: --register-node="true"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991463    2571 flags.go:64] FLAG: --register-with-taints=""
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991469    2571 flags.go:64] FLAG: --registry-burst="10"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991482    2571 flags.go:64] FLAG: --registry-qps="5"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991487    2571 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991492    2571 flags.go:64] FLAG: --reserved-memory=""
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991498    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991503    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991508    2571 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991513    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991517    2571 flags.go:64] FLAG: --runonce="false"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991521    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991526    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991532    2571 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991536    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 00:02:07.000345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991542    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991547    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991552    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991557    2571 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991561    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991566    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991570    2571 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991575    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991580    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991585    2571 flags.go:64] FLAG: --system-cgroups=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991590    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991599    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991603    2571 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991607    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991613    2571 flags.go:64] FLAG: --tls-min-version=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991618    2571 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991623    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991627    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991632    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991637    2571 flags.go:64] FLAG: --v="2"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991643    2571 flags.go:64] FLAG: --version="false"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991658    2571 flags.go:64] FLAG: --vmodule=""
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991665    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.991670    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991895    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:07.001038 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991904    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991910    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991914    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991919    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991924    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991928    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991932    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991937    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991942    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991948    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991955    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991961    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991965    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991970    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991974    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991978    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991982    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991987    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991991    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:07.001659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.991996    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992000    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992005    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992009    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992013    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992018    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992022    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992026    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992030    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992035    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992041    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992045    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992049    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992053    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992057    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992062    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992067    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992071    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992075    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992080    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:07.002146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992084    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992088    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992092    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992096    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992100    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992106    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992110    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992115    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992119    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992123    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992128    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992132    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992136    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992140    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992144    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992149    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992153    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992157    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992162    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992166    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:07.002652 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992170    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992174    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992181    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992185    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992189    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992193    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992197    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992201    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992205    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992209    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992213    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992217    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992223    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992227    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992231    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992235    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992239    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992244    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992248    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:07.003160 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992252    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992257    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992261    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992266    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992270    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992274    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992278    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992283    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992287    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992294    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992299    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992304    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992309    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992313    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992317    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992323    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992328    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992333    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992337    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:07.003620 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:06.992341    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:06.992350    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.000371    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.000387    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.001298    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.001306    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001380    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001385    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001389    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001394    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001398    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001401    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001404    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001407    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001410    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:07.004137 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001412    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001415    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001418    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001420    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001423    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001426    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001429    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001432    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001434    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001437    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001439    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001442    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001444    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001447    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001449    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001453    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001455    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001458    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001460    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001463    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:07.004513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001467    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001470    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001472    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001475    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001477    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001480    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001483    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001486    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001488    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001491    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001494    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001496    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001499    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001501    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001504    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001506    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001509    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001511    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001514    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001516    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:07.005008 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001519    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001522    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001524    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001526    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001529    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001532    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001535    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001537    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001540    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001543    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001546    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001549    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001552    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001554    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001557    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001559    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001562    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001565    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001567    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:07.005513 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001570    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001572    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001575    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001577    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001580    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001582    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001586    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001589    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001592    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001595    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001597    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001599    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001602    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001605    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001607    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001610    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001612    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001615    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001618    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001621    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:07.006026 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001623    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001627    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001631    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001634    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001637    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001640    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001643    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001645    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001648    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001651    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001653    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.001659    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001812    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001818    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:07.006520 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001821    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001824    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001827    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001833    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001835    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001838    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001841    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001844    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001846    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001849    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001851    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001854    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001856    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001859    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001861    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001864    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001867    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001870    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001872    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001875    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:07.006889 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001877    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001886    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001888    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001891    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001895    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001898    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001901    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001904    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001907    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001910    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001913    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001916    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001919    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001921    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001924    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001927    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001929    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001938    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001940    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:07.007368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001943    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001945    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001948    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001950    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001953    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001955    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001958    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001960    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001963    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001966    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001969    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001971    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001974    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001976    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001979    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001987    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001991    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001995    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.001998    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002000    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:07.007847 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002003    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002006    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002008    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002011    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002014    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002016    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002019    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002022    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002024    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002026    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002029    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002031    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002034    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002036    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002039    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002041    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002044    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002046    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002049    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002051    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:07.008323 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002054    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002057    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002059    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002062    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002064    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002067    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002069    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002072    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002080    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002083    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002085    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002088    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002090    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002092    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002095    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002097    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002100    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:07.008816 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:07.002102    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:07.009260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.002107    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 00:02:07.009260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.002226    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 00:02:07.009260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.004756    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 00:02:07.009260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.006504    2571 server.go:1019] "Starting client certificate rotation"
Aug 04 00:02:07.009260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.006651    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 00:02:07.009260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.006715    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 00:02:07.009503 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.009490    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 00:02:07.012968 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.012913    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 00:02:07.027024 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.027000    2571 log.go:25] "Validated CRI v1 runtime API"
Aug 04 00:02:07.029538 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.029518    2571 log.go:25] "Validated CRI v1 image API"
Aug 04 00:02:07.030431 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.030412    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 00:02:07.033263 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.033243    2571 fs.go:135] Filesystem UUIDs: map[5ef98cf2-1014-4e66-ba91-184792634e64:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d73d676b-d552-49bf-a52c-4e5b93370ccf:/dev/nvme0n1p3]
Aug 04 00:02:07.033325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.033263    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 00:02:07.036189 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.036165    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 00:02:07.040187 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.040062    2571 manager.go:216] Machine: {Timestamp:2026-08-04 00:02:07.038627132 +0000 UTC m=+0.378662988 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100264 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24900dae78e148f15c6be491a5b213 SystemUUID:ec24900d-ae78-e148-f15c-6be491a5b213 BootID:a9c4995a-81fa-4d32-b055-a5ff776ad1bc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:96:d7:84:fa:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:96:d7:84:fa:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:d0:90:9c:e4:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 00:02:07.040187 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.040174    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 00:02:07.040367 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.040346    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 00:02:07.043936 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.043909    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 00:02:07.044077 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.043939    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 00:02:07.045516 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.045504    2571 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 00:02:07.045551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.045519    2571 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 00:02:07.045551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.045527    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 00:02:07.046389 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.046378    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 00:02:07.047685 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.047675    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 00:02:07.053169 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053156    2571 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 00:02:07.053288 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053278    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 00:02:07.053332 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053310    2571 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 00:02:07.053332 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053320    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 00:02:07.053332 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053330    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 00:02:07.053437 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053339    2571 kubelet.go:398] "Adding apiserver pod source"
Aug 04 00:02:07.053437 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053348    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 00:02:07.053781 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053764    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 00:02:07.053831 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.053790    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 00:02:07.056241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.056218    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 00:02:07.058215 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.058201    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 00:02:07.058285 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.058231    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 00:02:07.059674 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059660    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059677    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059683    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059702    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059712    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059718    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059726    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 00:02:07.059741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059732    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 00:02:07.059919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059748    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 00:02:07.059919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059757    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 00:02:07.059919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059770    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 00:02:07.059919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.059780    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 00:02:07.060597 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.060585    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 00:02:07.060597 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.060597    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 00:02:07.063905 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.063882    2571 server.go:1268] "Started kubelet"
Aug 04 00:02:07.063992 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.063949    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 00:02:07.064138 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.064090    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 00:02:07.064664 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.064645    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 00:02:07.064828 ip-10-0-142-136 systemd[1]: Started Kubernetes Kubelet.
Aug 04 00:02:07.068608 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.068572    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 00:02:07.070539 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.070515    2571 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 00:02:07.071333 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.071283    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 00:02:07.071452 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.071419    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 00:02:07.071542 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.071453    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 00:02:07.071717 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.071510    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 00:02:07.074347 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.071801    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-136.ec2.internal.18c871358ceb92c3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-136.ec2.internal,UID:ip-10-0-142-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-136.ec2.internal,},FirstTimestamp:2026-08-04 00:02:07.063855811 +0000 UTC m=+0.403891669,LastTimestamp:2026-08-04 00:02:07.063855811 +0000 UTC m=+0.403891669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-136.ec2.internal,}"
Aug 04 00:02:07.076085 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.076068    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 00:02:07.076141 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.076081    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 00:02:07.076183 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.076154    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.076907 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.076889    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 00:02:07.076981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.076909    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 00:02:07.076981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.076889    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 00:02:07.077062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077019    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 00:02:07.077062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077034    2571 factory.go:55] Registering systemd factory
Aug 04 00:02:07.077062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077043    2571 factory.go:223] Registration of the systemd container factory successfully
Aug 04 00:02:07.077182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077035    2571 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 00:02:07.077182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077074    2571 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 00:02:07.077312 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077294    2571 factory.go:153] Registering CRI-O factory
Aug 04 00:02:07.077312 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077311    2571 factory.go:223] Registration of the crio container factory successfully
Aug 04 00:02:07.077457 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077336    2571 factory.go:103] Registering Raw factory
Aug 04 00:02:07.077457 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077350    2571 manager.go:1196] Started watching for new ooms in manager
Aug 04 00:02:07.077776 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.077763    2571 manager.go:349] Starting recovery of all containers
Aug 04 00:02:07.080655 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.080627    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 00:02:07.080966 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.080942    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 00:02:07.083292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.083267    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w9xkx"
Aug 04 00:02:07.089569 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.089549    2571 manager.go:354] Recovery completed
Aug 04 00:02:07.091330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.091313    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w9xkx"
Aug 04 00:02:07.094671 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.094657    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.096870 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.096851    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.096935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.096885    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.096935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.096899    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.097437 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.097422    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 00:02:07.097503 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.097434    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.097503 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.097437    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 00:02:07.097503 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.097501    2571 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 00:02:07.098316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.098302    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.098399 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.098334    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.098399 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.098345    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.098977 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.098901    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-136.ec2.internal.18c871358ee35141  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-136.ec2.internal,UID:ip-10-0-142-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-136.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-136.ec2.internal,},FirstTimestamp:2026-08-04 00:02:07.096869185 +0000 UTC m=+0.436905041,LastTimestamp:2026-08-04 00:02:07.096869185 +0000 UTC m=+0.436905041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-136.ec2.internal,}"
Aug 04 00:02:07.099492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.099482    2571 policy_none.go:49] "None policy: Start"
Aug 04 00:02:07.099527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.099498    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 00:02:07.099527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.099508    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 00:02:07.101464 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.101453    2571 policy_none.go:47] "Start"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.137307    2571 manager.go:337] "Starting Device Plugin manager"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.137522    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.137534    2571 server.go:87] "Starting device plugin registration server"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.137704    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.137835    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.137848    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.137932    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.138004    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.138012    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.138626    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.138675    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.139065    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.139103    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.139122    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.139158    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 00:02:07.148551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.141480    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:07.238981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.238890    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.239310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.239291    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"]
Aug 04 00:02:07.239381 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.239369    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.239893 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.239872    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.239971 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.239905    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.239971 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.239916    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.239971 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.239946    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.240139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.240121    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.240179 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.240156    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.240179 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.240172    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.242580 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.242568    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.242718 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.242705    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.242757 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.242734    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.243294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.243277    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.243294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.243287    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.243449 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.243306    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.243449 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.243321    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.243449 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.243308    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.243449 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.243390    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.245636 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.245620    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.245745 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.245648    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:07.246309 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.246292    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:07.246395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.246317    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:07.246395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.246335    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:07.249739 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.249722    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.249829 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.249746    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-136.ec2.internal\": node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.268363 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.268342    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-136.ec2.internal\" not found" node="ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.272721 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.272701    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-136.ec2.internal\" not found" node="ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.278522 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.278504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aed72ea57421a105ed2430861abf08fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal\" (UID: \"aed72ea57421a105ed2430861abf08fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.278578 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.278529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aed72ea57421a105ed2430861abf08fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal\" (UID: \"aed72ea57421a105ed2430861abf08fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.278578 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.278545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e4cea72394bd0b0963f00a98984e037-config\") pod \"kube-apiserver-proxy-ip-10-0-142-136.ec2.internal\" (UID: \"4e4cea72394bd0b0963f00a98984e037\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.281187 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.281169    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.379711 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.379659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aed72ea57421a105ed2430861abf08fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal\" (UID: \"aed72ea57421a105ed2430861abf08fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.379711 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.379704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aed72ea57421a105ed2430861abf08fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal\" (UID: \"aed72ea57421a105ed2430861abf08fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.379916 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.379722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e4cea72394bd0b0963f00a98984e037-config\") pod \"kube-apiserver-proxy-ip-10-0-142-136.ec2.internal\" (UID: \"4e4cea72394bd0b0963f00a98984e037\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.379916 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.379769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e4cea72394bd0b0963f00a98984e037-config\") pod \"kube-apiserver-proxy-ip-10-0-142-136.ec2.internal\" (UID: \"4e4cea72394bd0b0963f00a98984e037\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.379916 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.379769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aed72ea57421a105ed2430861abf08fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal\" (UID: \"aed72ea57421a105ed2430861abf08fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.379916 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.379780    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aed72ea57421a105ed2430861abf08fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal\" (UID: \"aed72ea57421a105ed2430861abf08fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.381773 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.381756    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.482345 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.482299    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.571861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.571803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.576377 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.576362    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:07.582899 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.582882    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.683586 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.683536    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.784564 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.784534    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.885133 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.885049    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:07.932897 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:07.932869    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:07.985934 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:07.985898    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-136.ec2.internal\" not found"
Aug 04 00:02:08.006151 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.006099    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 00:02:08.006304 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.006290    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 00:02:08.006357 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.006321    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 00:02:08.024557 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.024526    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:08.055019 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.054972    2571 apiserver.go:52] "Watching apiserver"
Aug 04 00:02:08.063993 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.063962    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 00:02:08.064350 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.064327    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lsq9x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn","openshift-dns/node-resolver-dc68r","openshift-image-registry/node-ca-tdlsb","openshift-multus/multus-684qb","openshift-multus/multus-additional-cni-plugins-56p8m","openshift-network-diagnostics/network-check-target-87cf5","openshift-ovn-kubernetes/ovnkube-node-97p4s","kube-system/global-pull-secret-syncer-ddcl4","openshift-cluster-node-tuning-operator/tuned-llv9g","openshift-multus/network-metrics-daemon-7pbsf","openshift-network-operator/iptables-alerter-f74ck"]
Aug 04 00:02:08.067148 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.067127    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.069534 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.069510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.069847 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.069828    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 00:02:08.069941 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.069913    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 00:02:08.069999 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.069989    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fhcpj\""
Aug 04 00:02:08.073179 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.073135    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.073307 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.073235    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 00:02:08.073471 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.073451    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sg6zn\""
Aug 04 00:02:08.073546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.073457    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.073603 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.073552    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.075310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.075285    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jvbds\""
Aug 04 00:02:08.075573 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.075558    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.075700 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.075587    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.075960 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.075946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.076174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.076157    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 00:02:08.076266 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.076252    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:08.078193 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.078176    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.078265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.078248    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.078328 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.078277    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 00:02:08.078328 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.078288    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-srwlb\""
Aug 04 00:02:08.078417 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.078400    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.080593 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.080574    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.080684 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.080638    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jgv2c\""
Aug 04 00:02:08.080747 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.080707    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 00:02:08.080826 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.080785    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.081062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.081039    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.081152 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.081088    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 00:02:08.083026 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.083009    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 00:02:08.083113 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.083060    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b47kz\""
Aug 04 00:02:08.083113 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.083061    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 00:02:08.083285 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.083268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:08.083363 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.083340    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:08.084985 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.084960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-k8s-cni-cncf-io\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085067 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-cni-bin\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085067 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbmr9\" (UniqueName: \"kubernetes.io/projected/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-kube-api-access-wbmr9\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.085148 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-kubelet\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085148 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-sys-fs\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085148 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnpm\" (UniqueName: \"kubernetes.io/projected/2fb32d48-309a-4f3e-844a-b5741a9d84d3-kube-api-access-ksnpm\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085282 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b872291-f419-4f30-b3f3-b3726dfa8f4d-cni-binary-copy\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085282 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-cni-multus\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085282 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-hostroot\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085372 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgtp4\" (UniqueName: \"kubernetes.io/projected/06864f10-06e5-4538-aeea-6d7312ba87d5-kube-api-access-cgtp4\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.085372 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085304    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-system-cni-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085372 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-cnibin\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085372 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-daemon-config\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085489 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xrrr\" (UniqueName: \"kubernetes.io/projected/6b872291-f419-4f30-b3f3-b3726dfa8f4d-kube-api-access-4xrrr\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085489 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-conf-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085489 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-multus-certs\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085489 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085452    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-socket-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085489 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085480    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-cni-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-etc-kubernetes\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085536    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06864f10-06e5-4538-aeea-6d7312ba87d5-tmp-dir\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-serviceca\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-os-release\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085609    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-netns\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.085655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085649    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf8a8e2c-c735-45f9-887e-2ff2d93e1312-konnectivity-ca\") pod \"konnectivity-agent-lsq9x\" (UID: \"bf8a8e2c-c735-45f9-887e-2ff2d93e1312\") " pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-registration-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-device-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085755    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06864f10-06e5-4538-aeea-6d7312ba87d5-hosts-file\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf8a8e2c-c735-45f9-887e-2ff2d93e1312-agent-certs\") pod \"konnectivity-agent-lsq9x\" (UID: \"bf8a8e2c-c735-45f9-887e-2ff2d93e1312\") " pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.085958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-host\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.086295 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.085976    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-socket-dir-parent\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.088000 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.087979    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 00:02:08.088331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.088306    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 00:02:08.088406 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.088389    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.088494 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.088471    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:08.088561 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.088497    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 00:02:08.088617 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.088563    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hftt2\""
Aug 04 00:02:08.088683 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.088631    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.088944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.088927    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.089074 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.089056    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 00:02:08.089179 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.089160    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 00:02:08.090933 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.090919    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.093308 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.093291    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 00:02:08.093396 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.093323    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cp85r\""
Aug 04 00:02:08.093396 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.093339    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.093396 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.093378    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.093396 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.093391    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"
Aug 04 00:02:08.093574 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.093421    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:08.093632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.093619    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.095819 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.095804    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal"]
Aug 04 00:02:08.095899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.095887    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.097404 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.097368    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-02 23:57:07 +0000 UTC" deadline="2028-04-22 19:34:52.84107307 +0000 UTC"
Aug 04 00:02:08.097404 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.097402    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15067h32m44.743673544s"
Aug 04 00:02:08.098360 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.098346    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6jjc9\""
Aug 04 00:02:08.098532 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.098519    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:08.098585 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.098566    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:08.098968 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.098955    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 00:02:08.104101 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.104084    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 00:02:08.104271 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.104255    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal"]
Aug 04 00:02:08.116382 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.116357    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jzktk"
Aug 04 00:02:08.125349 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.125326    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jzktk"
Aug 04 00:02:08.177895 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.177872    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 00:02:08.186341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06864f10-06e5-4538-aeea-6d7312ba87d5-tmp-dir\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.186496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-serviceca\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.186496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf8a8e2c-c735-45f9-887e-2ff2d93e1312-konnectivity-ca\") pod \"konnectivity-agent-lsq9x\" (UID: \"bf8a8e2c-c735-45f9-887e-2ff2d93e1312\") " pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.186496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-device-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.186496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cnibin\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.186496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-run\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.186496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06864f10-06e5-4538-aeea-6d7312ba87d5-hosts-file\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf8a8e2c-c735-45f9-887e-2ff2d93e1312-agent-certs\") pod \"konnectivity-agent-lsq9x\" (UID: \"bf8a8e2c-c735-45f9-887e-2ff2d93e1312\") " pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-system-cni-dir\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-modprobe-d\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186611    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-kubernetes\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-host\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-device-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-k8s-cni-cncf-io\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-k8s-cni-cncf-io\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-cni-bin\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-var-lib-kubelet\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/254c1d19-0c07-453c-ba57-371148e9d90d-host-slash\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.186836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06864f10-06e5-4538-aeea-6d7312ba87d5-hosts-file\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbmr9\" (UniqueName: \"kubernetes.io/projected/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-kube-api-access-wbmr9\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186890    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-kubelet\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-os-release\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.186972    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87f93f9e-4024-453f-b593-7bd09fe5ea55-kubelet-config\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-kubelet\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187007    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-cni-bin\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187027    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-systemd\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187053    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-var-lib-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovnkube-script-lib\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b872291-f419-4f30-b3f3-b3726dfa8f4d-cni-binary-copy\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187194    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-host\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187210    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-cni-multus\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-systemd-units\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06864f10-06e5-4538-aeea-6d7312ba87d5-tmp-dir\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.187478 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-systemd\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187387    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-lib-modules\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-host\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25rnt\" (UniqueName: \"kubernetes.io/projected/7f5a69cd-a194-4464-84d8-2b97fd9290b7-kube-api-access-25rnt\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgtp4\" (UniqueName: \"kubernetes.io/projected/06864f10-06e5-4538-aeea-6d7312ba87d5-kube-api-access-cgtp4\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-system-cni-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xrrr\" (UniqueName: \"kubernetes.io/projected/6b872291-f419-4f30-b3f3-b3726dfa8f4d-kube-api-access-4xrrr\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqgf9\" (UniqueName: \"kubernetes.io/projected/f08bc5f7-cacb-4e54-99ca-adafff1941ca-kube-api-access-nqgf9\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf8a8e2c-c735-45f9-887e-2ff2d93e1312-konnectivity-ca\") pod \"konnectivity-agent-lsq9x\" (UID: \"bf8a8e2c-c735-45f9-887e-2ff2d93e1312\") " pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-etc-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysctl-d\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-serviceca\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-conf-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-cni-multus\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-multus-certs\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.188292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-system-cni-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-run-netns\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-env-overrides\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.187984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysconfig\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysctl-conf\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188027    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-conf-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188036    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-tuned\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188067    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-cni-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188070    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-multus-certs\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188064    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-var-lib-kubelet\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87f93f9e-4024-453f-b593-7bd09fe5ea55-dbus\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-log-socket\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ddq\" (UniqueName: \"kubernetes.io/projected/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-kube-api-access-f2ddq\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-os-release\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188270    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-cni-dir\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-netns\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.189227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188327    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-registration-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b872291-f419-4f30-b3f3-b3726dfa8f4d-cni-binary-copy\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188358    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-sys\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-host-run-netns\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-os-release\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188405    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-registration-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8rq8\" (UniqueName: \"kubernetes.io/projected/254c1d19-0c07-453c-ba57-371148e9d90d-kube-api-access-p8rq8\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188502    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovnkube-config\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/254c1d19-0c07-453c-ba57-371148e9d90d-iptables-alerter-script\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-socket-dir-parent\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-sys-fs\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnpm\" (UniqueName: \"kubernetes.io/projected/2fb32d48-309a-4f3e-844a-b5741a9d84d3-kube-api-access-ksnpm\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-socket-dir-parent\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188705    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-sys-fs\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdgt\" (UniqueName: \"kubernetes.io/projected/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-kube-api-access-chdgt\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-slash\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188878    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-hostroot\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188923    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188965    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.188971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-hostroot\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-ovn\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovn-node-metrics-cert\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-cnibin\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-daemon-config\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189177    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5a69cd-a194-4464-84d8-2b97fd9290b7-tmp\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189206    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-socket-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189246    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-cnibin\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-cni-bin\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-etc-kubernetes\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-node-log\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.190975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.191672 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-cni-netd\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.191672 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.191672 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb32d48-309a-4f3e-844a-b5741a9d84d3-socket-dir\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.191672 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189712    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b872291-f419-4f30-b3f3-b3726dfa8f4d-multus-daemon-config\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.191672 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.189728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b872291-f419-4f30-b3f3-b3726dfa8f4d-etc-kubernetes\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.192122 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.192098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf8a8e2c-c735-45f9-887e-2ff2d93e1312-agent-certs\") pod \"konnectivity-agent-lsq9x\" (UID: \"bf8a8e2c-c735-45f9-887e-2ff2d93e1312\") " pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.196395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.196367    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xrrr\" (UniqueName: \"kubernetes.io/projected/6b872291-f419-4f30-b3f3-b3726dfa8f4d-kube-api-access-4xrrr\") pod \"multus-684qb\" (UID: \"6b872291-f419-4f30-b3f3-b3726dfa8f4d\") " pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.196526 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.196429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbmr9\" (UniqueName: \"kubernetes.io/projected/727b67a9-8e1d-47e7-9e39-9ad7a66b7e06-kube-api-access-wbmr9\") pod \"node-ca-tdlsb\" (UID: \"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06\") " pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.196704 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.196681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgtp4\" (UniqueName: \"kubernetes.io/projected/06864f10-06e5-4538-aeea-6d7312ba87d5-kube-api-access-cgtp4\") pod \"node-resolver-dc68r\" (UID: \"06864f10-06e5-4538-aeea-6d7312ba87d5\") " pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.197166 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.197149    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnpm\" (UniqueName: \"kubernetes.io/projected/2fb32d48-309a-4f3e-844a-b5741a9d84d3-kube-api-access-ksnpm\") pod \"aws-ebs-csi-driver-node-f87tn\" (UID: \"2fb32d48-309a-4f3e-844a-b5741a9d84d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.289673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.289673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-var-lib-kubelet\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/254c1d19-0c07-453c-ba57-371148e9d90d-host-slash\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-os-release\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87f93f9e-4024-453f-b593-7bd09fe5ea55-kubelet-config\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.289823    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-var-lib-kubelet\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/254c1d19-0c07-453c-ba57-371148e9d90d-host-slash\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-kubelet\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289933    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-kubelet\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.289949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87f93f9e-4024-453f-b593-7bd09fe5ea55-kubelet-config\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.290512 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.290264    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:08.78988205 +0000 UTC m=+2.129917916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:08.290512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-systemd\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-systemd\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-var-lib-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290486    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-os-release\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.290512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovnkube-script-lib\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290528    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-systemd-units\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290529    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-var-lib-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-systemd-units\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-systemd\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-systemd\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-lib-modules\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-host\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25rnt\" (UniqueName: \"kubernetes.io/projected/7f5a69cd-a194-4464-84d8-2b97fd9290b7-kube-api-access-25rnt\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290787    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-host\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgf9\" (UniqueName: \"kubernetes.io/projected/f08bc5f7-cacb-4e54-99ca-adafff1941ca-kube-api-access-nqgf9\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-etc-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.290854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290849    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-lib-modules\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysctl-d\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-etc-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.290986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-openvswitch\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-run-netns\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-env-overrides\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291029    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysctl-d\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysconfig\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-run-netns\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291158    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovnkube-script-lib\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291175    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysctl-conf\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-tuned\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291214    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysconfig\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87f93f9e-4024-453f-b593-7bd09fe5ea55-dbus\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-log-socket\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.291525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291298    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-sysctl-conf\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87f93f9e-4024-453f-b593-7bd09fe5ea55-dbus\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291351    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-log-socket\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ddq\" (UniqueName: \"kubernetes.io/projected/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-kube-api-access-f2ddq\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-sys\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8rq8\" (UniqueName: \"kubernetes.io/projected/254c1d19-0c07-453c-ba57-371148e9d90d-kube-api-access-p8rq8\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovnkube-config\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/254c1d19-0c07-453c-ba57-371148e9d90d-iptables-alerter-script\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdgt\" (UniqueName: \"kubernetes.io/projected/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-kube-api-access-chdgt\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-env-overrides\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.291976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-slash\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292103    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-ovn\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.292330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-run-ovn\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-slash\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292437    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-sys\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292736    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/254c1d19-0c07-453c-ba57-371148e9d90d-iptables-alerter-script\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovn-node-metrics-cert\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5a69cd-a194-4464-84d8-2b97fd9290b7-tmp\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.292959    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-cni-bin\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:08.293055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293071    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-node-log\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-cni-netd\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cnibin\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-run\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293251    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovnkube-config\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-system-cni-dir\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-modprobe-d\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-kubernetes\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.293527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-cni-netd\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293982 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.293628    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:08.293982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-kubernetes\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.293982 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.293706    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret podName:87f93f9e-4024-453f-b593-7bd09fe5ea55 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:08.793683793 +0000 UTC m=+2.133719637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret") pod "global-pull-secret-syncer-ddcl4" (UID: "87f93f9e-4024-453f-b593-7bd09fe5ea55") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:08.293982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-cni-bin\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.293982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.293898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.294231 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-node-log\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.294231 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-run\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.294231 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-cnibin\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.294231 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.294417 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294263    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-modprobe-d\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.294417 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-system-cni-dir\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.294508 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294412    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08bc5f7-cacb-4e54-99ca-adafff1941ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.294508 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.294463    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f08bc5f7-cacb-4e54-99ca-adafff1941ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.295092 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.295059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f5a69cd-a194-4464-84d8-2b97fd9290b7-etc-tuned\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.297212 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.297183    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5a69cd-a194-4464-84d8-2b97fd9290b7-tmp\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.297882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.297858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-ovn-node-metrics-cert\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.299310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.299291    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25rnt\" (UniqueName: \"kubernetes.io/projected/7f5a69cd-a194-4464-84d8-2b97fd9290b7-kube-api-access-25rnt\") pod \"tuned-llv9g\" (UID: \"7f5a69cd-a194-4464-84d8-2b97fd9290b7\") " pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.300989 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.300965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqgf9\" (UniqueName: \"kubernetes.io/projected/f08bc5f7-cacb-4e54-99ca-adafff1941ca-kube-api-access-nqgf9\") pod \"multus-additional-cni-plugins-56p8m\" (UID: \"f08bc5f7-cacb-4e54-99ca-adafff1941ca\") " pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.303421 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.303399    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:08.303545 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.303427    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:08.303545 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.303442    2571 projected.go:196] Error preparing data for projected volume kube-api-access-42lv9 for pod openshift-network-diagnostics/network-check-target-87cf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:08.303545 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.303517    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9 podName:057f196b-d0f5-42d7-861f-121f68640d4b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:08.803498702 +0000 UTC m=+2.143534563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-42lv9" (UniqueName: "kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9") pod "network-check-target-87cf5" (UID: "057f196b-d0f5-42d7-861f-121f68640d4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:08.305748 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.305726    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdgt\" (UniqueName: \"kubernetes.io/projected/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-kube-api-access-chdgt\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.306059 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.306038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8rq8\" (UniqueName: \"kubernetes.io/projected/254c1d19-0c07-453c-ba57-371148e9d90d-kube-api-access-p8rq8\") pod \"iptables-alerter-f74ck\" (UID: \"254c1d19-0c07-453c-ba57-371148e9d90d\") " pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.306455 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.306440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ddq\" (UniqueName: \"kubernetes.io/projected/c2eeb15d-6446-49aa-8eb8-17c7998be3b4-kube-api-access-f2ddq\") pod \"ovnkube-node-97p4s\" (UID: \"c2eeb15d-6446-49aa-8eb8-17c7998be3b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.316634 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.316600    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed72ea57421a105ed2430861abf08fc.slice/crio-cdf15914739ee8ae73ee7f74f19c4e83b3307a06f7dc1acf39091b1ab096ee47 WatchSource:0}: Error finding container cdf15914739ee8ae73ee7f74f19c4e83b3307a06f7dc1acf39091b1ab096ee47: Status 404 returned error can't find the container with id cdf15914739ee8ae73ee7f74f19c4e83b3307a06f7dc1acf39091b1ab096ee47
Aug 04 00:02:08.318438 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.318417    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4cea72394bd0b0963f00a98984e037.slice/crio-168687d344fafbbae3afda6ad65ea2d9851223a0a0e65dbb94b2a63dd1ea2023 WatchSource:0}: Error finding container 168687d344fafbbae3afda6ad65ea2d9851223a0a0e65dbb94b2a63dd1ea2023: Status 404 returned error can't find the container with id 168687d344fafbbae3afda6ad65ea2d9851223a0a0e65dbb94b2a63dd1ea2023
Aug 04 00:02:08.322935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.322921    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:02:08.392271 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.392236    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:08.402448 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.402388    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8a8e2c_c735_45f9_887e_2ff2d93e1312.slice/crio-92e1970601e701999542a68c1f74f09c7ec6c986f167a57bd4a7331e67348e98 WatchSource:0}: Error finding container 92e1970601e701999542a68c1f74f09c7ec6c986f167a57bd4a7331e67348e98: Status 404 returned error can't find the container with id 92e1970601e701999542a68c1f74f09c7ec6c986f167a57bd4a7331e67348e98
Aug 04 00:02:08.422882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.422828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn"
Aug 04 00:02:08.431896 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.431870    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb32d48_309a_4f3e_844a_b5741a9d84d3.slice/crio-cfaa3273d01e7ae64b40936e8919b3a903e7a4ed9c9b0b952606ac1d6dbcce13 WatchSource:0}: Error finding container cfaa3273d01e7ae64b40936e8919b3a903e7a4ed9c9b0b952606ac1d6dbcce13: Status 404 returned error can't find the container with id cfaa3273d01e7ae64b40936e8919b3a903e7a4ed9c9b0b952606ac1d6dbcce13
Aug 04 00:02:08.435071 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.435055    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dc68r"
Aug 04 00:02:08.443918 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.443896    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06864f10_06e5_4538_aeea_6d7312ba87d5.slice/crio-8e6efcb6deebba6f60a4b926a2ea9e13699287dc920a1872a203d084d5d61e4b WatchSource:0}: Error finding container 8e6efcb6deebba6f60a4b926a2ea9e13699287dc920a1872a203d084d5d61e4b: Status 404 returned error can't find the container with id 8e6efcb6deebba6f60a4b926a2ea9e13699287dc920a1872a203d084d5d61e4b
Aug 04 00:02:08.450066 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.450048    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tdlsb"
Aug 04 00:02:08.458957 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.458932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727b67a9_8e1d_47e7_9e39_9ad7a66b7e06.slice/crio-0a72139a4c7fee7fb4a356452e264ee55642c78580e901f8363de929713d75c6 WatchSource:0}: Error finding container 0a72139a4c7fee7fb4a356452e264ee55642c78580e901f8363de929713d75c6: Status 404 returned error can't find the container with id 0a72139a4c7fee7fb4a356452e264ee55642c78580e901f8363de929713d75c6
Aug 04 00:02:08.467115 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.467094    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-684qb"
Aug 04 00:02:08.491914 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.491893    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56p8m"
Aug 04 00:02:08.500383 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.500358    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08bc5f7_cacb_4e54_99ca_adafff1941ca.slice/crio-7b5260f7043a9ffe79e6d0cbf7a29e3502951efa6510664422ec1dcc968b9336 WatchSource:0}: Error finding container 7b5260f7043a9ffe79e6d0cbf7a29e3502951efa6510664422ec1dcc968b9336: Status 404 returned error can't find the container with id 7b5260f7043a9ffe79e6d0cbf7a29e3502951efa6510664422ec1dcc968b9336
Aug 04 00:02:08.522923 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.522899    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:08.531398 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.531373    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2eeb15d_6446_49aa_8eb8_17c7998be3b4.slice/crio-da11cc2606cf2dfb42c5f96cd7166f6ee7b713f4503dd46fcf324e79471ce55e WatchSource:0}: Error finding container da11cc2606cf2dfb42c5f96cd7166f6ee7b713f4503dd46fcf324e79471ce55e: Status 404 returned error can't find the container with id da11cc2606cf2dfb42c5f96cd7166f6ee7b713f4503dd46fcf324e79471ce55e
Aug 04 00:02:08.535732 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.535714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-llv9g"
Aug 04 00:02:08.542048 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.542032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f74ck"
Aug 04 00:02:08.543920 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.543898    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5a69cd_a194_4464_84d8_2b97fd9290b7.slice/crio-c1893fa584c90d2b542783a705ca53d5bf98340cf8b7d50898329d3ab06d4fc4 WatchSource:0}: Error finding container c1893fa584c90d2b542783a705ca53d5bf98340cf8b7d50898329d3ab06d4fc4: Status 404 returned error can't find the container with id c1893fa584c90d2b542783a705ca53d5bf98340cf8b7d50898329d3ab06d4fc4
Aug 04 00:02:08.551423 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:08.551401    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254c1d19_0c07_453c_ba57_371148e9d90d.slice/crio-0db08aa46f28f78e81249d307091068b6f4330e5003e021b23fea49b8d3019f5 WatchSource:0}: Error finding container 0db08aa46f28f78e81249d307091068b6f4330e5003e021b23fea49b8d3019f5: Status 404 returned error can't find the container with id 0db08aa46f28f78e81249d307091068b6f4330e5003e021b23fea49b8d3019f5
Aug 04 00:02:08.797099 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.796998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:08.797099 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.797060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:08.797319 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.797172    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:08.797319 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.797184    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:08.797319 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.797254    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret podName:87f93f9e-4024-453f-b593-7bd09fe5ea55 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:09.797232961 +0000 UTC m=+3.137268812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret") pod "global-pull-secret-syncer-ddcl4" (UID: "87f93f9e-4024-453f-b593-7bd09fe5ea55") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:08.797319 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.797275    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:09.797265519 +0000 UTC m=+3.137301366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:08.897604 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:08.897559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:08.897812 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.897781    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:08.897812 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.897805    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:08.897990 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.897818    2571 projected.go:196] Error preparing data for projected volume kube-api-access-42lv9 for pod openshift-network-diagnostics/network-check-target-87cf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:08.897990 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:08.897883    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9 podName:057f196b-d0f5-42d7-861f-121f68640d4b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:09.897864326 +0000 UTC m=+3.237900197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-42lv9" (UniqueName: "kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9") pod "network-check-target-87cf5" (UID: "057f196b-d0f5-42d7-861f-121f68640d4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:09.030846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.030811    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:09.128798 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.128654    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-02 23:57:08 +0000 UTC" deadline="2028-04-03 13:28:58.269301264 +0000 UTC"
Aug 04 00:02:09.128798 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.128731    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14605h26m49.14057417s"
Aug 04 00:02:09.140213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.140177    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:09.140388 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.140329    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:09.150451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.150386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal" event={"ID":"aed72ea57421a105ed2430861abf08fc","Type":"ContainerStarted","Data":"cdf15914739ee8ae73ee7f74f19c4e83b3307a06f7dc1acf39091b1ab096ee47"}
Aug 04 00:02:09.159927 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.159890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f74ck" event={"ID":"254c1d19-0c07-453c-ba57-371148e9d90d","Type":"ContainerStarted","Data":"0db08aa46f28f78e81249d307091068b6f4330e5003e021b23fea49b8d3019f5"}
Aug 04 00:02:09.165390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.165352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-684qb" event={"ID":"6b872291-f419-4f30-b3f3-b3726dfa8f4d","Type":"ContainerStarted","Data":"fc48b5e337c91113bcb230b03f35e1cbefaebb11e2d76f775e706a1aae4deb1a"}
Aug 04 00:02:09.167831 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.167799    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tdlsb" event={"ID":"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06","Type":"ContainerStarted","Data":"0a72139a4c7fee7fb4a356452e264ee55642c78580e901f8363de929713d75c6"}
Aug 04 00:02:09.170620 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.170593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsq9x" event={"ID":"bf8a8e2c-c735-45f9-887e-2ff2d93e1312","Type":"ContainerStarted","Data":"92e1970601e701999542a68c1f74f09c7ec6c986f167a57bd4a7331e67348e98"}
Aug 04 00:02:09.174372 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.174298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal" event={"ID":"4e4cea72394bd0b0963f00a98984e037","Type":"ContainerStarted","Data":"168687d344fafbbae3afda6ad65ea2d9851223a0a0e65dbb94b2a63dd1ea2023"}
Aug 04 00:02:09.177741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.177700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-llv9g" event={"ID":"7f5a69cd-a194-4464-84d8-2b97fd9290b7","Type":"ContainerStarted","Data":"c1893fa584c90d2b542783a705ca53d5bf98340cf8b7d50898329d3ab06d4fc4"}
Aug 04 00:02:09.181044 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.181004    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"da11cc2606cf2dfb42c5f96cd7166f6ee7b713f4503dd46fcf324e79471ce55e"}
Aug 04 00:02:09.186479 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.186430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerStarted","Data":"7b5260f7043a9ffe79e6d0cbf7a29e3502951efa6510664422ec1dcc968b9336"}
Aug 04 00:02:09.191760 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.191732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dc68r" event={"ID":"06864f10-06e5-4538-aeea-6d7312ba87d5","Type":"ContainerStarted","Data":"8e6efcb6deebba6f60a4b926a2ea9e13699287dc920a1872a203d084d5d61e4b"}
Aug 04 00:02:09.193504 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.193476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn" event={"ID":"2fb32d48-309a-4f3e-844a-b5741a9d84d3","Type":"ContainerStarted","Data":"cfaa3273d01e7ae64b40936e8919b3a903e7a4ed9c9b0b952606ac1d6dbcce13"}
Aug 04 00:02:09.805499 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.804654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:09.805499 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.804752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:09.805499 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.804918    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:09.805499 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.804987    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:11.804966469 +0000 UTC m=+5.145002347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:09.805499 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.805397    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:09.805499 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.805452    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret podName:87f93f9e-4024-453f-b593-7bd09fe5ea55 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:11.805435482 +0000 UTC m=+5.145471332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret") pod "global-pull-secret-syncer-ddcl4" (UID: "87f93f9e-4024-453f-b593-7bd09fe5ea55") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:09.905716 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:09.905670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:09.905927 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.905872    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:09.905927 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.905893    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:09.905927 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.905907    2571 projected.go:196] Error preparing data for projected volume kube-api-access-42lv9 for pod openshift-network-diagnostics/network-check-target-87cf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:09.906100 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:09.905982    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9 podName:057f196b-d0f5-42d7-861f-121f68640d4b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:11.905960102 +0000 UTC m=+5.245995953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-42lv9" (UniqueName: "kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9") pod "network-check-target-87cf5" (UID: "057f196b-d0f5-42d7-861f-121f68640d4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:10.131034 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:10.130926    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-02 23:57:08 +0000 UTC" deadline="2028-02-24 21:08:20.858655486 +0000 UTC"
Aug 04 00:02:10.131034 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:10.130973    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13677h6m10.727687366s"
Aug 04 00:02:10.150284 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:10.150248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:10.150472 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:10.150419    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:10.150901 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:10.150878    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:10.151069 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:10.151043    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:10.723288 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:10.723238    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:11.144247 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:11.144180    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:11.144665 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.144309    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:11.822873 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:11.822085    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:11.822873 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:11.822158    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:11.822873 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.822323    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:11.822873 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.822389    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:15.822369881 +0000 UTC m=+9.162405726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:11.822873 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.822796    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:11.822873 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.822846    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret podName:87f93f9e-4024-453f-b593-7bd09fe5ea55 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:15.822831847 +0000 UTC m=+9.162867694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret") pod "global-pull-secret-syncer-ddcl4" (UID: "87f93f9e-4024-453f-b593-7bd09fe5ea55") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:11.923272 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:11.923214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:11.923454 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.923377    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:11.923454 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.923407    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:11.923454 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.923420    2571 projected.go:196] Error preparing data for projected volume kube-api-access-42lv9 for pod openshift-network-diagnostics/network-check-target-87cf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:11.923613 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:11.923485    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9 podName:057f196b-d0f5-42d7-861f-121f68640d4b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:15.923464891 +0000 UTC m=+9.263500739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-42lv9" (UniqueName: "kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9") pod "network-check-target-87cf5" (UID: "057f196b-d0f5-42d7-861f-121f68640d4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:12.140096 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:12.139563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:12.140096 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:12.139727    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:12.140096 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:12.139880    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:12.140096 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:12.139992    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:13.143246 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:13.143221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:13.143715 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:13.143329    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:14.139838 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:14.139801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:14.140005 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:14.139954    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:14.140316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:14.140297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:14.140412 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:14.140393    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:15.139856 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:15.139818    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:15.140336 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.139959    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:15.855131 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:15.854337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:15.855131 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:15.854408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:15.855131 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.854531    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:15.855131 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.854616    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:23.854596185 +0000 UTC m=+17.194632042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:15.855131 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.855043    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:15.855131 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.855096    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret podName:87f93f9e-4024-453f-b593-7bd09fe5ea55 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:23.855080951 +0000 UTC m=+17.195116801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret") pod "global-pull-secret-syncer-ddcl4" (UID: "87f93f9e-4024-453f-b593-7bd09fe5ea55") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:15.955335 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:15.955251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:15.955497 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.955428    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:15.955497 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.955454    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:15.955497 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.955467    2571 projected.go:196] Error preparing data for projected volume kube-api-access-42lv9 for pod openshift-network-diagnostics/network-check-target-87cf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:15.955652 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:15.955538    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9 podName:057f196b-d0f5-42d7-861f-121f68640d4b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:23.955516678 +0000 UTC m=+17.295552532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-42lv9" (UniqueName: "kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9") pod "network-check-target-87cf5" (UID: "057f196b-d0f5-42d7-861f-121f68640d4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:16.140369 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:16.140061    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:16.140369 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:16.140193    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:16.140369 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:16.140218    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:16.140369 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:16.140309    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:17.143758 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:17.143252    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:17.143758 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:17.143388    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:18.140224 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:18.140191    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:18.140392 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:18.140204    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:18.140392 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:18.140312    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:18.140518 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:18.140406    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:19.142741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:19.142713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:19.143192 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:19.142836    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:20.139613 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:20.139579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:20.139797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:20.139619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:20.139797 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:20.139743    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:20.139930 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:20.139857    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:21.140377 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:21.140329    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:21.140828 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:21.140480    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:22.139863 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:22.139823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:22.140059 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:22.139823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:22.140059 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:22.139942    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:22.140159 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:22.140082    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:23.139766 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:23.139728    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:23.140189 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:23.139866    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:23.916323 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:23.916229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:23.916323 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:23.916298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:23.916567 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:23.916401    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:23.916567 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:23.916423    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:23.916567 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:23.916497    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret podName:87f93f9e-4024-453f-b593-7bd09fe5ea55 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.916465135 +0000 UTC m=+33.256500997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret") pod "global-pull-secret-syncer-ddcl4" (UID: "87f93f9e-4024-453f-b593-7bd09fe5ea55") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:23.916567 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:23.916519    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.916509252 +0000 UTC m=+33.256545110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:24.017467 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:24.017426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:24.017644 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:24.017603    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:24.017644 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:24.017627    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:24.017644 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:24.017641    2571 projected.go:196] Error preparing data for projected volume kube-api-access-42lv9 for pod openshift-network-diagnostics/network-check-target-87cf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:24.017803 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:24.017722    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9 podName:057f196b-d0f5-42d7-861f-121f68640d4b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:40.017703746 +0000 UTC m=+33.357739610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-42lv9" (UniqueName: "kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9") pod "network-check-target-87cf5" (UID: "057f196b-d0f5-42d7-861f-121f68640d4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:24.140038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:24.140005    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:24.140518 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:24.140122    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:24.140518 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:24.140190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:24.140518 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:24.140307    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:25.139707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:25.139661    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:25.139987 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:25.139806    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:26.139962 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:26.139927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:26.139962 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:26.139959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:26.140503 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:26.140058    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:26.140503 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:26.140135    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:27.140582 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:27.140540    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:27.141063 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:27.140673    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:28.139663 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.139463    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:28.139759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.139549    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:28.139810 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:28.139772    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:28.139862 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:28.139836    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:28.246844 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.245934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-llv9g" event={"ID":"7f5a69cd-a194-4464-84d8-2b97fd9290b7","Type":"ContainerStarted","Data":"3c0eb3f9a1f7c9dca8628660819455ae2236d5e59dc65fe6bd3c3b0c581bff3e"}
Aug 04 00:02:28.254857 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.254776    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:02:28.255748 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.255724    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"1624a2296bfed24ac84e78b0491304c823579baf5ba883623c801972bf048fb6"}
Aug 04 00:02:28.255849 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.255681    2571 generic.go:356] "Generic (PLEG): container finished" podID="c2eeb15d-6446-49aa-8eb8-17c7998be3b4" containerID="b1aee109dbab827c1ba28c704e78954d2756d3c28f657474d419dc24cbe5cb25" exitCode=1
Aug 04 00:02:28.256082 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.255816    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"4b3b5fbdd6834c0a09a0b82921480e971810fcad40b9a92da2b702b0df88441b"}
Aug 04 00:02:28.256082 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.255968    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerDied","Data":"b1aee109dbab827c1ba28c704e78954d2756d3c28f657474d419dc24cbe5cb25"}
Aug 04 00:02:28.256082 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.256023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"abca1e956079e40d53791817a7372d1ee9dc8dc846daa7b5e27ec4203d18eeb0"}
Aug 04 00:02:28.265768 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.265606    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal" event={"ID":"4e4cea72394bd0b0963f00a98984e037","Type":"ContainerStarted","Data":"1ba60243797ec6d35d31d25e3a6741b158e37d352a2a8903ead284a2f2a42f98"}
Aug 04 00:02:28.281411 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:28.278607    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-llv9g" podStartSLOduration=2.373624445 podStartE2EDuration="21.278585813s" totalImagesPullingTime="18.904961368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:28.265275909 +0000 UTC m=+21.605311775" watchObservedRunningTime="2026-08-04 00:02:28.278585813 +0000 UTC m=+21.618621679"
Aug 04 00:02:29.139843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.139799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:29.140037 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:29.139933    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:29.271555 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.271512    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:02:29.272310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.271973    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"421f4cb6743cfb02015dcbf1b779c7c9497e65fb435683c48ec4570522a377d0"}
Aug 04 00:02:29.272310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.272056    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"d7b874d07b39b5cb21d6ec895c2693137e819e577ad5456a7dd5c6fd449f619f"}
Aug 04 00:02:29.272310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.272101    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"29e00052a09e2d0f43f3690fd8ccb57d6b616b234e121ada7422eb5c96ff862a"}
Aug 04 00:02:29.273857 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.273643    2571 generic.go:356] "Generic (PLEG): container finished" podID="f08bc5f7-cacb-4e54-99ca-adafff1941ca" containerID="748f514fec86f5648e760d540184fd1f35ba7f707c4954055a8be29983605a16" exitCode=0
Aug 04 00:02:29.276738 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.273723    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerDied","Data":"748f514fec86f5648e760d540184fd1f35ba7f707c4954055a8be29983605a16"}
Aug 04 00:02:29.278752 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.278344    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dc68r" event={"ID":"06864f10-06e5-4538-aeea-6d7312ba87d5","Type":"ContainerStarted","Data":"01869b30415a36584a4df54723503719895918c5fff4f620f013c5ff0b1c258b"}
Aug 04 00:02:29.279884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.279853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn" event={"ID":"2fb32d48-309a-4f3e-844a-b5741a9d84d3","Type":"ContainerStarted","Data":"32f320191fa2438a1c18cb52fe27f0dacce8a75ab1f1feef511c14a954c9c78d"}
Aug 04 00:02:29.281507 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.281485    2571 generic.go:356] "Generic (PLEG): container finished" podID="aed72ea57421a105ed2430861abf08fc" containerID="71c387f93e4ef14de7a65e0e59647fa1b00151fbf251b6e1942564c86ff39cde" exitCode=0
Aug 04 00:02:29.281580 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.281544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal" event={"ID":"aed72ea57421a105ed2430861abf08fc","Type":"ContainerDied","Data":"71c387f93e4ef14de7a65e0e59647fa1b00151fbf251b6e1942564c86ff39cde"}
Aug 04 00:02:29.283582 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.283556    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f74ck" event={"ID":"254c1d19-0c07-453c-ba57-371148e9d90d","Type":"ContainerStarted","Data":"9d0267cdd514cb0ef8a184e11cb9a787bb56baccd64f83ea710840cd4be05763"}
Aug 04 00:02:29.285051 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.285029    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-684qb" event={"ID":"6b872291-f419-4f30-b3f3-b3726dfa8f4d","Type":"ContainerStarted","Data":"8d35cd67bb027e0c8678b68ec71c90e6542407219b52f1c2998c3c76b2fe4ee6"}
Aug 04 00:02:29.286583 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.286562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tdlsb" event={"ID":"727b67a9-8e1d-47e7-9e39-9ad7a66b7e06","Type":"ContainerStarted","Data":"1f2526690229f7aa56ef68deb5453e7b9264333b537607019f5592b9f75eec51"}
Aug 04 00:02:29.288104 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.288082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsq9x" event={"ID":"bf8a8e2c-c735-45f9-887e-2ff2d93e1312","Type":"ContainerStarted","Data":"97a9c9610f350c943a7c9ec35e4718bec569805f0629ed8eed4a874e43f16247"}
Aug 04 00:02:29.300091 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.300006    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-136.ec2.internal" podStartSLOduration=21.299992978 podStartE2EDuration="21.299992978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:28.279362994 +0000 UTC m=+21.619398860" watchObservedRunningTime="2026-08-04 00:02:29.299992978 +0000 UTC m=+22.640028843"
Aug 04 00:02:29.312736 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.312675    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f74ck" podStartSLOduration=3.4147042 podStartE2EDuration="22.312658517s" totalImagesPullingTime="18.897954317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:29.312120696 +0000 UTC m=+22.652156562" watchObservedRunningTime="2026-08-04 00:02:29.312658517 +0000 UTC m=+22.652694383"
Aug 04 00:02:29.339172 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.339109    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lsq9x" podStartSLOduration=3.291119954 podStartE2EDuration="22.339094115s" totalImagesPullingTime="19.047974161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:29.338385973 +0000 UTC m=+22.678421840" watchObservedRunningTime="2026-08-04 00:02:29.339094115 +0000 UTC m=+22.679129982"
Aug 04 00:02:29.365986 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.365938    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dc68r" podStartSLOduration=11.431160092 podStartE2EDuration="22.36592188s" totalImagesPullingTime="10.934761788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:29.351852962 +0000 UTC m=+22.691888828" watchObservedRunningTime="2026-08-04 00:02:29.36592188 +0000 UTC m=+22.705957744"
Aug 04 00:02:29.366124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.366008    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tdlsb" podStartSLOduration=3.40535337 podStartE2EDuration="22.366002471s" totalImagesPullingTime="18.960649101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:29.36550777 +0000 UTC m=+22.705543634" watchObservedRunningTime="2026-08-04 00:02:29.366002471 +0000 UTC m=+22.706038336"
Aug 04 00:02:29.382920 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.382871    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-684qb" podStartSLOduration=2.658740436 podStartE2EDuration="22.382855612s" totalImagesPullingTime="19.724115176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:29.382484831 +0000 UTC m=+22.722520708" watchObservedRunningTime="2026-08-04 00:02:29.382855612 +0000 UTC m=+22.722891519"
Aug 04 00:02:29.910604 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:29.910579    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 00:02:30.139849 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.139777    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:30.140052 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:30.139882    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:30.140052 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.139940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:30.140052 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:30.140014    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:30.159440 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.159354    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T00:02:29.910599255Z","UUID":"31b59b7f-e030-4eed-9246-a7cb8e14e228","Handler":null,"Name":"","Endpoint":""}
Aug 04 00:02:30.160684 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.160664    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 00:02:30.160794 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.160712    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 00:02:30.293083 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.293042    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn" event={"ID":"2fb32d48-309a-4f3e-844a-b5741a9d84d3","Type":"ContainerStarted","Data":"e9b1ff118178309a0024a10187a1ed1b7695a47776d5823f62300a8b205aeaf1"}
Aug 04 00:02:30.295132 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.295101    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal" event={"ID":"aed72ea57421a105ed2430861abf08fc","Type":"ContainerStarted","Data":"02a1bad316cc1ebb54057dd39a4d9043f0dad78e818a5474725258a770c259eb"}
Aug 04 00:02:30.311103 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:30.311040    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-136.ec2.internal" podStartSLOduration=22.310993668 podStartE2EDuration="22.310993668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:30.310235286 +0000 UTC m=+23.650271153" watchObservedRunningTime="2026-08-04 00:02:30.310993668 +0000 UTC m=+23.651029532"
Aug 04 00:02:31.109325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:31.109289    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:31.110251 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:31.110230    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:31.142456 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:31.142435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:31.142583 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:31.142527    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:31.301795 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:31.301753    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:02:31.302363 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:31.302314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"8d47a20e3c54d099425a9746502eeb4234e03573165a58a7bcc8ef996b96803c"}
Aug 04 00:02:31.302911 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:31.302887    2571 scope.go:117] "RemoveContainer" containerID="b1aee109dbab827c1ba28c704e78954d2756d3c28f657474d419dc24cbe5cb25"
Aug 04 00:02:32.140050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.139844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:32.140278 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.139907    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:32.140278 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:32.140129    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:32.140278 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:32.140243    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:32.310329 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.310293    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:02:32.310892 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.310742    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" event={"ID":"c2eeb15d-6446-49aa-8eb8-17c7998be3b4","Type":"ContainerStarted","Data":"9c58850c25ea8b964bf3309b88219491a8707c4b6b1f5b1d9a6fa943677ab5da"}
Aug 04 00:02:32.311116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.311095    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:32.311239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.311170    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:32.311239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.311223    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:32.313427 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.313407    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 00:02:32.313529 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.313508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn" event={"ID":"2fb32d48-309a-4f3e-844a-b5741a9d84d3","Type":"ContainerStarted","Data":"298e690f7c71384595159e954a4fb0e57bf72cb22485f46fa865631b1a8d0276"}
Aug 04 00:02:32.328676 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.328641    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:32.329204 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.329175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:02:32.339357 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.339303    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s" podStartSLOduration=6.378550969 podStartE2EDuration="25.339281844s" totalImagesPullingTime="18.960730875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:32.337069822 +0000 UTC m=+25.677105689" watchObservedRunningTime="2026-08-04 00:02:32.339281844 +0000 UTC m=+25.679317711"
Aug 04 00:02:32.376900 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:32.376850    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f87tn" podStartSLOduration=3.776000001 podStartE2EDuration="25.376836085s" totalImagesPullingTime="21.600836084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:32.376540185 +0000 UTC m=+25.716576054" watchObservedRunningTime="2026-08-04 00:02:32.376836085 +0000 UTC m=+25.716871950"
Aug 04 00:02:33.140116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.140084    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:33.140297 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:33.140219    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:33.195751 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.195720    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddcl4"]
Aug 04 00:02:33.199568 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.199537    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87cf5"]
Aug 04 00:02:33.199756 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.199679    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:33.200011 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:33.199842    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:33.200388 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.199998    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7pbsf"]
Aug 04 00:02:33.200500 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.200457    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:33.200751 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:33.200682    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:33.315951 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:33.315866    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:33.316639 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:33.316133    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:35.140511 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:35.140326    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:35.140883 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:35.140336    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:35.140883 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:35.140594    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:35.140883 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:35.140658    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:35.140883 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:35.140349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:35.140883 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:35.140774    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:35.321806 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:35.321721    2571 generic.go:356] "Generic (PLEG): container finished" podID="f08bc5f7-cacb-4e54-99ca-adafff1941ca" containerID="ff516039cae0d262eb3334c42c557061364b770c3dadce9a2457a95409bf6265" exitCode=0
Aug 04 00:02:35.321806 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:35.321772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerDied","Data":"ff516039cae0d262eb3334c42c557061364b770c3dadce9a2457a95409bf6265"}
Aug 04 00:02:36.788227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:36.788189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:36.788594 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:36.788332    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 00:02:36.788896 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:36.788879    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lsq9x"
Aug 04 00:02:37.142711 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.142669    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:37.142874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.142725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:37.142874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.142787    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:37.142874 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:37.142802    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87cf5" podUID="057f196b-d0f5-42d7-861f-121f68640d4b"
Aug 04 00:02:37.143043 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:37.142904    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddcl4" podUID="87f93f9e-4024-453f-b593-7bd09fe5ea55"
Aug 04 00:02:37.143043 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:37.142965    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7pbsf" podUID="88ba6ca4-fccd-45dc-9242-d157ee56e2b8"
Aug 04 00:02:37.327877 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.327841    2571 generic.go:356] "Generic (PLEG): container finished" podID="f08bc5f7-cacb-4e54-99ca-adafff1941ca" containerID="e571b7e00bdeca10e4a875de7dc24d4543df66584cbca6431fe90290006014f8" exitCode=0
Aug 04 00:02:37.328045 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.327930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerDied","Data":"e571b7e00bdeca10e4a875de7dc24d4543df66584cbca6431fe90290006014f8"}
Aug 04 00:02:37.962843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.962821    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-136.ec2.internal" event="NodeReady"
Aug 04 00:02:37.963189 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.962946    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 00:02:37.996050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:37.996021    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29763360-cqlc9"]
Aug 04 00:02:38.007256 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.007229    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-l9f49"]
Aug 04 00:02:38.007377 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.007352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.009782 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.009757    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Aug 04 00:02:38.009924 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.009812    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-nc69w\""
Aug 04 00:02:38.023073 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.023050    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-678c5cc8f6-hxqbl"]
Aug 04 00:02:38.023213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.023181    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.025878 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.025619    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 04 00:02:38.025878 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.025621    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 04 00:02:38.025878 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.025771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-85m8c\""
Aug 04 00:02:38.026080 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.026032    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.026119 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.026098    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.039177 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.039121    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 04 00:02:38.043554 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.043531    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"]
Aug 04 00:02:38.043670 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.043654    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.046023 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.045927    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 04 00:02:38.046023 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.046007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.046241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.046186    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 04 00:02:38.046241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.046194    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 04 00:02:38.046241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.046208    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.046393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.046316    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kkcsp\""
Aug 04 00:02:38.046462 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.046438    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 04 00:02:38.061924 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.061898    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"]
Aug 04 00:02:38.062086 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.061991    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.064594 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.064572    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.064736 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.064602    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lbkvx\""
Aug 04 00:02:38.064736 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.064671    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 04 00:02:38.064736 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.064704    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.064954 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.064939    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 04 00:02:38.084109 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.084084    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"]
Aug 04 00:02:38.084239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.084208    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"
Aug 04 00:02:38.087335 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.087313    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gs8b5\""
Aug 04 00:02:38.087335 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.087325    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.087475 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.087359    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.102260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.102236    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"]
Aug 04 00:02:38.102375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.102354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.105016 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.104992    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.105132 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.105033    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.105132 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.105050    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 04 00:02:38.105132 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.104993    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tr2vg\""
Aug 04 00:02:38.105344 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.105329    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 04 00:02:38.124313 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.124292    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-656969f57d-flvn7"]
Aug 04 00:02:38.124424 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.124406    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.126563 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.126682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126570    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.126682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmddm\" (UniqueName: \"kubernetes.io/projected/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-kube-api-access-zmddm\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.126682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-default-certificate\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.126682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126644    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.126682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126670    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5f6\" (UniqueName: \"kubernetes.io/projected/8eec624e-ae11-4621-b2ca-fecd3c42cc50-kube-api-access-xq5f6\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.126898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a1f7b92-4ff8-4881-a729-172f26200589-tmp\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.126898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126782    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 04 00:02:38.126898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a1f7b92-4ff8-4881-a729-172f26200589-serving-cert\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.126898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5nw\" (UniqueName: \"kubernetes.io/projected/3a1f7b92-4ff8-4881-a729-172f26200589-kube-api-access-lh5nw\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.126898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126867    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.126898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126877    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 04 00:02:38.127176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a1f7b92-4ff8-4881-a729-172f26200589-snapshots\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.127176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126832    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.127176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.126947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1f7b92-4ff8-4881-a729-172f26200589-trusted-ca-bundle\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.127176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.127016    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-stats-auth\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.127176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.127065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1f7b92-4ff8-4881-a729-172f26200589-service-ca-bundle\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.127176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.127131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b7e8e6-a07f-438c-b420-28e3e4993e56-serviceca\") pod \"image-pruner-29763360-cqlc9\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") " pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.127443 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.127183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727pt\" (UniqueName: \"kubernetes.io/projected/a3b7e8e6-a07f-438c-b420-28e3e4993e56-kube-api-access-727pt\") pod \"image-pruner-29763360-cqlc9\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") " pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.127443 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.127201    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.127443 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.127223    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9wplr\""
Aug 04 00:02:38.144604 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.144585    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"]
Aug 04 00:02:38.144727 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.144713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.147200 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.147181    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 00:02:38.147200 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.147189    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 00:02:38.147361 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.147231    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 00:02:38.147361 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.147264    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dptb9\""
Aug 04 00:02:38.152165 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.152149    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 00:02:38.165534 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.165458    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"]
Aug 04 00:02:38.165628 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.165591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.167807 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.167791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 04 00:02:38.167923 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.167907    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.167979 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.167966    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lcqt5\""
Aug 04 00:02:38.168043 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.168028    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.176721 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.176704    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-87nm2"]
Aug 04 00:02:38.176811 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.176796    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"
Aug 04 00:02:38.178981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.178966    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.179060 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.179010    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.179060 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.179025    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g66w2\""
Aug 04 00:02:38.192893 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.192873    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29763360-cqlc9"]
Aug 04 00:02:38.192964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.192898    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"]
Aug 04 00:02:38.192964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.192913    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"]
Aug 04 00:02:38.192964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.192934    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m657x"]
Aug 04 00:02:38.193046 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.192982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.195351 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.195331    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 04 00:02:38.195449 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.195433    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-b67qv\""
Aug 04 00:02:38.195707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.195675    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 04 00:02:38.195707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.195677    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.195818 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.195715    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.200612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.200591    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 04 00:02:38.206774 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206756    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-l9f49"]
Aug 04 00:02:38.206868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206790    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"]
Aug 04 00:02:38.206868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206810    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"]
Aug 04 00:02:38.206868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-87nm2"]
Aug 04 00:02:38.206868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206857    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-678c5cc8f6-hxqbl"]
Aug 04 00:02:38.206868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206861    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.207111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206874    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m657x"]
Aug 04 00:02:38.207111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206894    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"]
Aug 04 00:02:38.207111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206911    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"]
Aug 04 00:02:38.207111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206930    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656969f57d-flvn7"]
Aug 04 00:02:38.207111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.206968    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5rj2t"]
Aug 04 00:02:38.209387 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.209360    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 00:02:38.209476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.209399    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 00:02:38.209476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.209447    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 00:02:38.209630 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.209613    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-74zks\""
Aug 04 00:02:38.220972 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.220930    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rj2t"]
Aug 04 00:02:38.221051 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.221038    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.223260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.223245    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 00:02:38.223347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.223263    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9x2gl\""
Aug 04 00:02:38.223347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.223248    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 00:02:38.227808 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.227789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727pt\" (UniqueName: \"kubernetes.io/projected/a3b7e8e6-a07f-438c-b420-28e3e4993e56-kube-api-access-727pt\") pod \"image-pruner-29763360-cqlc9\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") " pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.227876 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.227816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.227876 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.227839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-image-registry-private-configuration\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.227969 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.227951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/684f1db7-220a-445f-806e-11471e240967-config\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.228010 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.227994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-default-certificate\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.228058 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.228125 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.228110    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 00:02:38.228174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5f6\" (UniqueName: \"kubernetes.io/projected/8eec624e-ae11-4621-b2ca-fecd3c42cc50-kube-api-access-xq5f6\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.228174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwq9\" (UniqueName: \"kubernetes.io/projected/9d4e77e6-5aa7-4639-8761-98a3e6373036-kube-api-access-6dwq9\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.228174 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.228167    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:38.728152848 +0000 UTC m=+32.068188691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : secret "router-metrics-certs-default" not found
Aug 04 00:02:38.228331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-certificates\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.228331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-trusted-ca\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.228331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228254    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzxw\" (UniqueName: \"kubernetes.io/projected/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-kube-api-access-djzxw\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.228331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228278    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45f2a65-7f2f-461d-b362-c2cbf781275f-ca-trust-extracted\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.228331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a1f7b92-4ff8-4881-a729-172f26200589-serving-cert\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.228543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228332    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqsq2\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-kube-api-access-tqsq2\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.228543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a1f7b92-4ff8-4881-a729-172f26200589-snapshots\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.228543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1f7b92-4ff8-4881-a729-172f26200589-trusted-ca-bundle\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.228543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/684f1db7-220a-445f-806e-11471e240967-serving-cert\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.228543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.228543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228505    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228549    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1f7b92-4ff8-4881-a729-172f26200589-service-ca-bundle\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b7e8e6-a07f-438c-b420-28e3e4993e56-serviceca\") pod \"image-pruner-29763360-cqlc9\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") " pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228658    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmddm\" (UniqueName: \"kubernetes.io/projected/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-kube-api-access-zmddm\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42bgn\" (UniqueName: \"kubernetes.io/projected/684f1db7-220a-445f-806e-11471e240967-kube-api-access-42bgn\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228743    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klgjk\" (UniqueName: \"kubernetes.io/projected/bc13c545-4bca-4a9e-9241-02dc9753a1e4-kube-api-access-klgjk\") pod \"volume-data-source-validator-5b8776669-zcvzc\" (UID: \"bc13c545-4bca-4a9e-9241-02dc9753a1e4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.228816 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.228797    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:38.728780414 +0000 UTC m=+32.068816281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : configmap references non-existent config key: service-ca.crt
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a1f7b92-4ff8-4881-a729-172f26200589-tmp\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-installation-pull-secrets\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5nw\" (UniqueName: \"kubernetes.io/projected/3a1f7b92-4ff8-4881-a729-172f26200589-kube-api-access-lh5nw\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-stats-auth\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.228968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a1f7b92-4ff8-4881-a729-172f26200589-snapshots\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-bound-sa-token\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.229081    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:38.229153 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.229116    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls podName:77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:38.729104519 +0000 UTC m=+32.069140361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-f9x5w" (UID: "77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7") : secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:38.229707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229273    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b7e8e6-a07f-438c-b420-28e3e4993e56-serviceca\") pod \"image-pruner-29763360-cqlc9\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") " pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.229707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1f7b92-4ff8-4881-a729-172f26200589-service-ca-bundle\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.229707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1f7b92-4ff8-4881-a729-172f26200589-trusted-ca-bundle\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.229707 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.229596    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a1f7b92-4ff8-4881-a729-172f26200589-tmp\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.232452 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.232426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a1f7b92-4ff8-4881-a729-172f26200589-serving-cert\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.232537 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.232515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-stats-auth\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.232571 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.232558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-default-certificate\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.239491 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.239439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-727pt\" (UniqueName: \"kubernetes.io/projected/a3b7e8e6-a07f-438c-b420-28e3e4993e56-kube-api-access-727pt\") pod \"image-pruner-29763360-cqlc9\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") " pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.239491 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.239462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5f6\" (UniqueName: \"kubernetes.io/projected/8eec624e-ae11-4621-b2ca-fecd3c42cc50-kube-api-access-xq5f6\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.240593 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.240573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5nw\" (UniqueName: \"kubernetes.io/projected/3a1f7b92-4ff8-4881-a729-172f26200589-kube-api-access-lh5nw\") pod \"insights-operator-77696685b-l9f49\" (UID: \"3a1f7b92-4ff8-4881-a729-172f26200589\") " pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.240686 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.240641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmddm\" (UniqueName: \"kubernetes.io/projected/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-kube-api-access-zmddm\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.320773 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.320743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:02:38.329362 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.329476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdq7j\" (UniqueName: \"kubernetes.io/projected/2bf3791e-9884-4184-8c38-4b6e1910aee2-kube-api-access-xdq7j\") pod \"network-check-source-65bdbbff45-m222p\" (UID: \"2bf3791e-9884-4184-8c38-4b6e1910aee2\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"
Aug 04 00:02:38.329476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-bound-sa-token\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.329476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96010a8d-bd91-4415-a612-df983492481b-trusted-ca\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.329612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9162229-a6ac-41ae-b0c7-54854b0620b8-config-volume\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.329612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4flm\" (UniqueName: \"kubernetes.io/projected/96010a8d-bd91-4415-a612-df983492481b-kube-api-access-g4flm\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.329612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-image-registry-private-configuration\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.329612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/684f1db7-220a-445f-806e-11471e240967-config\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.329612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j47qs\" (UniqueName: \"kubernetes.io/projected/f9162229-a6ac-41ae-b0c7-54854b0620b8-kube-api-access-j47qs\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwq9\" (UniqueName: \"kubernetes.io/projected/9d4e77e6-5aa7-4639-8761-98a3e6373036-kube-api-access-6dwq9\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-certificates\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329710    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-trusted-ca\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzxw\" (UniqueName: \"kubernetes.io/projected/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-kube-api-access-djzxw\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45f2a65-7f2f-461d-b362-c2cbf781275f-ca-trust-extracted\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqsq2\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-kube-api-access-tqsq2\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9162229-a6ac-41ae-b0c7-54854b0620b8-tmp-dir\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.329866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/684f1db7-220a-445f-806e-11471e240967-serving-cert\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329879    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96010a8d-bd91-4415-a612-df983492481b-config\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.329935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec60b111-db5a-422c-852f-109e8d2d033a-cert\") pod \"ingress-canary-m657x\" (UID: \"ec60b111-db5a-422c-852f-109e8d2d033a\") " pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42bgn\" (UniqueName: \"kubernetes.io/projected/684f1db7-220a-445f-806e-11471e240967-kube-api-access-42bgn\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klgjk\" (UniqueName: \"kubernetes.io/projected/bc13c545-4bca-4a9e-9241-02dc9753a1e4-kube-api-access-klgjk\") pod \"volume-data-source-validator-5b8776669-zcvzc\" (UID: \"bc13c545-4bca-4a9e-9241-02dc9753a1e4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96010a8d-bd91-4415-a612-df983492481b-serving-cert\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.330219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-installation-pull-secrets\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330225    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzcs4\" (UniqueName: \"kubernetes.io/projected/ec60b111-db5a-422c-852f-109e8d2d033a-kube-api-access-bzcs4\") pod \"ingress-canary-m657x\" (UID: \"ec60b111-db5a-422c-852f-109e8d2d033a\") " pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330251    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/684f1db7-220a-445f-806e-11471e240967-config\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.330401    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45f2a65-7f2f-461d-b362-c2cbf781275f-ca-trust-extracted\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.330456    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls podName:9d4e77e6-5aa7-4639-8761-98a3e6373036 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:38.830437877 +0000 UTC m=+32.170473725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fx4v8" (UID: "9d4e77e6-5aa7-4639-8761-98a3e6373036") : secret "samples-operator-tls" not found
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.330517    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.330533    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656969f57d-flvn7: secret "image-registry-tls" not found
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330570    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-certificates\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.330656 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.330588    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls podName:b45f2a65-7f2f-461d-b362-c2cbf781275f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:38.830571302 +0000 UTC m=+32.170607145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls") pod "image-registry-656969f57d-flvn7" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f") : secret "image-registry-tls" not found
Aug 04 00:02:38.331154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.330716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-trusted-ca\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.332258 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.332237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-image-registry-private-configuration\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.332653 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.332637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.332765 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.332642    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-installation-pull-secrets\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.332837 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.332817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/684f1db7-220a-445f-806e-11471e240967-serving-cert\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.333774 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.333760    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-l9f49"
Aug 04 00:02:38.339110 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.339063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwq9\" (UniqueName: \"kubernetes.io/projected/9d4e77e6-5aa7-4639-8761-98a3e6373036-kube-api-access-6dwq9\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.339362 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.339341    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-bound-sa-token\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.339362 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.339390    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqsq2\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-kube-api-access-tqsq2\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.339615 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.339599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klgjk\" (UniqueName: \"kubernetes.io/projected/bc13c545-4bca-4a9e-9241-02dc9753a1e4-kube-api-access-klgjk\") pod \"volume-data-source-validator-5b8776669-zcvzc\" (UID: \"bc13c545-4bca-4a9e-9241-02dc9753a1e4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"
Aug 04 00:02:38.340265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.340241    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzxw\" (UniqueName: \"kubernetes.io/projected/b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e-kube-api-access-djzxw\") pod \"kube-storage-version-migrator-operator-7878f4b88c-p5pjd\" (UID: \"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.340885 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.340866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42bgn\" (UniqueName: \"kubernetes.io/projected/684f1db7-220a-445f-806e-11471e240967-kube-api-access-42bgn\") pod \"service-ca-operator-784f97bcf6-r94wg\" (UID: \"684f1db7-220a-445f-806e-11471e240967\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.392909 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.392881    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"
Aug 04 00:02:38.411123 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.411090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.431619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96010a8d-bd91-4415-a612-df983492481b-trusted-ca\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.431666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9162229-a6ac-41ae-b0c7-54854b0620b8-config-volume\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.431735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4flm\" (UniqueName: \"kubernetes.io/projected/96010a8d-bd91-4415-a612-df983492481b-kube-api-access-g4flm\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.431782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j47qs\" (UniqueName: \"kubernetes.io/projected/f9162229-a6ac-41ae-b0c7-54854b0620b8-kube-api-access-j47qs\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.432667    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9162229-a6ac-41ae-b0c7-54854b0620b8-tmp-dir\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.432778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96010a8d-bd91-4415-a612-df983492481b-config\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.432821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.432911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec60b111-db5a-422c-852f-109e8d2d033a-cert\") pod \"ingress-canary-m657x\" (UID: \"ec60b111-db5a-422c-852f-109e8d2d033a\") " pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.433732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96010a8d-bd91-4415-a612-df983492481b-serving-cert\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.433796    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzcs4\" (UniqueName: \"kubernetes.io/projected/ec60b111-db5a-422c-852f-109e8d2d033a-kube-api-access-bzcs4\") pod \"ingress-canary-m657x\" (UID: \"ec60b111-db5a-422c-852f-109e8d2d033a\") " pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.433876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdq7j\" (UniqueName: \"kubernetes.io/projected/2bf3791e-9884-4184-8c38-4b6e1910aee2-kube-api-access-xdq7j\") pod \"network-check-source-65bdbbff45-m222p\" (UID: \"2bf3791e-9884-4184-8c38-4b6e1910aee2\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.434142    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9162229-a6ac-41ae-b0c7-54854b0620b8-config-volume\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.433617    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96010a8d-bd91-4415-a612-df983492481b-trusted-ca\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.434973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.434754    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9162229-a6ac-41ae-b0c7-54854b0620b8-tmp-dir\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.435733 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.435001    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 00:02:38.435733 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.435066    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls podName:f9162229-a6ac-41ae-b0c7-54854b0620b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:38.935048588 +0000 UTC m=+32.275084432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls") pod "dns-default-5rj2t" (UID: "f9162229-a6ac-41ae-b0c7-54854b0620b8") : secret "dns-default-metrics-tls" not found
Aug 04 00:02:38.435733 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.435269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"
Aug 04 00:02:38.436415 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.436159    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96010a8d-bd91-4415-a612-df983492481b-config\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.446058 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.445096    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdq7j\" (UniqueName: \"kubernetes.io/projected/2bf3791e-9884-4184-8c38-4b6e1910aee2-kube-api-access-xdq7j\") pod \"network-check-source-65bdbbff45-m222p\" (UID: \"2bf3791e-9884-4184-8c38-4b6e1910aee2\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"
Aug 04 00:02:38.446058 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.445393    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96010a8d-bd91-4415-a612-df983492481b-serving-cert\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.448070 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.448027    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzcs4\" (UniqueName: \"kubernetes.io/projected/ec60b111-db5a-422c-852f-109e8d2d033a-kube-api-access-bzcs4\") pod \"ingress-canary-m657x\" (UID: \"ec60b111-db5a-422c-852f-109e8d2d033a\") " pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.450576 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.448205    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4flm\" (UniqueName: \"kubernetes.io/projected/96010a8d-bd91-4415-a612-df983492481b-kube-api-access-g4flm\") pod \"console-operator-5ccd6b445f-87nm2\" (UID: \"96010a8d-bd91-4415-a612-df983492481b\") " pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.450576 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.448332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j47qs\" (UniqueName: \"kubernetes.io/projected/f9162229-a6ac-41ae-b0c7-54854b0620b8-kube-api-access-j47qs\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.453628 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.451958    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec60b111-db5a-422c-852f-109e8d2d033a-cert\") pod \"ingress-canary-m657x\" (UID: \"ec60b111-db5a-422c-852f-109e8d2d033a\") " pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.484477 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.484421    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"
Aug 04 00:02:38.501700 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.501657    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:38.515311 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.515279    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m657x"
Aug 04 00:02:38.529218 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.529190    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29763360-cqlc9"]
Aug 04 00:02:38.541811 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.541551    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-l9f49"]
Aug 04 00:02:38.579244 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:38.579209    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1f7b92_4ff8_4881_a729_172f26200589.slice/crio-208ad3ddee711604533e5c9801ad496928b633bb47dc317f123988076e4935a8 WatchSource:0}: Error finding container 208ad3ddee711604533e5c9801ad496928b633bb47dc317f123988076e4935a8: Status 404 returned error can't find the container with id 208ad3ddee711604533e5c9801ad496928b633bb47dc317f123988076e4935a8
Aug 04 00:02:38.580273 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:38.580251    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b7e8e6_a07f_438c_b420_28e3e4993e56.slice/crio-41ab34c0e7ef818cf523c9c4d990a7dd7664fcbdc817172e65314deb7bffbfe2 WatchSource:0}: Error finding container 41ab34c0e7ef818cf523c9c4d990a7dd7664fcbdc817172e65314deb7bffbfe2: Status 404 returned error can't find the container with id 41ab34c0e7ef818cf523c9c4d990a7dd7664fcbdc817172e65314deb7bffbfe2
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.740048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.740204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.740307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.740352    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.740426    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.740404012 +0000 UTC m=+33.080439858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : secret "router-metrics-certs-default" not found
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.740440    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.740493    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls podName:77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.740475889 +0000 UTC m=+33.080511733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-f9x5w" (UID: "77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7") : secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:38.741618 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.740570    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.740558264 +0000 UTC m=+33.080594110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : configmap references non-existent config key: service-ca.crt
Aug 04 00:02:38.811209 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.810915    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-87nm2"]
Aug 04 00:02:38.841734 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.841680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:38.841868 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.841825    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 00:02:38.841868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.841839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:38.841984 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.841847    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656969f57d-flvn7: secret "image-registry-tls" not found
Aug 04 00:02:38.842029 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.841990    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 00:02:38.842073 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.841992    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls podName:b45f2a65-7f2f-461d-b362-c2cbf781275f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.841977295 +0000 UTC m=+33.182013152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls") pod "image-registry-656969f57d-flvn7" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f") : secret "image-registry-tls" not found
Aug 04 00:02:38.842073 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.842063    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls podName:9d4e77e6-5aa7-4639-8761-98a3e6373036 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.842043382 +0000 UTC m=+33.182079232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fx4v8" (UID: "9d4e77e6-5aa7-4639-8761-98a3e6373036") : secret "samples-operator-tls" not found
Aug 04 00:02:38.901715 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:38.901663    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96010a8d_bd91_4415_a612_df983492481b.slice/crio-4cfe4bf762c9384aeb7b98f6c21da657bb2a745a3d15697677b86a8b60fa6572 WatchSource:0}: Error finding container 4cfe4bf762c9384aeb7b98f6c21da657bb2a745a3d15697677b86a8b60fa6572: Status 404 returned error can't find the container with id 4cfe4bf762c9384aeb7b98f6c21da657bb2a745a3d15697677b86a8b60fa6572
Aug 04 00:02:38.943293 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:38.943267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:38.943440 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.943422    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 00:02:38.943489 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:38.943479    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls podName:f9162229-a6ac-41ae-b0c7-54854b0620b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:39.943464034 +0000 UTC m=+33.283499877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls") pod "dns-default-5rj2t" (UID: "f9162229-a6ac-41ae-b0c7-54854b0620b8") : secret "dns-default-metrics-tls" not found
Aug 04 00:02:39.033865 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.033712    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc"]
Aug 04 00:02:39.035012 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.034994    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m657x"]
Aug 04 00:02:39.036203 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:39.036179    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec60b111_db5a_422c_852f_109e8d2d033a.slice/crio-62a50d22ccc78380c86f93a61a1a8f547f51a4bdb72e6c7521b307c304584421 WatchSource:0}: Error finding container 62a50d22ccc78380c86f93a61a1a8f547f51a4bdb72e6c7521b307c304584421: Status 404 returned error can't find the container with id 62a50d22ccc78380c86f93a61a1a8f547f51a4bdb72e6c7521b307c304584421
Aug 04 00:02:39.036675 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:39.036656    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc13c545_4bca_4a9e_9241_02dc9753a1e4.slice/crio-850fa64823c69463f872f4cfade1077002ae88b8927bd63df282d30bb2da0b22 WatchSource:0}: Error finding container 850fa64823c69463f872f4cfade1077002ae88b8927bd63df282d30bb2da0b22: Status 404 returned error can't find the container with id 850fa64823c69463f872f4cfade1077002ae88b8927bd63df282d30bb2da0b22
Aug 04 00:02:39.066413 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.066331    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg"]
Aug 04 00:02:39.069214 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:39.069186    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684f1db7_220a_445f_806e_11471e240967.slice/crio-7510c3606dd6f366203dd8e7399df86470f41cf0db1115f2b6cbae046fe02c12 WatchSource:0}: Error finding container 7510c3606dd6f366203dd8e7399df86470f41cf0db1115f2b6cbae046fe02c12: Status 404 returned error can't find the container with id 7510c3606dd6f366203dd8e7399df86470f41cf0db1115f2b6cbae046fe02c12
Aug 04 00:02:39.070249 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.070227    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd"]
Aug 04 00:02:39.071428 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.071409    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-m222p"]
Aug 04 00:02:39.074424 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:39.074400    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf3791e_9884_4184_8c38_4b6e1910aee2.slice/crio-f2e9597eeb5c4755261ec0297e3e46bd757a29d397deac82d3a16f50583abef8 WatchSource:0}: Error finding container f2e9597eeb5c4755261ec0297e3e46bd757a29d397deac82d3a16f50583abef8: Status 404 returned error can't find the container with id f2e9597eeb5c4755261ec0297e3e46bd757a29d397deac82d3a16f50583abef8
Aug 04 00:02:39.075146 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:39.075126    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70bc0c1_0d8a_4c61_ad4e_949b6bd5c87e.slice/crio-441f019c0932cd83a3c5c436929a18b2c926c430e15af9ed121c99e2af4f8182 WatchSource:0}: Error finding container 441f019c0932cd83a3c5c436929a18b2c926c430e15af9ed121c99e2af4f8182: Status 404 returned error can't find the container with id 441f019c0932cd83a3c5c436929a18b2c926c430e15af9ed121c99e2af4f8182
Aug 04 00:02:39.140269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.140241    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:39.140439 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.140285    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:39.140476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.140443    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:39.142937 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.142912    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 00:02:39.142937 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.142918    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 00:02:39.143140 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.142918    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4cq2\""
Aug 04 00:02:39.143140 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.142918    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l74qs\""
Aug 04 00:02:39.336226 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.336144    2571 generic.go:356] "Generic (PLEG): container finished" podID="f08bc5f7-cacb-4e54-99ca-adafff1941ca" containerID="b121ba696e97cbbd4cf76c3655aac493601e25bdd1e7712f806f3016347133b5" exitCode=0
Aug 04 00:02:39.336374 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.336228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerDied","Data":"b121ba696e97cbbd4cf76c3655aac493601e25bdd1e7712f806f3016347133b5"}
Aug 04 00:02:39.337342 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.337317    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd" event={"ID":"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e","Type":"ContainerStarted","Data":"441f019c0932cd83a3c5c436929a18b2c926c430e15af9ed121c99e2af4f8182"}
Aug 04 00:02:39.338476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.338449    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg" event={"ID":"684f1db7-220a-445f-806e-11471e240967","Type":"ContainerStarted","Data":"7510c3606dd6f366203dd8e7399df86470f41cf0db1115f2b6cbae046fe02c12"}
Aug 04 00:02:39.339606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.339586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc" event={"ID":"bc13c545-4bca-4a9e-9241-02dc9753a1e4","Type":"ContainerStarted","Data":"850fa64823c69463f872f4cfade1077002ae88b8927bd63df282d30bb2da0b22"}
Aug 04 00:02:39.340786 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.340767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m657x" event={"ID":"ec60b111-db5a-422c-852f-109e8d2d033a","Type":"ContainerStarted","Data":"62a50d22ccc78380c86f93a61a1a8f547f51a4bdb72e6c7521b307c304584421"}
Aug 04 00:02:39.341861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.341840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" event={"ID":"96010a8d-bd91-4415-a612-df983492481b","Type":"ContainerStarted","Data":"4cfe4bf762c9384aeb7b98f6c21da657bb2a745a3d15697677b86a8b60fa6572"}
Aug 04 00:02:39.343215 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.343196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p" event={"ID":"2bf3791e-9884-4184-8c38-4b6e1910aee2","Type":"ContainerStarted","Data":"f2e9597eeb5c4755261ec0297e3e46bd757a29d397deac82d3a16f50583abef8"}
Aug 04 00:02:39.344156 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.344137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-l9f49" event={"ID":"3a1f7b92-4ff8-4881-a729-172f26200589","Type":"ContainerStarted","Data":"208ad3ddee711604533e5c9801ad496928b633bb47dc317f123988076e4935a8"}
Aug 04 00:02:39.345352 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.345330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29763360-cqlc9" event={"ID":"a3b7e8e6-a07f-438c-b420-28e3e4993e56","Type":"ContainerStarted","Data":"4a9962245e033398ecdfceddb510c544300935c5286de8d9757880fd3ce46b40"}
Aug 04 00:02:39.345430 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.345365    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29763360-cqlc9" event={"ID":"a3b7e8e6-a07f-438c-b420-28e3e4993e56","Type":"ContainerStarted","Data":"41ab34c0e7ef818cf523c9c4d990a7dd7664fcbdc817172e65314deb7bffbfe2"}
Aug 04 00:02:39.373037 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.372905    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29763360-cqlc9" podStartSLOduration=159.372890619 podStartE2EDuration="2m39.372890619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:39.372860696 +0000 UTC m=+32.712896562" watchObservedRunningTime="2026-08-04 00:02:39.372890619 +0000 UTC m=+32.712926478"
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.751003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.751091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.751183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.751348    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:41.751330181 +0000 UTC m=+35.091366027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : configmap references non-existent config key: service-ca.crt
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.751785    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.751844    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls podName:77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:41.751826182 +0000 UTC m=+35.091862030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-f9x5w" (UID: "77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7") : secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.751897    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 00:02:39.751969 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.751938    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:41.751918505 +0000 UTC m=+35.091954354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : secret "router-metrics-certs-default" not found
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.852302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.852430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.852589    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.852603    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656969f57d-flvn7: secret "image-registry-tls" not found
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.852717    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls podName:b45f2a65-7f2f-461d-b362-c2cbf781275f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:41.852640526 +0000 UTC m=+35.192676372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls") pod "image-registry-656969f57d-flvn7" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f") : secret "image-registry-tls" not found
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.852835    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 00:02:39.853041 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.852904    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls podName:9d4e77e6-5aa7-4639-8761-98a3e6373036 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:41.852881338 +0000 UTC m=+35.192917184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fx4v8" (UID: "9d4e77e6-5aa7-4639-8761-98a3e6373036") : secret "samples-operator-tls" not found
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.952937    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.953102    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.953131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.953283    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.953344    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs podName:88ba6ca4-fccd-45dc-9242-d157ee56e2b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:11.953325916 +0000 UTC m=+65.293361761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs") pod "network-metrics-daemon-7pbsf" (UID: "88ba6ca4-fccd-45dc-9242-d157ee56e2b8") : secret "metrics-daemon-secret" not found
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.954036    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 00:02:39.954173 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:39.954092    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls podName:f9162229-a6ac-41ae-b0c7-54854b0620b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:41.95407595 +0000 UTC m=+35.294111794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls") pod "dns-default-5rj2t" (UID: "f9162229-a6ac-41ae-b0c7-54854b0620b8") : secret "dns-default-metrics-tls" not found
Aug 04 00:02:39.960585 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:39.960534    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87f93f9e-4024-453f-b593-7bd09fe5ea55-original-pull-secret\") pod \"global-pull-secret-syncer-ddcl4\" (UID: \"87f93f9e-4024-453f-b593-7bd09fe5ea55\") " pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:40.054797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.054263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:40.068100 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.068042    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lv9\" (UniqueName: \"kubernetes.io/projected/057f196b-d0f5-42d7-861f-121f68640d4b-kube-api-access-42lv9\") pod \"network-check-target-87cf5\" (UID: \"057f196b-d0f5-42d7-861f-121f68640d4b\") " pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:40.071722 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.071538    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddcl4"
Aug 04 00:02:40.278070 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.277993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddcl4"]
Aug 04 00:02:40.286065 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:40.286029    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f93f9e_4024_453f_b593_7bd09fe5ea55.slice/crio-43f8ec267cd7a1613632d245d96eb08a71a0c9ecf2b997eaebf5a545ec28a5c2 WatchSource:0}: Error finding container 43f8ec267cd7a1613632d245d96eb08a71a0c9ecf2b997eaebf5a545ec28a5c2: Status 404 returned error can't find the container with id 43f8ec267cd7a1613632d245d96eb08a71a0c9ecf2b997eaebf5a545ec28a5c2
Aug 04 00:02:40.369352 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.369277    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:40.369802 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.369677    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddcl4" event={"ID":"87f93f9e-4024-453f-b593-7bd09fe5ea55","Type":"ContainerStarted","Data":"43f8ec267cd7a1613632d245d96eb08a71a0c9ecf2b997eaebf5a545ec28a5c2"}
Aug 04 00:02:40.626580 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:40.626435    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87cf5"]
Aug 04 00:02:40.635425 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:40.635382    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057f196b_d0f5_42d7_861f_121f68640d4b.slice/crio-202b3a891f4c2f5c23d973edf61409c32ac4f3f63266eac08208a63638cd76ed WatchSource:0}: Error finding container 202b3a891f4c2f5c23d973edf61409c32ac4f3f63266eac08208a63638cd76ed: Status 404 returned error can't find the container with id 202b3a891f4c2f5c23d973edf61409c32ac4f3f63266eac08208a63638cd76ed
Aug 04 00:02:41.377233 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.377153    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87cf5" event={"ID":"057f196b-d0f5-42d7-861f-121f68640d4b","Type":"ContainerStarted","Data":"202b3a891f4c2f5c23d973edf61409c32ac4f3f63266eac08208a63638cd76ed"}
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.777916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.777986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.778077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.778251    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:45.778231666 +0000 UTC m=+39.118267513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : configmap references non-existent config key: service-ca.crt
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.778678    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.778746    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls podName:77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:45.778730674 +0000 UTC m=+39.118766519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-f9x5w" (UID: "77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7") : secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.778804    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 00:02:41.778918 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.778835    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:45.778823733 +0000 UTC m=+39.118859580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : secret "router-metrics-certs-default" not found
Aug 04 00:02:41.878565 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.878518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:41.878752 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.878641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:41.878863 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.878846    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 00:02:41.878937 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.878926    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls podName:9d4e77e6-5aa7-4639-8761-98a3e6373036 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:45.878906905 +0000 UTC m=+39.218942754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fx4v8" (UID: "9d4e77e6-5aa7-4639-8761-98a3e6373036") : secret "samples-operator-tls" not found
Aug 04 00:02:41.879473 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.879339    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 00:02:41.879473 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.879359    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656969f57d-flvn7: secret "image-registry-tls" not found
Aug 04 00:02:41.879473 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.879405    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls podName:b45f2a65-7f2f-461d-b362-c2cbf781275f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:45.879389364 +0000 UTC m=+39.219425209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls") pod "image-registry-656969f57d-flvn7" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f") : secret "image-registry-tls" not found
Aug 04 00:02:41.980065 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:41.980025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:41.980359 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.980339    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 00:02:41.980456 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:41.980405    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls podName:f9162229-a6ac-41ae-b0c7-54854b0620b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:45.980387857 +0000 UTC m=+39.320423706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls") pod "dns-default-5rj2t" (UID: "f9162229-a6ac-41ae-b0c7-54854b0620b8") : secret "dns-default-metrics-tls" not found
Aug 04 00:02:42.717620 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.716478    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"]
Aug 04 00:02:42.733148 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.731862    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"]
Aug 04 00:02:42.734536 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.733552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:42.738316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.738006    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pkbbw\""
Aug 04 00:02:42.738316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.738053    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 00:02:42.738316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.738059    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 00:02:42.738316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.738006    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 00:02:42.740379 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.740090    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 04 00:02:42.747759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.747246    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"]
Aug 04 00:02:42.747759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.747278    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"]
Aug 04 00:02:42.747759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.747300    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"]
Aug 04 00:02:42.747759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.747355    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.750313 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.750292    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 04 00:02:42.768717 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.767867    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"]
Aug 04 00:02:42.768717 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.767990    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.771324 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.770893    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 00:02:42.771324 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.771169    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 00:02:42.771324 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.771270    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 00:02:42.771551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.771270    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 00:02:42.889961 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.889828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jll44\" (UniqueName: \"kubernetes.io/projected/c48e8c59-d6b1-4bac-9f47-d7469103296f-kube-api-access-jll44\") pod \"managed-serviceaccount-addon-agent-57995d858-qxpl2\" (UID: \"c48e8c59-d6b1-4bac-9f47-d7469103296f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:42.889961 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.889915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a8a6bf60-342d-471a-955d-3be7e86aae2c-klusterlet-config\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.889961 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.889949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.890281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c9b65d-2110-4aac-8739-6e20e873e38d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.890281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265n6\" (UniqueName: \"kubernetes.io/projected/22c9b65d-2110-4aac-8739-6e20e873e38d-kube-api-access-265n6\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.890281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c48e8c59-d6b1-4bac-9f47-d7469103296f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57995d858-qxpl2\" (UID: \"c48e8c59-d6b1-4bac-9f47-d7469103296f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:42.890281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-hub\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.890481 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8c7\" (UniqueName: \"kubernetes.io/projected/a8a6bf60-342d-471a-955d-3be7e86aae2c-kube-api-access-vq8c7\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.890481 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.890481 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-ca\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.890481 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.890377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8a6bf60-342d-471a-955d-3be7e86aae2c-tmp\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.991904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.991818    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-hub\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.991904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.991874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8c7\" (UniqueName: \"kubernetes.io/projected/a8a6bf60-342d-471a-955d-3be7e86aae2c-kube-api-access-vq8c7\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.991904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.991905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.992154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.991930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-ca\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.992154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.991963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8a6bf60-342d-471a-955d-3be7e86aae2c-tmp\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.992154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jll44\" (UniqueName: \"kubernetes.io/projected/c48e8c59-d6b1-4bac-9f47-d7469103296f-kube-api-access-jll44\") pod \"managed-serviceaccount-addon-agent-57995d858-qxpl2\" (UID: \"c48e8c59-d6b1-4bac-9f47-d7469103296f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:42.992154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a8a6bf60-342d-471a-955d-3be7e86aae2c-klusterlet-config\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.992154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.992154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c9b65d-2110-4aac-8739-6e20e873e38d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.992393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-265n6\" (UniqueName: \"kubernetes.io/projected/22c9b65d-2110-4aac-8739-6e20e873e38d-kube-api-access-265n6\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:42.992393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c48e8c59-d6b1-4bac-9f47-d7469103296f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57995d858-qxpl2\" (UID: \"c48e8c59-d6b1-4bac-9f47-d7469103296f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:42.992989 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.992962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8a6bf60-342d-471a-955d-3be7e86aae2c-tmp\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:42.993759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.993735    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c9b65d-2110-4aac-8739-6e20e873e38d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:43.000725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.995424    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c48e8c59-d6b1-4bac-9f47-d7469103296f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57995d858-qxpl2\" (UID: \"c48e8c59-d6b1-4bac-9f47-d7469103296f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:43.000725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.997360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-ca\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:43.000725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.998427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-hub\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:43.000725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.998625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a8a6bf60-342d-471a-955d-3be7e86aae2c-klusterlet-config\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:43.000725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.999513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:43.000725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:42.999964    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22c9b65d-2110-4aac-8739-6e20e873e38d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:43.002391 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:43.001795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jll44\" (UniqueName: \"kubernetes.io/projected/c48e8c59-d6b1-4bac-9f47-d7469103296f-kube-api-access-jll44\") pod \"managed-serviceaccount-addon-agent-57995d858-qxpl2\" (UID: \"c48e8c59-d6b1-4bac-9f47-d7469103296f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:43.002391 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:43.002340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-265n6\" (UniqueName: \"kubernetes.io/projected/22c9b65d-2110-4aac-8739-6e20e873e38d-kube-api-access-265n6\") pod \"cluster-proxy-proxy-agent-67bfb98f68-mp5vf\" (UID: \"22c9b65d-2110-4aac-8739-6e20e873e38d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:43.002828 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:43.002770    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8c7\" (UniqueName: \"kubernetes.io/projected/a8a6bf60-342d-471a-955d-3be7e86aae2c-kube-api-access-vq8c7\") pod \"klusterlet-addon-workmgr-767fb9b45d-95ht8\" (UID: \"a8a6bf60-342d-471a-955d-3be7e86aae2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:43.061611 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:43.061575    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"
Aug 04 00:02:43.076131 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:43.076099    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:02:43.084367 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:43.084286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:02:45.820162 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:45.820119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:45.820265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.820283    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.820350    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:53.820329322 +0000 UTC m=+47.160365169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : secret "router-metrics-certs-default" not found
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:45.820367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.820457    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.820465    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:53.820446058 +0000 UTC m=+47.160481900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : configmap references non-existent config key: service-ca.crt
Aug 04 00:02:45.820621 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.820493    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls podName:77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:53.82048136 +0000 UTC m=+47.160517205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-f9x5w" (UID: "77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7") : secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:45.921251 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:45.921210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:45.921430 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:45.921295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:45.921430 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.921369    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 00:02:45.921544 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.921441    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls podName:9d4e77e6-5aa7-4639-8761-98a3e6373036 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:53.921423468 +0000 UTC m=+47.261459312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fx4v8" (UID: "9d4e77e6-5aa7-4639-8761-98a3e6373036") : secret "samples-operator-tls" not found
Aug 04 00:02:45.921544 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.921454    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 00:02:45.921544 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.921474    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656969f57d-flvn7: secret "image-registry-tls" not found
Aug 04 00:02:45.921544 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:45.921531    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls podName:b45f2a65-7f2f-461d-b362-c2cbf781275f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:53.921515278 +0000 UTC m=+47.261551136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls") pod "image-registry-656969f57d-flvn7" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f") : secret "image-registry-tls" not found
Aug 04 00:02:46.022149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:46.022113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:46.022320 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:46.022255    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 00:02:46.022320 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:46.022319    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls podName:f9162229-a6ac-41ae-b0c7-54854b0620b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:54.022304062 +0000 UTC m=+47.362339908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls") pod "dns-default-5rj2t" (UID: "f9162229-a6ac-41ae-b0c7-54854b0620b8") : secret "dns-default-metrics-tls" not found
Aug 04 00:02:51.908608 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:51.908476    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2"]
Aug 04 00:02:52.030050 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:02:52.030010    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc48e8c59_d6b1_4bac_9f47_d7469103296f.slice/crio-6c5ee70e0b35c17f6fd48bee261b990e7f05217540dd4298370db3e7a2dc95e8 WatchSource:0}: Error finding container 6c5ee70e0b35c17f6fd48bee261b990e7f05217540dd4298370db3e7a2dc95e8: Status 404 returned error can't find the container with id 6c5ee70e0b35c17f6fd48bee261b990e7f05217540dd4298370db3e7a2dc95e8
Aug 04 00:02:52.170009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.169944    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"]
Aug 04 00:02:52.196667 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.196605    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"]
Aug 04 00:02:52.417271 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.417152    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8" event={"ID":"a8a6bf60-342d-471a-955d-3be7e86aae2c","Type":"ContainerStarted","Data":"be8e2dae0663554dd4ebde93a44ac8c70ce949ca5d5e23cea8da2c92f9674751"}
Aug 04 00:02:52.422640 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.422556    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerStarted","Data":"09adf2ad15597e1d38c8033ff46478291ebf92a7c6336e979ab544456f27a576"}
Aug 04 00:02:52.425160 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.424656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd" event={"ID":"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e","Type":"ContainerStarted","Data":"5607a5fabe8e1e83c1bdf7d4746eff7a8cb358640ee3502fdf08392fa767c3e6"}
Aug 04 00:02:52.433504 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.431956    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg" event={"ID":"684f1db7-220a-445f-806e-11471e240967","Type":"ContainerStarted","Data":"cdf0072eff72fac3ecb27e491d8bb5e374d938fca4649aef18a4d3148d2dcf20"}
Aug 04 00:02:52.437302 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.435496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc" event={"ID":"bc13c545-4bca-4a9e-9241-02dc9753a1e4","Type":"ContainerStarted","Data":"1aa6d9ec5879d5498974be8cbb8ed6283b380d7032970ff15043d91cbff7f035"}
Aug 04 00:02:52.438843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.438817    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m657x" event={"ID":"ec60b111-db5a-422c-852f-109e8d2d033a","Type":"ContainerStarted","Data":"72ea97503b1b92f8d024ae7dc293ba99eae39caca7cbe828cb36378823b390ea"}
Aug 04 00:02:52.446312 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.446255    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd" podStartSLOduration=18.781707812 podStartE2EDuration="31.446223391s" totalImagesPullingTime="12.664515579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.446148135 +0000 UTC m=+45.786184004" watchObservedRunningTime="2026-08-04 00:02:52.446223391 +0000 UTC m=+45.786259237"
Aug 04 00:02:52.447141 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.447079    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" event={"ID":"22c9b65d-2110-4aac-8739-6e20e873e38d","Type":"ContainerStarted","Data":"14ecf4d66b78e70318aaf6b62311bf48827ffb4fad6809f8d7615c88dd667283"}
Aug 04 00:02:52.449654 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.448897    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/0.log"
Aug 04 00:02:52.449654 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.448932    2571 generic.go:356] "Generic (PLEG): container finished" podID="96010a8d-bd91-4415-a612-df983492481b" containerID="c4f95baecdbd6b72611d9fdc3315b710c2d2927aa6d71383fad69a7915c25f55" exitCode=255
Aug 04 00:02:52.449654 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.448998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" event={"ID":"96010a8d-bd91-4415-a612-df983492481b","Type":"ContainerDied","Data":"c4f95baecdbd6b72611d9fdc3315b710c2d2927aa6d71383fad69a7915c25f55"}
Aug 04 00:02:52.449654 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.449313    2571 scope.go:117] "RemoveContainer" containerID="c4f95baecdbd6b72611d9fdc3315b710c2d2927aa6d71383fad69a7915c25f55"
Aug 04 00:02:52.469717 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.466828    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p" event={"ID":"2bf3791e-9884-4184-8c38-4b6e1910aee2","Type":"ContainerStarted","Data":"64b7a43dd2c205b6075cff7c769ebc36ebbec5023c54809c9ac36b1fece1f1b7"}
Aug 04 00:02:52.469717 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.469343    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg" podStartSLOduration=18.940839946 podStartE2EDuration="31.469322581s" totalImagesPullingTime="12.528482635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.467634115 +0000 UTC m=+45.807669982" watchObservedRunningTime="2026-08-04 00:02:52.469322581 +0000 UTC m=+45.809358450"
Aug 04 00:02:52.495667 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.495622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-l9f49" event={"ID":"3a1f7b92-4ff8-4881-a729-172f26200589","Type":"ContainerStarted","Data":"1a3f6b8ba96927d8ae3c51384c485a0c1af50f029dd84f59db81a49c2d400f97"}
Aug 04 00:02:52.512960 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.512503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2" event={"ID":"c48e8c59-d6b1-4bac-9f47-d7469103296f","Type":"ContainerStarted","Data":"6c5ee70e0b35c17f6fd48bee261b990e7f05217540dd4298370db3e7a2dc95e8"}
Aug 04 00:02:52.513827 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.513590    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m657x" podStartSLOduration=2.489201662 podStartE2EDuration="15.513571893s" totalImagesPullingTime="13.024370231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.492884812 +0000 UTC m=+45.832920682" watchObservedRunningTime="2026-08-04 00:02:52.513571893 +0000 UTC m=+45.853607756"
Aug 04 00:02:52.516962 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.516914    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zcvzc" podStartSLOduration=18.528341371 podStartE2EDuration="31.516896151s" totalImagesPullingTime="12.98855478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.512095303 +0000 UTC m=+45.852131163" watchObservedRunningTime="2026-08-04 00:02:52.516896151 +0000 UTC m=+45.856932017"
Aug 04 00:02:52.517070 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.514921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87cf5" event={"ID":"057f196b-d0f5-42d7-861f-121f68640d4b","Type":"ContainerStarted","Data":"39ce93ca4ea50f628e6b10ac7b4803d54e8a9a99f68db178fb3b7a6bf5246350"}
Aug 04 00:02:52.517128 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.517093    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:02:52.531575 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.531349    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-l9f49" podStartSLOduration=28.050838634 podStartE2EDuration="41.531328392s" totalImagesPullingTime="13.480489758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.529193476 +0000 UTC m=+45.869229348" watchObservedRunningTime="2026-08-04 00:02:52.531328392 +0000 UTC m=+45.871364258"
Aug 04 00:02:52.552709 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.550358    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-m222p" podStartSLOduration=8.563842866 podStartE2EDuration="21.550336557s" totalImagesPullingTime="12.986493691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.548850926 +0000 UTC m=+45.888886792" watchObservedRunningTime="2026-08-04 00:02:52.550336557 +0000 UTC m=+45.890372426"
Aug 04 00:02:52.598285 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:52.596709    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87cf5" podStartSLOduration=34.174223574 podStartE2EDuration="45.596672845s" totalImagesPullingTime="11.422449271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:52.596266347 +0000 UTC m=+45.936302213" watchObservedRunningTime="2026-08-04 00:02:52.596672845 +0000 UTC m=+45.936708711"
Aug 04 00:02:53.528221 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.528020    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:02:53.530386 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.528929    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/0.log"
Aug 04 00:02:53.530386 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.529004    2571 generic.go:356] "Generic (PLEG): container finished" podID="96010a8d-bd91-4415-a612-df983492481b" containerID="e3a29488c10d77137dac1b0496d3d98e73a7ca3faec5d02356229b5e4aae24bc" exitCode=255
Aug 04 00:02:53.530386 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.529084    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" event={"ID":"96010a8d-bd91-4415-a612-df983492481b","Type":"ContainerDied","Data":"e3a29488c10d77137dac1b0496d3d98e73a7ca3faec5d02356229b5e4aae24bc"}
Aug 04 00:02:53.530386 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.529137    2571 scope.go:117] "RemoveContainer" containerID="c4f95baecdbd6b72611d9fdc3315b710c2d2927aa6d71383fad69a7915c25f55"
Aug 04 00:02:53.530386 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.529582    2571 scope.go:117] "RemoveContainer" containerID="e3a29488c10d77137dac1b0496d3d98e73a7ca3faec5d02356229b5e4aae24bc"
Aug 04 00:02:53.530386 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:53.529901    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-87nm2_openshift-console-operator(96010a8d-bd91-4415-a612-df983492481b)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" podUID="96010a8d-bd91-4415-a612-df983492481b"
Aug 04 00:02:53.536290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.536260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddcl4" event={"ID":"87f93f9e-4024-453f-b593-7bd09fe5ea55","Type":"ContainerStarted","Data":"2546d5790d3ce097ddc9c8202a9c0ea3b655f724224332e863b7253e982a27c6"}
Aug 04 00:02:53.545202 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.545174    2571 generic.go:356] "Generic (PLEG): container finished" podID="f08bc5f7-cacb-4e54-99ca-adafff1941ca" containerID="09adf2ad15597e1d38c8033ff46478291ebf92a7c6336e979ab544456f27a576" exitCode=0
Aug 04 00:02:53.546778 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.545345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerDied","Data":"09adf2ad15597e1d38c8033ff46478291ebf92a7c6336e979ab544456f27a576"}
Aug 04 00:02:53.568024 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.567839    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ddcl4" podStartSLOduration=34.777641405 podStartE2EDuration="46.5678169s" totalImagesPullingTime="11.790175495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:53.567129786 +0000 UTC m=+46.907165652" watchObservedRunningTime="2026-08-04 00:02:53.5678169 +0000 UTC m=+46.907852763"
Aug 04 00:02:53.907794 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.907666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:02:53.907794 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.907772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:53.908023 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:53.907859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:02:53.908083 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:53.908059    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:09.908038923 +0000 UTC m=+63.248074782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : configmap references non-existent config key: service-ca.crt
Aug 04 00:02:53.908528 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:53.908508    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:53.908608 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:53.908569    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls podName:77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:09.908553401 +0000 UTC m=+63.248589261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-f9x5w" (UID: "77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7") : secret "cluster-monitoring-operator-tls" not found
Aug 04 00:02:53.908672 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:53.908635    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 00:02:53.908672 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:53.908670    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs podName:8eec624e-ae11-4621-b2ca-fecd3c42cc50 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:09.908658355 +0000 UTC m=+63.248694218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs") pod "router-default-678c5cc8f6-hxqbl" (UID: "8eec624e-ae11-4621-b2ca-fecd3c42cc50") : secret "router-metrics-certs-default" not found
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.009178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.009312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.009486    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.009554    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls podName:9d4e77e6-5aa7-4639-8761-98a3e6373036 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:10.009533759 +0000 UTC m=+63.349569604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fx4v8" (UID: "9d4e77e6-5aa7-4639-8761-98a3e6373036") : secret "samples-operator-tls" not found
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.009993    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.010009    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656969f57d-flvn7: secret "image-registry-tls" not found
Aug 04 00:02:54.010512 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.010059    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls podName:b45f2a65-7f2f-461d-b362-c2cbf781275f nodeName:}" failed. No retries permitted until 2026-08-04 00:03:10.010042231 +0000 UTC m=+63.350078098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls") pod "image-registry-656969f57d-flvn7" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f") : secret "image-registry-tls" not found
Aug 04 00:02:54.087427 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.085672    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-72wgq"]
Aug 04 00:02:54.100412 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.099297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.103391 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.102773    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 00:02:54.103391 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.103034    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvwq5\""
Aug 04 00:02:54.108516 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.105913    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 00:02:54.110911 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.110211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:02:54.110911 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.110521    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 00:02:54.110911 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.110587    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls podName:f9162229-a6ac-41ae-b0c7-54854b0620b8 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:10.110569793 +0000 UTC m=+63.450605649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls") pod "dns-default-5rj2t" (UID: "f9162229-a6ac-41ae-b0c7-54854b0620b8") : secret "dns-default-metrics-tls" not found
Aug 04 00:02:54.114406 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.114272    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72wgq"]
Aug 04 00:02:54.211199 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.211168    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5fb4362-c944-4804-a9fd-55a657c0332b-data-volume\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.211378 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.211210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsf7h\" (UniqueName: \"kubernetes.io/projected/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-api-access-vsf7h\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.211378 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.211239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5fb4362-c944-4804-a9fd-55a657c0332b-crio-socket\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.211378 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.211286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.211378 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.211343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312119 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.312078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312297 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.312177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312297 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.312287    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5fb4362-c944-4804-a9fd-55a657c0332b-data-volume\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312408 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.312315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsf7h\" (UniqueName: \"kubernetes.io/projected/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-api-access-vsf7h\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312408 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.312344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5fb4362-c944-4804-a9fd-55a657c0332b-crio-socket\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312535 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.312461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5fb4362-c944-4804-a9fd-55a657c0332b-crio-socket\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.312589 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.312575    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:54.312643 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.312632    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:54.812613627 +0000 UTC m=+48.152649477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:54.312934 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.312915    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 00:02:54.313024 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.312971    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:54.81295567 +0000 UTC m=+48.152991522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : configmap "kube-rbac-proxy" not found
Aug 04 00:02:54.313300 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.313281    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5fb4362-c944-4804-a9fd-55a657c0332b-data-volume\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.323200 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.323154    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsf7h\" (UniqueName: \"kubernetes.io/projected/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-api-access-vsf7h\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.554291 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.554079    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:02:54.554768 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.554708    2571 scope.go:117] "RemoveContainer" containerID="e3a29488c10d77137dac1b0496d3d98e73a7ca3faec5d02356229b5e4aae24bc"
Aug 04 00:02:54.555129 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.555021    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-87nm2_openshift-console-operator(96010a8d-bd91-4415-a612-df983492481b)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" podUID="96010a8d-bd91-4415-a612-df983492481b"
Aug 04 00:02:54.568453 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.567285    2571 generic.go:356] "Generic (PLEG): container finished" podID="f08bc5f7-cacb-4e54-99ca-adafff1941ca" containerID="1eb366253d9cb401056de3c69704bff08c8ccf30968bf1d40d3d3eec5bf9c5ca" exitCode=0
Aug 04 00:02:54.568453 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.568383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerDied","Data":"1eb366253d9cb401056de3c69704bff08c8ccf30968bf1d40d3d3eec5bf9c5ca"}
Aug 04 00:02:54.816742 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.816645    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.816913 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:54.816755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:54.816913 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.816863    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 00:02:54.817031 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.816925    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:55.816907217 +0000 UTC m=+49.156943061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : configmap "kube-rbac-proxy" not found
Aug 04 00:02:54.817095 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.817014    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:54.817145 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:54.817133    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:55.817113463 +0000 UTC m=+49.157149312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:55.581543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:55.581508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56p8m" event={"ID":"f08bc5f7-cacb-4e54-99ca-adafff1941ca","Type":"ContainerStarted","Data":"c21766e67eb193a053282fdfeba2cd5c27c1f5ba5b198cb4c4b4e574d64fd3ae"}
Aug 04 00:02:55.604306 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:55.604246    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-56p8m" podStartSLOduration=8.947287015 podStartE2EDuration="48.604228829s" totalImagesPullingTime="39.656941814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:55.602500119 +0000 UTC m=+48.942536028" watchObservedRunningTime="2026-08-04 00:02:55.604228829 +0000 UTC m=+48.944264695"
Aug 04 00:02:55.826188 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:55.826143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:55.826368 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:55.826262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:55.826368 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:55.826327    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:55.826500 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:55.826368    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 00:02:55.826500 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:55.826417    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:57.826393173 +0000 UTC m=+51.166429019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:55.826500 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:55.826439    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:02:57.82642879 +0000 UTC m=+51.166464638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : configmap "kube-rbac-proxy" not found
Aug 04 00:02:56.503163 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:56.503131    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dc68r_06864f10-06e5-4538-aeea-6d7312ba87d5/dns-node-resolver/0.log"
Aug 04 00:02:56.904266 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:56.904238    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29763360-cqlc9_a3b7e8e6-a07f-438c-b420-28e3e4993e56/image-pruner/0.log"
Aug 04 00:02:57.703935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:57.703907    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tdlsb_727b67a9-8e1d-47e7-9e39-9ad7a66b7e06/node-ca/0.log"
Aug 04 00:02:57.846387 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:57.846345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:57.846576 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:57.846445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:57.846576 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:57.846516    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:57.846718 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:57.846580    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:03:01.846563761 +0000 UTC m=+55.186599605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : secret "insights-runtime-extractor-tls" not found
Aug 04 00:02:57.847020 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:57.846998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fb4362-c944-4804-a9fd-55a657c0332b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:02:58.303673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:58.303596    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m657x_ec60b111-db5a-422c-852f-109e8d2d033a/serve-healthcheck-canary/0.log"
Aug 04 00:02:58.502029 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:58.501997    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:58.502204 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:58.502054    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:02:58.502454 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:58.502438    2571 scope.go:117] "RemoveContainer" containerID="e3a29488c10d77137dac1b0496d3d98e73a7ca3faec5d02356229b5e4aae24bc"
Aug 04 00:02:58.502629 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:02:58.502609    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-87nm2_openshift-console-operator(96010a8d-bd91-4415-a612-df983492481b)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" podUID="96010a8d-bd91-4415-a612-df983492481b"
Aug 04 00:02:59.105492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:02:59.105458    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-p5pjd_b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e/kube-storage-version-migrator-operator/0.log"
Aug 04 00:03:00.600936 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.600893    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" event={"ID":"22c9b65d-2110-4aac-8739-6e20e873e38d","Type":"ContainerStarted","Data":"9756df00d8e8925906a5257c73d63af27cd2b3cec688db9d4d9dc53670653253"}
Aug 04 00:03:00.601440 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.600952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" event={"ID":"22c9b65d-2110-4aac-8739-6e20e873e38d","Type":"ContainerStarted","Data":"060499968ea56d282c60334cc4cd4f3b66d1cdb1150dc49eb6d4d02af2f16e2a"}
Aug 04 00:03:00.601440 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.600974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" event={"ID":"22c9b65d-2110-4aac-8739-6e20e873e38d","Type":"ContainerStarted","Data":"8b53b6f17923381c9d12e9bf3d42a85af0292bb11b34ca7a9bce5b4dbe7455e0"}
Aug 04 00:03:00.602495 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.602469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2" event={"ID":"c48e8c59-d6b1-4bac-9f47-d7469103296f","Type":"ContainerStarted","Data":"5bbf9bd375484299c23a664bb20ad3337c9d7eaf2b781b1fe3f44309cc620388"}
Aug 04 00:03:00.604003 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.603980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8" event={"ID":"a8a6bf60-342d-471a-955d-3be7e86aae2c","Type":"ContainerStarted","Data":"2451261e2bf22ea20d35245b33f967b5ec6e2ba47b2702850ec80ef1acb6152e"}
Aug 04 00:03:00.604184 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.604173    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:03:00.606052 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.606031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8"
Aug 04 00:03:00.624510 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.624467    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" podStartSLOduration=10.815345988 podStartE2EDuration="18.624455164s" totalImagesPullingTime="7.809109176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:00.622672733 +0000 UTC m=+53.962708597" watchObservedRunningTime="2026-08-04 00:03:00.624455164 +0000 UTC m=+53.964491028"
Aug 04 00:03:00.659636 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.659587    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57995d858-qxpl2" podStartSLOduration=10.692708883 podStartE2EDuration="18.659572667s" totalImagesPullingTime="7.966863784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:00.640451161 +0000 UTC m=+53.980487025" watchObservedRunningTime="2026-08-04 00:03:00.659572667 +0000 UTC m=+53.999608535"
Aug 04 00:03:00.660252 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:00.660226    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-767fb9b45d-95ht8" podStartSLOduration=10.803555317 podStartE2EDuration="18.660217411s" totalImagesPullingTime="7.856662094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:00.658643907 +0000 UTC m=+53.998679772" watchObservedRunningTime="2026-08-04 00:03:00.660217411 +0000 UTC m=+54.000253326"
Aug 04 00:03:01.889010 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:01.888962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:03:01.889468 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:03:01.889114    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 00:03:01.889468 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:03:01.889196    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls podName:c5fb4362-c944-4804-a9fd-55a657c0332b nodeName:}" failed. No retries permitted until 2026-08-04 00:03:09.889179208 +0000 UTC m=+63.229215051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72wgq" (UID: "c5fb4362-c944-4804-a9fd-55a657c0332b") : secret "insights-runtime-extractor-tls" not found
Aug 04 00:03:03.087282 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:03.087235    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" podUID="22c9b65d-2110-4aac-8739-6e20e873e38d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 00:03:04.328212 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:04.328183    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-97p4s"
Aug 04 00:03:09.961869 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.961831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:03:09.962255 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.961879    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:09.962255 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.961925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:03:09.962255 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.961957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:09.962675 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.962651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eec624e-ae11-4621-b2ca-fecd3c42cc50-service-ca-bundle\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:09.964286 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.964255    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fb4362-c944-4804-a9fd-55a657c0332b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72wgq\" (UID: \"c5fb4362-c944-4804-a9fd-55a657c0332b\") " pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:03:09.964443 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.964424    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eec624e-ae11-4621-b2ca-fecd3c42cc50-metrics-certs\") pod \"router-default-678c5cc8f6-hxqbl\" (UID: \"8eec624e-ae11-4621-b2ca-fecd3c42cc50\") " pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:09.964494 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:09.964441    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-f9x5w\" (UID: \"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:03:10.028019 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.027987    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvwq5\""
Aug 04 00:03:10.036034 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.036011    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72wgq"
Aug 04 00:03:10.063000 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.062966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:03:10.063151 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.063033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:03:10.065354 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.065327    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d4e77e6-5aa7-4639-8761-98a3e6373036-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fx4v8\" (UID: \"9d4e77e6-5aa7-4639-8761-98a3e6373036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:03:10.065467 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.065386    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"image-registry-656969f57d-flvn7\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") " pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:03:10.155232 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.155206    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kkcsp\""
Aug 04 00:03:10.163243 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.163212    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:10.163568 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.163542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:03:10.165784 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.165759    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9162229-a6ac-41ae-b0c7-54854b0620b8-metrics-tls\") pod \"dns-default-5rj2t\" (UID: \"f9162229-a6ac-41ae-b0c7-54854b0620b8\") " pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:03:10.173319 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.173297    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lbkvx\""
Aug 04 00:03:10.181457 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.181432    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"
Aug 04 00:03:10.193354 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.193329    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72wgq"]
Aug 04 00:03:10.196284 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:03:10.196258    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fb4362_c944_4804_a9fd_55a657c0332b.slice/crio-c6feaf7f233742166ba01ae2b5ca9ae997ae515aeae20746a3ff30338bf57652 WatchSource:0}: Error finding container c6feaf7f233742166ba01ae2b5ca9ae997ae515aeae20746a3ff30338bf57652: Status 404 returned error can't find the container with id c6feaf7f233742166ba01ae2b5ca9ae997ae515aeae20746a3ff30338bf57652
Aug 04 00:03:10.257346 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.257315    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dptb9\""
Aug 04 00:03:10.263303 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.263274    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:03:10.276445 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.276117    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lcqt5\""
Aug 04 00:03:10.284107 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.283866    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"
Aug 04 00:03:10.339658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.339625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9x2gl\""
Aug 04 00:03:10.342970 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.342468    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:03:10.375290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.375189    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-678c5cc8f6-hxqbl"]
Aug 04 00:03:10.385684 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:03:10.385648    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eec624e_ae11_4621_b2ca_fecd3c42cc50.slice/crio-f806f8e9d0e29f2aea78c16121c6d1c96138c4126645cf378024f0ed8c946e7a WatchSource:0}: Error finding container f806f8e9d0e29f2aea78c16121c6d1c96138c4126645cf378024f0ed8c946e7a: Status 404 returned error can't find the container with id f806f8e9d0e29f2aea78c16121c6d1c96138c4126645cf378024f0ed8c946e7a
Aug 04 00:03:10.397476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.397447    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w"]
Aug 04 00:03:10.404378 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:03:10.404327    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a6b7e1_4933_44e3_8ae6_7c18e7d81ee7.slice/crio-27bf0f5aa15fbc95efb23c5a387230e32469f1788764e9c26b4bcb6477e16237 WatchSource:0}: Error finding container 27bf0f5aa15fbc95efb23c5a387230e32469f1788764e9c26b4bcb6477e16237: Status 404 returned error can't find the container with id 27bf0f5aa15fbc95efb23c5a387230e32469f1788764e9c26b4bcb6477e16237
Aug 04 00:03:10.474242 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.473880    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656969f57d-flvn7"]
Aug 04 00:03:10.497209 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.497185    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8"]
Aug 04 00:03:10.519362 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.519335    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rj2t"]
Aug 04 00:03:10.528602 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:03:10.528580    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9162229_a6ac_41ae_b0c7_54854b0620b8.slice/crio-2818b1c8b2dbcbb0331b5e0789eac1dd6c356a114d36c58a7037f0abf7a7f0e4 WatchSource:0}: Error finding container 2818b1c8b2dbcbb0331b5e0789eac1dd6c356a114d36c58a7037f0abf7a7f0e4: Status 404 returned error can't find the container with id 2818b1c8b2dbcbb0331b5e0789eac1dd6c356a114d36c58a7037f0abf7a7f0e4
Aug 04 00:03:10.639790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.639752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w" event={"ID":"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7","Type":"ContainerStarted","Data":"27bf0f5aa15fbc95efb23c5a387230e32469f1788764e9c26b4bcb6477e16237"}
Aug 04 00:03:10.640861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.640833    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rj2t" event={"ID":"f9162229-a6ac-41ae-b0c7-54854b0620b8","Type":"ContainerStarted","Data":"2818b1c8b2dbcbb0331b5e0789eac1dd6c356a114d36c58a7037f0abf7a7f0e4"}
Aug 04 00:03:10.641896 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.641873    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8" event={"ID":"9d4e77e6-5aa7-4639-8761-98a3e6373036","Type":"ContainerStarted","Data":"e062cdfdf65ff3838c2189cfae6c3c69b3e8241045e2f20cf8466045110b3382"}
Aug 04 00:03:10.643299 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.643280    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72wgq" event={"ID":"c5fb4362-c944-4804-a9fd-55a657c0332b","Type":"ContainerStarted","Data":"24c8c565ae0b10dc04b86d8b08a9bebd736ea13454a0b40a218140f689b84815"}
Aug 04 00:03:10.643411 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.643315    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72wgq" event={"ID":"c5fb4362-c944-4804-a9fd-55a657c0332b","Type":"ContainerStarted","Data":"c6feaf7f233742166ba01ae2b5ca9ae997ae515aeae20746a3ff30338bf57652"}
Aug 04 00:03:10.644558 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.644537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl" event={"ID":"8eec624e-ae11-4621-b2ca-fecd3c42cc50","Type":"ContainerStarted","Data":"78ee53d430d5a61c0e6c84477c5e4fe7fd07a2de5c9f8541a6b74e7806657f62"}
Aug 04 00:03:10.644654 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.644577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl" event={"ID":"8eec624e-ae11-4621-b2ca-fecd3c42cc50","Type":"ContainerStarted","Data":"f806f8e9d0e29f2aea78c16121c6d1c96138c4126645cf378024f0ed8c946e7a"}
Aug 04 00:03:10.646050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.646031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656969f57d-flvn7" event={"ID":"b45f2a65-7f2f-461d-b362-c2cbf781275f","Type":"ContainerStarted","Data":"f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae"}
Aug 04 00:03:10.646143 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.646059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656969f57d-flvn7" event={"ID":"b45f2a65-7f2f-461d-b362-c2cbf781275f","Type":"ContainerStarted","Data":"e883d37ceb0e8fc602980daa99452cb869d679a2cdeb620e49df9f5748438e80"}
Aug 04 00:03:10.646201 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.646162    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:03:10.665965 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.665905    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl" podStartSLOduration=59.665889131 podStartE2EDuration="59.665889131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:10.665082553 +0000 UTC m=+64.005118420" watchObservedRunningTime="2026-08-04 00:03:10.665889131 +0000 UTC m=+64.005924995"
Aug 04 00:03:10.684441 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:10.684390    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-656969f57d-flvn7" podStartSLOduration=41.684371249 podStartE2EDuration="41.684371249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:10.683332257 +0000 UTC m=+64.023368122" watchObservedRunningTime="2026-08-04 00:03:10.684371249 +0000 UTC m=+64.024407172"
Aug 04 00:03:11.163886 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.163853    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:11.166460 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.166437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:11.653305 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.653222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72wgq" event={"ID":"c5fb4362-c944-4804-a9fd-55a657c0332b","Type":"ContainerStarted","Data":"7880da0fbab8860275e6214386f726f2025895c3e102090f699db8be9fb73904"}
Aug 04 00:03:11.653538 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.653517    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:11.655023 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.655004    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-678c5cc8f6-hxqbl"
Aug 04 00:03:11.982322 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.982284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:03:11.984721 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:11.984684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ba6ca4-fccd-45dc-9242-d157ee56e2b8-metrics-certs\") pod \"network-metrics-daemon-7pbsf\" (UID: \"88ba6ca4-fccd-45dc-9242-d157ee56e2b8\") " pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:03:12.140344 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:12.140311    2571 scope.go:117] "RemoveContainer" containerID="e3a29488c10d77137dac1b0496d3d98e73a7ca3faec5d02356229b5e4aae24bc"
Aug 04 00:03:12.164144 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:12.164116    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4cq2\""
Aug 04 00:03:12.172296 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:12.172267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7pbsf"
Aug 04 00:03:13.085787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.085744    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" podUID="22c9b65d-2110-4aac-8739-6e20e873e38d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 00:03:13.416220 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.414633    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7pbsf"]
Aug 04 00:03:13.667505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.666922    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w" event={"ID":"77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7","Type":"ContainerStarted","Data":"aa5c5a59e4467eabcaf83dff4993449f55506b16a59ee375bbb83817dab30d43"}
Aug 04 00:03:13.671340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.671224    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:03:13.671340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.671327    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" event={"ID":"96010a8d-bd91-4415-a612-df983492481b","Type":"ContainerStarted","Data":"96120c254177f0f9665febeb34b64c89e73fcbefc298a466bda9fa5d2d1cca67"}
Aug 04 00:03:13.673156 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.671739    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:03:13.675668 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.675641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8" event={"ID":"9d4e77e6-5aa7-4639-8761-98a3e6373036","Type":"ContainerStarted","Data":"9bfbda24bb1a7b0484d1490639fa2e57941d54867ebc8dd84544a1a193e7bb73"}
Aug 04 00:03:13.675792 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.675711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8" event={"ID":"9d4e77e6-5aa7-4639-8761-98a3e6373036","Type":"ContainerStarted","Data":"44ebb7ff9e32de45b5414748665044614965c1080efa586f723860d458027843"}
Aug 04 00:03:13.681025 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.680558    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7pbsf" event={"ID":"88ba6ca4-fccd-45dc-9242-d157ee56e2b8","Type":"ContainerStarted","Data":"315999ea0712278cb57779c60b552dd1fcb51721c6d5334d7c185946b18b76ab"}
Aug 04 00:03:13.689754 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.689678    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-f9x5w" podStartSLOduration=59.839272387 podStartE2EDuration="1m2.6896639s" totalImagesPullingTime="2.850391513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:13.688140556 +0000 UTC m=+67.028176419" watchObservedRunningTime="2026-08-04 00:03:13.6896639 +0000 UTC m=+67.029699765"
Aug 04 00:03:13.707676 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.707597    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2" podStartSLOduration=39.97702883 podStartE2EDuration="52.707574224s" totalImagesPullingTime="12.730545394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:13.705641703 +0000 UTC m=+67.045677569" watchObservedRunningTime="2026-08-04 00:03:13.707574224 +0000 UTC m=+67.047610090"
Aug 04 00:03:13.726160 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:13.726000    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fx4v8" podStartSLOduration=50.04317369 podStartE2EDuration="52.725938094s" totalImagesPullingTime="2.682764404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:13.725085169 +0000 UTC m=+67.065121035" watchObservedRunningTime="2026-08-04 00:03:13.725938094 +0000 UTC m=+67.065973961"
Aug 04 00:03:14.103076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:14.103042    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-87nm2"
Aug 04 00:03:16.697783 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.697741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rj2t" event={"ID":"f9162229-a6ac-41ae-b0c7-54854b0620b8","Type":"ContainerStarted","Data":"07d3dc1b75ea1ab50fd47f4779fc63d1ce8d970dda345981143822cce0b5f5e1"}
Aug 04 00:03:16.698251 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.697838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rj2t" event={"ID":"f9162229-a6ac-41ae-b0c7-54854b0620b8","Type":"ContainerStarted","Data":"6db52b8d96a0e5b5c101160a0d75238fef51dedeb36fc4b292178c8cf2dcf240"}
Aug 04 00:03:16.698251 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.697870    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:03:16.699877 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.699853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72wgq" event={"ID":"c5fb4362-c944-4804-a9fd-55a657c0332b","Type":"ContainerStarted","Data":"786ffd38f8448b29ee7eb45e119a00fb29c9e83119154d993af5d47a694e536d"}
Aug 04 00:03:16.701610 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.701581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7pbsf" event={"ID":"88ba6ca4-fccd-45dc-9242-d157ee56e2b8","Type":"ContainerStarted","Data":"2e8be76fb7627bfb2d8a16f221f0228d0faacbb8816bcd579b3728cd40b92ae7"}
Aug 04 00:03:16.701744 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.701636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7pbsf" event={"ID":"88ba6ca4-fccd-45dc-9242-d157ee56e2b8","Type":"ContainerStarted","Data":"6002b5a08fd74764059db9689b04e9aa39e818105ea52e4e96f2f3307a448a1a"}
Aug 04 00:03:16.715869 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.715826    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5rj2t" podStartSLOduration=33.247076988 podStartE2EDuration="38.715812218s" totalImagesPullingTime="5.46873523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:16.714386946 +0000 UTC m=+70.054422808" watchObservedRunningTime="2026-08-04 00:03:16.715812218 +0000 UTC m=+70.055848083"
Aug 04 00:03:16.732347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.732304    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-72wgq" podStartSLOduration=17.21929804 podStartE2EDuration="22.732290106s" totalImagesPullingTime="5.512992066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:16.731505868 +0000 UTC m=+70.071541745" watchObservedRunningTime="2026-08-04 00:03:16.732290106 +0000 UTC m=+70.072325971"
Aug 04 00:03:16.746290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:16.746241    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7pbsf" podStartSLOduration=67.172102606 podStartE2EDuration="1m9.746226991s" totalImagesPullingTime="2.574124385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:16.745345053 +0000 UTC m=+70.085380918" watchObservedRunningTime="2026-08-04 00:03:16.746226991 +0000 UTC m=+70.086262855"
Aug 04 00:03:22.294057 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.294026    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9hb6c"]
Aug 04 00:03:22.297537 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.297517    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.300180 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.300161    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 00:03:22.300180 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.300162    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 00:03:22.300370 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.300240    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 00:03:22.300520 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.300493    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 00:03:22.301069 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.301052    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zm4p5\""
Aug 04 00:03:22.471359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471363    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-sys\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-textfile\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-wtmp\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471420    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c60b60f-666e-4613-803b-527881ddd20e-metrics-client-ca\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-tls\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471801 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471656    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjzg\" (UniqueName: \"kubernetes.io/projected/0c60b60f-666e-4613-803b-527881ddd20e-kube-api-access-xmjzg\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.471801 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.471703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-root\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573048 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.572960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573048 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-tls\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573269 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:03:22.573112    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 00:03:22.573269 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:03:22.573162    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-tls podName:0c60b60f-666e-4613-803b-527881ddd20e nodeName:}" failed. No retries permitted until 2026-08-04 00:03:23.073146383 +0000 UTC m=+76.413182226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-tls") pod "node-exporter-9hb6c" (UID: "0c60b60f-666e-4613-803b-527881ddd20e") : secret "node-exporter-tls" not found
Aug 04 00:03:22.573269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjzg\" (UniqueName: \"kubernetes.io/projected/0c60b60f-666e-4613-803b-527881ddd20e-kube-api-access-xmjzg\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573190    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-root\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-sys\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573270    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-root\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-textfile\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-wtmp\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c60b60f-666e-4613-803b-527881ddd20e-metrics-client-ca\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573362    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-sys\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573505    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-wtmp\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-textfile\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573970 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573621    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.573970 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.573910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c60b60f-666e-4613-803b-527881ddd20e-metrics-client-ca\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.575399 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.575380    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:22.583996 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:22.583974    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjzg\" (UniqueName: \"kubernetes.io/projected/0c60b60f-666e-4613-803b-527881ddd20e-kube-api-access-xmjzg\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:23.076921 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.076885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-tls\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:23.079250 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.079221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c60b60f-666e-4613-803b-527881ddd20e-node-exporter-tls\") pod \"node-exporter-9hb6c\" (UID: \"0c60b60f-666e-4613-803b-527881ddd20e\") " pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:23.085950 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.085919    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" podUID="22c9b65d-2110-4aac-8739-6e20e873e38d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 00:03:23.086065 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.085980    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf"
Aug 04 00:03:23.086462 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.086432    2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9756df00d8e8925906a5257c73d63af27cd2b3cec688db9d4d9dc53670653253"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Aug 04 00:03:23.086537 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.086478    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" podUID="22c9b65d-2110-4aac-8739-6e20e873e38d" containerName="service-proxy" containerID="cri-o://9756df00d8e8925906a5257c73d63af27cd2b3cec688db9d4d9dc53670653253" gracePeriod=30
Aug 04 00:03:23.206459 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.206438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hb6c"
Aug 04 00:03:23.219563 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:03:23.219531    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c60b60f_666e_4613_803b_527881ddd20e.slice/crio-98a2a50ca37656b7cc08aca4874ed42515391b8215d396741eaef63066b9a5fc WatchSource:0}: Error finding container 98a2a50ca37656b7cc08aca4874ed42515391b8215d396741eaef63066b9a5fc: Status 404 returned error can't find the container with id 98a2a50ca37656b7cc08aca4874ed42515391b8215d396741eaef63066b9a5fc
Aug 04 00:03:23.548523 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.548495    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87cf5"
Aug 04 00:03:23.735911 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.735879    2571 generic.go:356] "Generic (PLEG): container finished" podID="22c9b65d-2110-4aac-8739-6e20e873e38d" containerID="9756df00d8e8925906a5257c73d63af27cd2b3cec688db9d4d9dc53670653253" exitCode=2
Aug 04 00:03:23.736133 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.735953    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" event={"ID":"22c9b65d-2110-4aac-8739-6e20e873e38d","Type":"ContainerDied","Data":"9756df00d8e8925906a5257c73d63af27cd2b3cec688db9d4d9dc53670653253"}
Aug 04 00:03:23.736133 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.736007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bfb98f68-mp5vf" event={"ID":"22c9b65d-2110-4aac-8739-6e20e873e38d","Type":"ContainerStarted","Data":"e6049f479f162c18644870dac4fbf1b068e2f7334ceb93f1a737fbfc5011ea34"}
Aug 04 00:03:23.737453 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:23.737426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hb6c" event={"ID":"0c60b60f-666e-4613-803b-527881ddd20e","Type":"ContainerStarted","Data":"98a2a50ca37656b7cc08aca4874ed42515391b8215d396741eaef63066b9a5fc"}
Aug 04 00:03:24.746139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:24.746105    2571 generic.go:356] "Generic (PLEG): container finished" podID="0c60b60f-666e-4613-803b-527881ddd20e" containerID="bb23825b1312f5c0d9ec089417f5ef797dfd40b7cfc8207dd5211d6e4e504184" exitCode=0
Aug 04 00:03:24.746528 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:24.746192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hb6c" event={"ID":"0c60b60f-666e-4613-803b-527881ddd20e","Type":"ContainerDied","Data":"bb23825b1312f5c0d9ec089417f5ef797dfd40b7cfc8207dd5211d6e4e504184"}
Aug 04 00:03:25.752147 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:25.752113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hb6c" event={"ID":"0c60b60f-666e-4613-803b-527881ddd20e","Type":"ContainerStarted","Data":"177d8ddd1cefae6ba81d78f97879e07accfc430ad20c42b38ae09074c4a6b3bc"}
Aug 04 00:03:25.752515 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:25.752172    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hb6c" event={"ID":"0c60b60f-666e-4613-803b-527881ddd20e","Type":"ContainerStarted","Data":"d9a06d6033dc3bcfed5c799bfeaf0af20cb017a0c155fce86aaa5abee533e42a"}
Aug 04 00:03:25.772659 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:25.772602    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9hb6c" podStartSLOduration=2.7354696020000002 podStartE2EDuration="3.772585686s" totalImagesPullingTime="973.510035ms" totalInitContainerRuntime="63.606049ms" isStatefulPod=true podCreationTimestamp="2026-08-04 00:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:25.771075426 +0000 UTC m=+79.111111292" watchObservedRunningTime="2026-08-04 00:03:25.772585686 +0000 UTC m=+79.112621550"
Aug 04 00:03:26.710235 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:26.710207    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5rj2t"
Aug 04 00:03:30.267754 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:30.267615    2571 patch_prober.go:28] interesting pod/image-registry-656969f57d-flvn7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 00:03:30.267754 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:30.267721    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-656969f57d-flvn7" podUID="b45f2a65-7f2f-461d-b362-c2cbf781275f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:03:31.658241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:31.658212    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:03:37.957472 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:37.957442    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656969f57d-flvn7"]
Aug 04 00:03:58.882165 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:58.882131    2571 generic.go:356] "Generic (PLEG): container finished" podID="684f1db7-220a-445f-806e-11471e240967" containerID="cdf0072eff72fac3ecb27e491d8bb5e374d938fca4649aef18a4d3148d2dcf20" exitCode=0
Aug 04 00:03:58.882575 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:58.882207    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg" event={"ID":"684f1db7-220a-445f-806e-11471e240967","Type":"ContainerDied","Data":"cdf0072eff72fac3ecb27e491d8bb5e374d938fca4649aef18a4d3148d2dcf20"}
Aug 04 00:03:58.882575 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:58.882549    2571 scope.go:117] "RemoveContainer" containerID="cdf0072eff72fac3ecb27e491d8bb5e374d938fca4649aef18a4d3148d2dcf20"
Aug 04 00:03:59.887514 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:03:59.887482    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-r94wg" event={"ID":"684f1db7-220a-445f-806e-11471e240967","Type":"ContainerStarted","Data":"1dbddb1e032ad16a4844d0a34dc4046301b3547970bcb06e7b0fa58aad9b20b2"}
Aug 04 00:04:02.976142 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:02.976101    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-656969f57d-flvn7" podUID="b45f2a65-7f2f-461d-b362-c2cbf781275f" containerName="registry" containerID="cri-o://f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae" gracePeriod=30
Aug 04 00:04:03.224613 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.224588    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:04:03.288601 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288512    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-trusted-ca\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288601 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288566    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-image-registry-private-configuration\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288601 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288597    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqsq2\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-kube-api-access-tqsq2\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-installation-pull-secrets\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288655    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45f2a65-7f2f-461d-b362-c2cbf781275f-ca-trust-extracted\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288765    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-certificates\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288831    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.288904 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.288860    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-bound-sa-token\") pod \"b45f2a65-7f2f-461d-b362-c2cbf781275f\" (UID: \"b45f2a65-7f2f-461d-b362-c2cbf781275f\") "
Aug 04 00:04:03.289538 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.289059    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:03.289538 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.289271    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:03.291283 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.291225    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:03.291398 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.291355    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:03.291468 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.291443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:03.291509 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.291487    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-kube-api-access-tqsq2" (OuterVolumeSpecName: "kube-api-access-tqsq2") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "kube-api-access-tqsq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:03.291792 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.291685    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:03.297898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.297876    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45f2a65-7f2f-461d-b362-c2cbf781275f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b45f2a65-7f2f-461d-b362-c2cbf781275f" (UID: "b45f2a65-7f2f-461d-b362-c2cbf781275f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:03.389682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389645    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45f2a65-7f2f-461d-b362-c2cbf781275f-ca-trust-extracted\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389674    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-certificates\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389687    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-registry-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389724    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-bound-sa-token\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389735    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45f2a65-7f2f-461d-b362-c2cbf781275f-trusted-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389746    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-image-registry-private-configuration\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389757    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqsq2\" (UniqueName: \"kubernetes.io/projected/b45f2a65-7f2f-461d-b362-c2cbf781275f-kube-api-access-tqsq2\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.389928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.389770    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45f2a65-7f2f-461d-b362-c2cbf781275f-installation-pull-secrets\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:03.902995 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.902961    2571 generic.go:356] "Generic (PLEG): container finished" podID="b45f2a65-7f2f-461d-b362-c2cbf781275f" containerID="f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae" exitCode=0
Aug 04 00:04:03.903289 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.903012    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656969f57d-flvn7"
Aug 04 00:04:03.903289 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.903045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656969f57d-flvn7" event={"ID":"b45f2a65-7f2f-461d-b362-c2cbf781275f","Type":"ContainerDied","Data":"f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae"}
Aug 04 00:04:03.903289 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.903094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656969f57d-flvn7" event={"ID":"b45f2a65-7f2f-461d-b362-c2cbf781275f","Type":"ContainerDied","Data":"e883d37ceb0e8fc602980daa99452cb869d679a2cdeb620e49df9f5748438e80"}
Aug 04 00:04:03.903289 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.903114    2571 scope.go:117] "RemoveContainer" containerID="f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae"
Aug 04 00:04:03.911336 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.911321    2571 scope.go:117] "RemoveContainer" containerID="f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae"
Aug 04 00:04:03.911568 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:04:03.911552    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae\": container with ID starting with f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae not found: ID does not exist" containerID="f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae"
Aug 04 00:04:03.911616 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.911575    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae"} err="failed to get container status \"f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae\": rpc error: code = NotFound desc = could not find container \"f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae\": container with ID starting with f62d5d2665535be082b1f3fcf31e23c25f6d13b479321482da027dbbc04171ae not found: ID does not exist"
Aug 04 00:04:03.924001 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.923978    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656969f57d-flvn7"]
Aug 04 00:04:03.930424 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:03.928787    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-656969f57d-flvn7"]
Aug 04 00:04:05.145325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:05.145286    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45f2a65-7f2f-461d-b362-c2cbf781275f" path="/var/lib/kubelet/pods/b45f2a65-7f2f-461d-b362-c2cbf781275f/volumes"
Aug 04 00:04:09.926406 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:09.926370    2571 generic.go:356] "Generic (PLEG): container finished" podID="a3b7e8e6-a07f-438c-b420-28e3e4993e56" containerID="4a9962245e033398ecdfceddb510c544300935c5286de8d9757880fd3ce46b40" exitCode=0
Aug 04 00:04:09.926803 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:09.926441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29763360-cqlc9" event={"ID":"a3b7e8e6-a07f-438c-b420-28e3e4993e56","Type":"ContainerDied","Data":"4a9962245e033398ecdfceddb510c544300935c5286de8d9757880fd3ce46b40"}
Aug 04 00:04:11.058292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.058270    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:04:11.153092 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.153069    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-727pt\" (UniqueName: \"kubernetes.io/projected/a3b7e8e6-a07f-438c-b420-28e3e4993e56-kube-api-access-727pt\") pod \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") "
Aug 04 00:04:11.153245 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.153102    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b7e8e6-a07f-438c-b420-28e3e4993e56-serviceca\") pod \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\" (UID: \"a3b7e8e6-a07f-438c-b420-28e3e4993e56\") "
Aug 04 00:04:11.153492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.153469    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3b7e8e6-a07f-438c-b420-28e3e4993e56-serviceca" (OuterVolumeSpecName: "serviceca") pod "a3b7e8e6-a07f-438c-b420-28e3e4993e56" (UID: "a3b7e8e6-a07f-438c-b420-28e3e4993e56"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:11.155207 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.155176    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b7e8e6-a07f-438c-b420-28e3e4993e56-kube-api-access-727pt" (OuterVolumeSpecName: "kube-api-access-727pt") pod "a3b7e8e6-a07f-438c-b420-28e3e4993e56" (UID: "a3b7e8e6-a07f-438c-b420-28e3e4993e56"). InnerVolumeSpecName "kube-api-access-727pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:11.253741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.253633    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-727pt\" (UniqueName: \"kubernetes.io/projected/a3b7e8e6-a07f-438c-b420-28e3e4993e56-kube-api-access-727pt\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:11.253741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.253667    2571 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b7e8e6-a07f-438c-b420-28e3e4993e56-serviceca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:04:11.935939 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.935912    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29763360-cqlc9"
Aug 04 00:04:11.935939 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.935920    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29763360-cqlc9" event={"ID":"a3b7e8e6-a07f-438c-b420-28e3e4993e56","Type":"ContainerDied","Data":"41ab34c0e7ef818cf523c9c4d990a7dd7664fcbdc817172e65314deb7bffbfe2"}
Aug 04 00:04:11.936128 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:11.935960    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41ab34c0e7ef818cf523c9c4d990a7dd7664fcbdc817172e65314deb7bffbfe2"
Aug 04 00:04:13.943849 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:13.943817    2571 generic.go:356] "Generic (PLEG): container finished" podID="b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e" containerID="5607a5fabe8e1e83c1bdf7d4746eff7a8cb358640ee3502fdf08392fa767c3e6" exitCode=0
Aug 04 00:04:13.944231 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:13.943879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd" event={"ID":"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e","Type":"ContainerDied","Data":"5607a5fabe8e1e83c1bdf7d4746eff7a8cb358640ee3502fdf08392fa767c3e6"}
Aug 04 00:04:13.944231 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:13.944153    2571 scope.go:117] "RemoveContainer" containerID="5607a5fabe8e1e83c1bdf7d4746eff7a8cb358640ee3502fdf08392fa767c3e6"
Aug 04 00:04:14.949536 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:14.949503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-p5pjd" event={"ID":"b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e","Type":"ContainerStarted","Data":"bba309cfb265dea1d7b291ebdb889edfb764c0d2069223bf603816f40064e6a3"}
Aug 04 00:04:28.000544 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:28.000517    2571 generic.go:356] "Generic (PLEG): container finished" podID="3a1f7b92-4ff8-4881-a729-172f26200589" containerID="1a3f6b8ba96927d8ae3c51384c485a0c1af50f029dd84f59db81a49c2d400f97" exitCode=0
Aug 04 00:04:28.000915 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:28.000565    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-l9f49" event={"ID":"3a1f7b92-4ff8-4881-a729-172f26200589","Type":"ContainerDied","Data":"1a3f6b8ba96927d8ae3c51384c485a0c1af50f029dd84f59db81a49c2d400f97"}
Aug 04 00:04:28.000964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:28.000913    2571 scope.go:117] "RemoveContainer" containerID="1a3f6b8ba96927d8ae3c51384c485a0c1af50f029dd84f59db81a49c2d400f97"
Aug 04 00:04:29.009490 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:04:29.009455    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-l9f49" event={"ID":"3a1f7b92-4ff8-4881-a729-172f26200589","Type":"ContainerStarted","Data":"b3dd3717bf74756cd269dd5cb8f1265b72915d6261023e264bd082219fc4e1e0"}
Aug 04 00:07:07.085410 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:07:07.085367    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:07:07.089773 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:07:07.089755    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:07:07.090074 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:07:07.090054    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:07:07.095085 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:07:07.095063    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:07:07.097084 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:07:07.097067    2571 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 00:08:06.170056 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.169979    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"]
Aug 04 00:08:06.170451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.170272    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b7e8e6-a07f-438c-b420-28e3e4993e56" containerName="image-pruner"
Aug 04 00:08:06.170451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.170283    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b7e8e6-a07f-438c-b420-28e3e4993e56" containerName="image-pruner"
Aug 04 00:08:06.170451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.170297    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45f2a65-7f2f-461d-b362-c2cbf781275f" containerName="registry"
Aug 04 00:08:06.170451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.170302    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45f2a65-7f2f-461d-b362-c2cbf781275f" containerName="registry"
Aug 04 00:08:06.170451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.170349    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45f2a65-7f2f-461d-b362-c2cbf781275f" containerName="registry"
Aug 04 00:08:06.170451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.170357    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b7e8e6-a07f-438c-b420-28e3e4993e56" containerName="image-pruner"
Aug 04 00:08:06.173201 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.173184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.176287 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.176265    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 00:08:06.176433 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.176415    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 00:08:06.176505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.176467    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rp998\""
Aug 04 00:08:06.176750 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.176731    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 00:08:06.176982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.176968    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 00:08:06.198038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.198016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"]
Aug 04 00:08:06.246165 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.246128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfdr\" (UniqueName: \"kubernetes.io/projected/02700f58-1424-4511-8f9f-5ba5830e1829-kube-api-access-ntfdr\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.246340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.246191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02700f58-1424-4511-8f9f-5ba5830e1829-webhook-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.246340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.246268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/02700f58-1424-4511-8f9f-5ba5830e1829-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.246340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.246302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02700f58-1424-4511-8f9f-5ba5830e1829-tmp\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.246454 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.246340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/02700f58-1424-4511-8f9f-5ba5830e1829-manifests\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.346876 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.346834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02700f58-1424-4511-8f9f-5ba5830e1829-webhook-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.346876 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.346880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/02700f58-1424-4511-8f9f-5ba5830e1829-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.347071 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.346899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02700f58-1424-4511-8f9f-5ba5830e1829-tmp\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.347071 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.346941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/02700f58-1424-4511-8f9f-5ba5830e1829-manifests\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.347071 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.346971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfdr\" (UniqueName: \"kubernetes.io/projected/02700f58-1424-4511-8f9f-5ba5830e1829-kube-api-access-ntfdr\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.347480 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.347445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/02700f58-1424-4511-8f9f-5ba5830e1829-manifests\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.349294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.349268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02700f58-1424-4511-8f9f-5ba5830e1829-tmp\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.349418 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.349400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/02700f58-1424-4511-8f9f-5ba5830e1829-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.349554 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.349533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02700f58-1424-4511-8f9f-5ba5830e1829-webhook-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.354738 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.354717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfdr\" (UniqueName: \"kubernetes.io/projected/02700f58-1424-4511-8f9f-5ba5830e1829-kube-api-access-ntfdr\") pod \"opendatahub-operator-controller-manager-8594b76987-pzjfv\" (UID: \"02700f58-1424-4511-8f9f-5ba5830e1829\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.482642 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.482541    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:06.631569 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.631545    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"]
Aug 04 00:08:06.633558 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:08:06.633531    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02700f58_1424_4511_8f9f_5ba5830e1829.slice/crio-f3c8e253d12eeca36054a8c699f65b7372c794ab57927167063df6677702ed9c WatchSource:0}: Error finding container f3c8e253d12eeca36054a8c699f65b7372c794ab57927167063df6677702ed9c: Status 404 returned error can't find the container with id f3c8e253d12eeca36054a8c699f65b7372c794ab57927167063df6677702ed9c
Aug 04 00:08:06.635313 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.635294    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:08:06.812843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:06.812752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv" event={"ID":"02700f58-1424-4511-8f9f-5ba5830e1829","Type":"ContainerStarted","Data":"f3c8e253d12eeca36054a8c699f65b7372c794ab57927167063df6677702ed9c"}
Aug 04 00:08:09.827673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:09.827580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv" event={"ID":"02700f58-1424-4511-8f9f-5ba5830e1829","Type":"ContainerStarted","Data":"5901757f7812ee1967d533eaea2bbc8dcc71354f84d6528009de26d676900ec8"}
Aug 04 00:08:10.836346 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:10.836306    2571 generic.go:356] "Generic (PLEG): container finished" podID="02700f58-1424-4511-8f9f-5ba5830e1829" containerID="5901757f7812ee1967d533eaea2bbc8dcc71354f84d6528009de26d676900ec8" exitCode=0
Aug 04 00:08:10.836730 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:10.836354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv" event={"ID":"02700f58-1424-4511-8f9f-5ba5830e1829","Type":"ContainerDied","Data":"5901757f7812ee1967d533eaea2bbc8dcc71354f84d6528009de26d676900ec8"}
Aug 04 00:08:11.842791 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:11.842748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv" event={"ID":"02700f58-1424-4511-8f9f-5ba5830e1829","Type":"ContainerStarted","Data":"94775f92fc91105b24e0b13d007a70b5336c24f72c908203345df555452eff82"}
Aug 04 00:08:11.843182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:11.842894    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:11.864912 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:11.864857    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv" podStartSLOduration=1.534630565 podStartE2EDuration="5.86484141s" totalImagesPullingTime="3.324647191s" totalInitContainerRuntime="1.005563654s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:11.862526985 +0000 UTC m=+365.202562849" watchObservedRunningTime="2026-08-04 00:08:11.86484141 +0000 UTC m=+365.204877274"
Aug 04 00:08:22.849858 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:22.849826    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-pzjfv"
Aug 04 00:08:32.173751 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.173714    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"]
Aug 04 00:08:32.176937 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.176917    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.179571 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.179518    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 00:08:32.179759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.179741    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 00:08:32.179851 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.179766    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 00:08:32.179851 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.179791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 00:08:32.179985 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.179838    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v8qwf\""
Aug 04 00:08:32.196043 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.196003    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"]
Aug 04 00:08:32.268427 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49pbs\" (UniqueName: \"kubernetes.io/projected/73d75a71-c693-4405-94ed-acc82cd98d93-kube-api-access-49pbs\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.268427 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.268675 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d75a71-c693-4405-94ed-acc82cd98d93-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.268675 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.268675 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75a71-c693-4405-94ed-acc82cd98d93-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.268675 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.268675 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.268587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75a71-c693-4405-94ed-acc82cd98d93-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369040 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.368996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49pbs\" (UniqueName: \"kubernetes.io/projected/73d75a71-c693-4405-94ed-acc82cd98d93-kube-api-access-49pbs\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d75a71-c693-4405-94ed-acc82cd98d93-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75a71-c693-4405-94ed-acc82cd98d93-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369203    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75a71-c693-4405-94ed-acc82cd98d93-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.369874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.369845    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d75a71-c693-4405-94ed-acc82cd98d93-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.371636 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.371603    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75a71-c693-4405-94ed-acc82cd98d93-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.371761 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.371639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.371761 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.371756    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.371836 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.371822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d75a71-c693-4405-94ed-acc82cd98d93-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.377071 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.377051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75a71-c693-4405-94ed-acc82cd98d93-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.377172 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.377117    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49pbs\" (UniqueName: \"kubernetes.io/projected/73d75a71-c693-4405-94ed-acc82cd98d93-kube-api-access-49pbs\") pod \"istiod-openshift-gateway-5677ccb49b-8zngn\" (UID: \"73d75a71-c693-4405-94ed-acc82cd98d93\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.487108 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.487019    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:32.625386 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.625357    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"]
Aug 04 00:08:32.628446 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:08:32.628416    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d75a71_c693_4405_94ed_acc82cd98d93.slice/crio-855ddf67086a207ad9929a7c7e19a29740f1573d389d75b2de8e2f949ac57552 WatchSource:0}: Error finding container 855ddf67086a207ad9929a7c7e19a29740f1573d389d75b2de8e2f949ac57552: Status 404 returned error can't find the container with id 855ddf67086a207ad9929a7c7e19a29740f1573d389d75b2de8e2f949ac57552
Aug 04 00:08:32.925335 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:32.925300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn" event={"ID":"73d75a71-c693-4405-94ed-acc82cd98d93","Type":"ContainerStarted","Data":"855ddf67086a207ad9929a7c7e19a29740f1573d389d75b2de8e2f949ac57552"}
Aug 04 00:08:35.256987 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.256948    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 00:08:35.257310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.257030    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 00:08:35.809941 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.809906    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"]
Aug 04 00:08:35.813128 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.813112    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:35.815624 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.815604    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 00:08:35.815758 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.815604    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:08:35.816757 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.816730    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 00:08:35.816889 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.816764    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cdkzt\""
Aug 04 00:08:35.816889 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.816779    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 00:08:35.816889 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.816787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 00:08:35.822611 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.822590    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"]
Aug 04 00:08:35.901471 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.901438    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-cert\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:35.901471 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.901475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpw4h\" (UniqueName: \"kubernetes.io/projected/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-kube-api-access-mpw4h\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:35.901729 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.901518    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-metrics-cert\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:35.901729 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.901553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-manager-config\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:35.944393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.944356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn" event={"ID":"73d75a71-c693-4405-94ed-acc82cd98d93","Type":"ContainerStarted","Data":"707ac88bcec289b43283fcdd4afecc084f022dd10551e7c3fbb01707f2708ae0"}
Aug 04 00:08:35.944557 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.944428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:35.980643 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:35.980585    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn" podStartSLOduration=1.354812644 podStartE2EDuration="3.9805631s" totalImagesPullingTime="2.625750456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:35.977928337 +0000 UTC m=+389.317964203" watchObservedRunningTime="2026-08-04 00:08:35.9805631 +0000 UTC m=+389.320598966"
Aug 04 00:08:36.002198 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.002169    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-cert\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.002715 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.002214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpw4h\" (UniqueName: \"kubernetes.io/projected/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-kube-api-access-mpw4h\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.002715 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.002266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-metrics-cert\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.002715 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.002343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-manager-config\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.003158 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.003134    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-manager-config\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.004868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.004844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-metrics-cert\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.004960 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.004927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-cert\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.010395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.010373    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpw4h\" (UniqueName: \"kubernetes.io/projected/0f19d786-c0bd-41cb-a6fe-e5ccb6911187-kube-api-access-mpw4h\") pod \"lws-controller-manager-b745d77d5-246jw\" (UID: \"0f19d786-c0bd-41cb-a6fe-e5ccb6911187\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.123391 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.123290    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:36.307339 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.307306    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"]
Aug 04 00:08:36.310368 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:08:36.310271    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f19d786_c0bd_41cb_a6fe_e5ccb6911187.slice/crio-01a6c8974603e98793a6b387edd629b59491d5f8da0acd85756ccdf07fd6308b WatchSource:0}: Error finding container 01a6c8974603e98793a6b387edd629b59491d5f8da0acd85756ccdf07fd6308b: Status 404 returned error can't find the container with id 01a6c8974603e98793a6b387edd629b59491d5f8da0acd85756ccdf07fd6308b
Aug 04 00:08:36.951544 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.951275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw" event={"ID":"0f19d786-c0bd-41cb-a6fe-e5ccb6911187","Type":"ContainerStarted","Data":"01a6c8974603e98793a6b387edd629b59491d5f8da0acd85756ccdf07fd6308b"}
Aug 04 00:08:36.953966 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:36.953935    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8zngn"
Aug 04 00:08:38.962421 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:38.962327    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw" event={"ID":"0f19d786-c0bd-41cb-a6fe-e5ccb6911187","Type":"ContainerStarted","Data":"1a201aa122a9ea0ddb11be8b8e3239be32e4659e4dc23571803a36dcdcf7f628"}
Aug 04 00:08:38.962808 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:38.962463    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:08:38.980274 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:38.980228    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw" podStartSLOduration=1.639278461 podStartE2EDuration="3.980214138s" totalImagesPullingTime="2.340935677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:38.97884465 +0000 UTC m=+392.318880515" watchObservedRunningTime="2026-08-04 00:08:38.980214138 +0000 UTC m=+392.320250002"
Aug 04 00:08:49.968337 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:08:49.968306    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-246jw"
Aug 04 00:11:59.452550 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.452509    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"]
Aug 04 00:11:59.455876 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.455853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.458539 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.458512    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 00:11:59.458676 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.458607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jdsqp\""
Aug 04 00:11:59.464473 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.464443    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"]
Aug 04 00:11:59.478607 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.478577    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-wh2dm"]
Aug 04 00:11:59.482939 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.482907    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.501129 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.501095    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-wh2dm"]
Aug 04 00:11:59.558534 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.558486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf06cf76-5156-41c5-b637-e206b34005c0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-wh2dm\" (UID: \"cf06cf76-5156-41c5-b637-e206b34005c0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.558534 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.558539    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwzfl\" (UniqueName: \"kubernetes.io/projected/cf06cf76-5156-41c5-b637-e206b34005c0-kube-api-access-xwzfl\") pod \"payload-processing-5cc6cd444b-wh2dm\" (UID: \"cf06cf76-5156-41c5-b637-e206b34005c0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.558768 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.558573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6a73b9-fcd9-4c35-8a92-46b333b1b879-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ncqq5\" (UID: \"db6a73b9-fcd9-4c35-8a92-46b333b1b879\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.558768 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.558599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xm75\" (UniqueName: \"kubernetes.io/projected/db6a73b9-fcd9-4c35-8a92-46b333b1b879-kube-api-access-4xm75\") pod \"payload-pre-processing-687dbb6cf6-ncqq5\" (UID: \"db6a73b9-fcd9-4c35-8a92-46b333b1b879\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.659802 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.659761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf06cf76-5156-41c5-b637-e206b34005c0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-wh2dm\" (UID: \"cf06cf76-5156-41c5-b637-e206b34005c0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.660009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.659811    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwzfl\" (UniqueName: \"kubernetes.io/projected/cf06cf76-5156-41c5-b637-e206b34005c0-kube-api-access-xwzfl\") pod \"payload-processing-5cc6cd444b-wh2dm\" (UID: \"cf06cf76-5156-41c5-b637-e206b34005c0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.660009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.659845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6a73b9-fcd9-4c35-8a92-46b333b1b879-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ncqq5\" (UID: \"db6a73b9-fcd9-4c35-8a92-46b333b1b879\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.660009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.659865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xm75\" (UniqueName: \"kubernetes.io/projected/db6a73b9-fcd9-4c35-8a92-46b333b1b879-kube-api-access-4xm75\") pod \"payload-pre-processing-687dbb6cf6-ncqq5\" (UID: \"db6a73b9-fcd9-4c35-8a92-46b333b1b879\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.660427 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.660403    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf06cf76-5156-41c5-b637-e206b34005c0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-wh2dm\" (UID: \"cf06cf76-5156-41c5-b637-e206b34005c0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.660534 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.660515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6a73b9-fcd9-4c35-8a92-46b333b1b879-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ncqq5\" (UID: \"db6a73b9-fcd9-4c35-8a92-46b333b1b879\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.668579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.668544    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xm75\" (UniqueName: \"kubernetes.io/projected/db6a73b9-fcd9-4c35-8a92-46b333b1b879-kube-api-access-4xm75\") pod \"payload-pre-processing-687dbb6cf6-ncqq5\" (UID: \"db6a73b9-fcd9-4c35-8a92-46b333b1b879\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.668731 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.668666    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwzfl\" (UniqueName: \"kubernetes.io/projected/cf06cf76-5156-41c5-b637-e206b34005c0-kube-api-access-xwzfl\") pod \"payload-processing-5cc6cd444b-wh2dm\" (UID: \"cf06cf76-5156-41c5-b637-e206b34005c0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.766842 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.766741    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:11:59.794382 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.794347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:11:59.917673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.917642    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"]
Aug 04 00:11:59.920462 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:11:59.920427    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6a73b9_fcd9_4c35_8a92_46b333b1b879.slice/crio-229d78dfb6e325cd9e13e941c6ecf4e616cba2d95d7c5333cbbe55c51fee17ce WatchSource:0}: Error finding container 229d78dfb6e325cd9e13e941c6ecf4e616cba2d95d7c5333cbbe55c51fee17ce: Status 404 returned error can't find the container with id 229d78dfb6e325cd9e13e941c6ecf4e616cba2d95d7c5333cbbe55c51fee17ce
Aug 04 00:11:59.947398 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:11:59.947373    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-wh2dm"]
Aug 04 00:11:59.949984 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:11:59.949953    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf06cf76_5156_41c5_b637_e206b34005c0.slice/crio-db7050356fa5bfed9d032c7e6a438313ae1c6fc5a8382728f867f479388297be WatchSource:0}: Error finding container db7050356fa5bfed9d032c7e6a438313ae1c6fc5a8382728f867f479388297be: Status 404 returned error can't find the container with id db7050356fa5bfed9d032c7e6a438313ae1c6fc5a8382728f867f479388297be
Aug 04 00:12:00.796964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:00.796871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5" event={"ID":"db6a73b9-fcd9-4c35-8a92-46b333b1b879","Type":"ContainerStarted","Data":"229d78dfb6e325cd9e13e941c6ecf4e616cba2d95d7c5333cbbe55c51fee17ce"}
Aug 04 00:12:00.798883 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:00.798837    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm" event={"ID":"cf06cf76-5156-41c5-b637-e206b34005c0","Type":"ContainerStarted","Data":"db7050356fa5bfed9d032c7e6a438313ae1c6fc5a8382728f867f479388297be"}
Aug 04 00:12:02.811513 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:02.811411    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5" event={"ID":"db6a73b9-fcd9-4c35-8a92-46b333b1b879","Type":"ContainerStarted","Data":"3226c845daeaa3e2e4257668f4b3d74e3c69e8a4eb3a66a3e390d176f1aedc8e"}
Aug 04 00:12:02.811999 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:02.811562    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:12:02.812812 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:02.812787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm" event={"ID":"cf06cf76-5156-41c5-b637-e206b34005c0","Type":"ContainerStarted","Data":"a4622119d9e8bf38c9f3ee6e506912cd2e6ec50cdd01289b0c4b70145938e939"}
Aug 04 00:12:02.812919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:02.812841    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:12:02.842434 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:02.842377    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5" podStartSLOduration=1.300927939 podStartE2EDuration="3.842359493s" totalImagesPullingTime="2.541431554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:12:02.826414722 +0000 UTC m=+596.166450588" watchObservedRunningTime="2026-08-04 00:12:02.842359493 +0000 UTC m=+596.182395358"
Aug 04 00:12:02.842625 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:02.842607    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm" podStartSLOduration=1.339598292 podStartE2EDuration="3.842601438s" totalImagesPullingTime="2.503003146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:12:02.840250849 +0000 UTC m=+596.180286716" watchObservedRunningTime="2026-08-04 00:12:02.842601438 +0000 UTC m=+596.182637302"
Aug 04 00:12:07.117565 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:07.117535    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:12:07.118781 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:07.118757    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:12:07.121760 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:07.121743    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:12:07.123395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:07.123373    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:12:13.819050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:13.819005    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5" podUID="db6a73b9-fcd9-4c35-8a92-46b333b1b879" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.26:9004: connect: connection refused"
Aug 04 00:12:13.819547 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:13.819402    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-wh2dm"
Aug 04 00:12:23.818523 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:23.818491    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ncqq5"
Aug 04 00:12:24.795682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.795645    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"]
Aug 04 00:12:24.801120 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.801093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:24.803851 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.803824    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 04 00:12:24.803851 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.803840    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nc2tq\""
Aug 04 00:12:24.804102 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.803825    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 00:12:24.804774 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.804754    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 00:12:24.810041 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.810012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"]
Aug 04 00:12:24.985137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.985097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:24.985137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.985142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:24.985635 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.985175    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:24.985635 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.985195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2967a26-cc24-48de-b52f-de96b18760a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:24.985635 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.985222    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:24.985635 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:24.985360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-459qp\" (UniqueName: \"kubernetes.io/projected/c2967a26-cc24-48de-b52f-de96b18760a8-kube-api-access-459qp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086113 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-459qp\" (UniqueName: \"kubernetes.io/projected/c2967a26-cc24-48de-b52f-de96b18760a8-kube-api-access-459qp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086113 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086353 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086353 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086353 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2967a26-cc24-48de-b52f-de96b18760a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086550 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086550 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086550 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.086739 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.086643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.088673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.088649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2967a26-cc24-48de-b52f-de96b18760a8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.088867 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.088846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2967a26-cc24-48de-b52f-de96b18760a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.098442 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.098414    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-459qp\" (UniqueName: \"kubernetes.io/projected/c2967a26-cc24-48de-b52f-de96b18760a8-kube-api-access-459qp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z479r\" (UID: \"c2967a26-cc24-48de-b52f-de96b18760a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.114303 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.114262    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:25.254233 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.254208    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"]
Aug 04 00:12:25.256894 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:12:25.256870    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2967a26_cc24_48de_b52f_de96b18760a8.slice/crio-bfd7b6c68319c45473baee69d7b2fbc599f9ceb4c8d2090ace0508d84c5fdc69 WatchSource:0}: Error finding container bfd7b6c68319c45473baee69d7b2fbc599f9ceb4c8d2090ace0508d84c5fdc69: Status 404 returned error can't find the container with id bfd7b6c68319c45473baee69d7b2fbc599f9ceb4c8d2090ace0508d84c5fdc69
Aug 04 00:12:25.914797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:25.914755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r" event={"ID":"c2967a26-cc24-48de-b52f-de96b18760a8","Type":"ContainerStarted","Data":"bfd7b6c68319c45473baee69d7b2fbc599f9ceb4c8d2090ace0508d84c5fdc69"}
Aug 04 00:12:26.920998 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:26.920962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r" event={"ID":"c2967a26-cc24-48de-b52f-de96b18760a8","Type":"ContainerStarted","Data":"26a9c5bb6ec5ffc5f6f74f7a13f2c42af90761f41b6a3aeff58baa2cd2efd7f2"}
Aug 04 00:12:26.937482 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:26.937425    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r" podStartSLOduration=1.868159753 podStartE2EDuration="2.937408105s" totalImagesPullingTime="1.069248352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:12:26.935970704 +0000 UTC m=+620.276006570" watchObservedRunningTime="2026-08-04 00:12:26.937408105 +0000 UTC m=+620.277443970"
Aug 04 00:12:35.114574 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:35.114534    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:35.115042 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:35.114630    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:35.127278 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:35.127250    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:12:35.969928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:12:35.969903    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z479r"
Aug 04 00:15:57.111630 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.111599    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-89565659c-6dzmb"]
Aug 04 00:15:57.114814 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.114793    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.118368 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.118334    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 00:15:57.118368 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.118351    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d6x2w\""
Aug 04 00:15:57.118539 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.118357    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 00:15:57.125278 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.125256    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89565659c-6dzmb"]
Aug 04 00:15:57.200063 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.200033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-webhook-cert\") pod \"maas-controller-89565659c-6dzmb\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") " pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.200232 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.200076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnkq6\" (UniqueName: \"kubernetes.io/projected/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-kube-api-access-lnkq6\") pod \"maas-controller-89565659c-6dzmb\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") " pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.301543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.301500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-webhook-cert\") pod \"maas-controller-89565659c-6dzmb\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") " pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.301749 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.301551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnkq6\" (UniqueName: \"kubernetes.io/projected/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-kube-api-access-lnkq6\") pod \"maas-controller-89565659c-6dzmb\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") " pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.304106 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.304078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-webhook-cert\") pod \"maas-controller-89565659c-6dzmb\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") " pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.309846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.309821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnkq6\" (UniqueName: \"kubernetes.io/projected/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-kube-api-access-lnkq6\") pod \"maas-controller-89565659c-6dzmb\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") " pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.426598 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.426554    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:57.555870 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.555841    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89565659c-6dzmb"]
Aug 04 00:15:57.558353 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:15:57.558308    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef6aa9d_689f_4160_a0c4_29a73afe66cf.slice/crio-097df726a09acebf9f593cb52c6d964aacac10fe064b10bacd9003454a3eebca WatchSource:0}: Error finding container 097df726a09acebf9f593cb52c6d964aacac10fe064b10bacd9003454a3eebca: Status 404 returned error can't find the container with id 097df726a09acebf9f593cb52c6d964aacac10fe064b10bacd9003454a3eebca
Aug 04 00:15:57.559722 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.559686    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:15:57.818867 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:57.818781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89565659c-6dzmb" event={"ID":"3ef6aa9d-689f-4160-a0c4-29a73afe66cf","Type":"ContainerStarted","Data":"097df726a09acebf9f593cb52c6d964aacac10fe064b10bacd9003454a3eebca"}
Aug 04 00:15:59.830073 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:59.830035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89565659c-6dzmb" event={"ID":"3ef6aa9d-689f-4160-a0c4-29a73afe66cf","Type":"ContainerStarted","Data":"93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139"}
Aug 04 00:15:59.830503 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:59.830170    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:15:59.848139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:15:59.848090    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-89565659c-6dzmb" podStartSLOduration=1.407752564 podStartE2EDuration="2.848073677s" totalImagesPullingTime="1.440321113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:15:59.84694512 +0000 UTC m=+833.186980986" watchObservedRunningTime="2026-08-04 00:15:59.848073677 +0000 UTC m=+833.188109541"
Aug 04 00:16:10.837452 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:10.837421    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:16:15.460991 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.460955    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-89565659c-6dzmb"]
Aug 04 00:16:15.461387 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.461171    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-89565659c-6dzmb" podUID="3ef6aa9d-689f-4160-a0c4-29a73afe66cf" containerName="manager" containerID="cri-o://93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139" gracePeriod=30
Aug 04 00:16:15.700787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.700766    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:16:15.760120 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.760042    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnkq6\" (UniqueName: \"kubernetes.io/projected/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-kube-api-access-lnkq6\") pod \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") "
Aug 04 00:16:15.760269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.760161    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-webhook-cert\") pod \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\" (UID: \"3ef6aa9d-689f-4160-a0c4-29a73afe66cf\") "
Aug 04 00:16:15.762272 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.762234    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-kube-api-access-lnkq6" (OuterVolumeSpecName: "kube-api-access-lnkq6") pod "3ef6aa9d-689f-4160-a0c4-29a73afe66cf" (UID: "3ef6aa9d-689f-4160-a0c4-29a73afe66cf"). InnerVolumeSpecName "kube-api-access-lnkq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:15.762272 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.762250    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3ef6aa9d-689f-4160-a0c4-29a73afe66cf" (UID: "3ef6aa9d-689f-4160-a0c4-29a73afe66cf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:16:15.861395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.861358    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-webhook-cert\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:16:15.861395 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.861388    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnkq6\" (UniqueName: \"kubernetes.io/projected/3ef6aa9d-689f-4160-a0c4-29a73afe66cf-kube-api-access-lnkq6\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:16:15.900962 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.900930    2571 generic.go:356] "Generic (PLEG): container finished" podID="3ef6aa9d-689f-4160-a0c4-29a73afe66cf" containerID="93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139" exitCode=0
Aug 04 00:16:15.901087 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.900974    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89565659c-6dzmb"
Aug 04 00:16:15.901087 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.900998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89565659c-6dzmb" event={"ID":"3ef6aa9d-689f-4160-a0c4-29a73afe66cf","Type":"ContainerDied","Data":"93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139"}
Aug 04 00:16:15.901087 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.901038    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89565659c-6dzmb" event={"ID":"3ef6aa9d-689f-4160-a0c4-29a73afe66cf","Type":"ContainerDied","Data":"097df726a09acebf9f593cb52c6d964aacac10fe064b10bacd9003454a3eebca"}
Aug 04 00:16:15.901087 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.901060    2571 scope.go:117] "RemoveContainer" containerID="93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139"
Aug 04 00:16:15.909728 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.909707    2571 scope.go:117] "RemoveContainer" containerID="93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139"
Aug 04 00:16:15.909991 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:16:15.909972    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139\": container with ID starting with 93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139 not found: ID does not exist" containerID="93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139"
Aug 04 00:16:15.910046 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.909999    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139"} err="failed to get container status \"93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139\": rpc error: code = NotFound desc = could not find container \"93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139\": container with ID starting with 93906d47aa338d2abe8d477b680260c1cef1b392fce1c771575a1fce4af2f139 not found: ID does not exist"
Aug 04 00:16:15.921520 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.921492    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-89565659c-6dzmb"]
Aug 04 00:16:15.924949 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:15.924930    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-89565659c-6dzmb"]
Aug 04 00:16:16.679911 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.679879    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-89565659c-sbthq"]
Aug 04 00:16:16.680280 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.680183    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef6aa9d-689f-4160-a0c4-29a73afe66cf" containerName="manager"
Aug 04 00:16:16.680280 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.680193    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef6aa9d-689f-4160-a0c4-29a73afe66cf" containerName="manager"
Aug 04 00:16:16.680280 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.680244    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef6aa9d-689f-4160-a0c4-29a73afe66cf" containerName="manager"
Aug 04 00:16:16.683064 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.683041    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.685700 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.685673    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d6x2w\""
Aug 04 00:16:16.685795 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.685727    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 00:16:16.686541 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.686526    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 00:16:16.693377 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.693359    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89565659c-sbthq"]
Aug 04 00:16:16.770679 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.770645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzdl\" (UniqueName: \"kubernetes.io/projected/33541d06-f2ef-4937-80f5-125f6cca7025-kube-api-access-dtzdl\") pod \"maas-controller-89565659c-sbthq\" (UID: \"33541d06-f2ef-4937-80f5-125f6cca7025\") " pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.770679 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.770678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33541d06-f2ef-4937-80f5-125f6cca7025-webhook-cert\") pod \"maas-controller-89565659c-sbthq\" (UID: \"33541d06-f2ef-4937-80f5-125f6cca7025\") " pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.871511 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.871466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzdl\" (UniqueName: \"kubernetes.io/projected/33541d06-f2ef-4937-80f5-125f6cca7025-kube-api-access-dtzdl\") pod \"maas-controller-89565659c-sbthq\" (UID: \"33541d06-f2ef-4937-80f5-125f6cca7025\") " pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.871511 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.871512    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33541d06-f2ef-4937-80f5-125f6cca7025-webhook-cert\") pod \"maas-controller-89565659c-sbthq\" (UID: \"33541d06-f2ef-4937-80f5-125f6cca7025\") " pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.874093 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.874068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33541d06-f2ef-4937-80f5-125f6cca7025-webhook-cert\") pod \"maas-controller-89565659c-sbthq\" (UID: \"33541d06-f2ef-4937-80f5-125f6cca7025\") " pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.879857 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.879832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzdl\" (UniqueName: \"kubernetes.io/projected/33541d06-f2ef-4937-80f5-125f6cca7025-kube-api-access-dtzdl\") pod \"maas-controller-89565659c-sbthq\" (UID: \"33541d06-f2ef-4937-80f5-125f6cca7025\") " pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:16.992958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:16.992872    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:17.118608 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:17.118574    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89565659c-sbthq"]
Aug 04 00:16:17.120376 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:16:17.120344    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33541d06_f2ef_4937_80f5_125f6cca7025.slice/crio-8b877347755505baa68d4a4a19bc568bdd685d8f2c1f97e61a3ef3ed8e5c7560 WatchSource:0}: Error finding container 8b877347755505baa68d4a4a19bc568bdd685d8f2c1f97e61a3ef3ed8e5c7560: Status 404 returned error can't find the container with id 8b877347755505baa68d4a4a19bc568bdd685d8f2c1f97e61a3ef3ed8e5c7560
Aug 04 00:16:17.146126 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:17.146098    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ef6aa9d-689f-4160-a0c4-29a73afe66cf" path="/var/lib/kubelet/pods/3ef6aa9d-689f-4160-a0c4-29a73afe66cf/volumes"
Aug 04 00:16:17.911548 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:17.911517    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89565659c-sbthq" event={"ID":"33541d06-f2ef-4937-80f5-125f6cca7025","Type":"ContainerStarted","Data":"2e9c0653fb0a7b9d39c19d1ac80884a51a5431309103835fbd58c87b9145c27c"}
Aug 04 00:16:17.912036 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:17.911572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89565659c-sbthq" event={"ID":"33541d06-f2ef-4937-80f5-125f6cca7025","Type":"ContainerStarted","Data":"8b877347755505baa68d4a4a19bc568bdd685d8f2c1f97e61a3ef3ed8e5c7560"}
Aug 04 00:16:17.912036 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:17.911603    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:16:17.928618 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:17.928565    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-89565659c-sbthq" podStartSLOduration=1.463012559 podStartE2EDuration="1.928550564s" totalImagesPullingTime="465.538005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:16:17.927362381 +0000 UTC m=+851.267398267" watchObservedRunningTime="2026-08-04 00:16:17.928550564 +0000 UTC m=+851.268586428"
Aug 04 00:16:28.918288 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:16:28.918257    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-89565659c-sbthq"
Aug 04 00:17:07.146236 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:17:07.146159    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:17:07.146236 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:17:07.146206    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:17:07.150843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:17:07.150823    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:17:07.150983 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:17:07.150968    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:22:07.172627 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:22:07.172601    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:22:07.175125 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:22:07.174054    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:22:07.177101 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:22:07.177080    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:22:07.178246 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:22:07.178228    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:27:07.198223 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:27:07.198109    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:27:07.200394 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:27:07.200370    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:27:07.202372 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:27:07.202342    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:27:07.204587 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:27:07.204569    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:31:30.202749 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.202713    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"]
Aug 04 00:31:30.205812 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.205793    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.208559 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.208540    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:31:30.209311 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.209293    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1c5d1257-serving-cert\""
Aug 04 00:31:30.209414 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.209339    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:31:30.209414 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.209344    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:31:30.216516 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.216494    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"]
Aug 04 00:31:30.250523 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.250490    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8fk2\" (UniqueName: \"kubernetes.io/projected/15e9f064-0861-4f1d-96d3-38d316f9d777-kube-api-access-h8fk2\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.250938 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.250892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e9f064-0861-4f1d-96d3-38d316f9d777-openshift-service-ca\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.251068 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.251003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.351873 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.351842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.352075 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.351933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8fk2\" (UniqueName: \"kubernetes.io/projected/15e9f064-0861-4f1d-96d3-38d316f9d777-kube-api-access-h8fk2\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.352075 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.351969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e9f064-0861-4f1d-96d3-38d316f9d777-openshift-service-ca\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.352075 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:31:30.351987    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-serving-cert: secret "maas-api-e2e-ait-1c5d1257-serving-cert" not found
Aug 04 00:31:30.352075 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:31:30.352061    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls podName:15e9f064-0861-4f1d-96d3-38d316f9d777 nodeName:}" failed. No retries permitted until 2026-08-04 00:31:30.852044358 +0000 UTC m=+1764.192080201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls") pod "maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" (UID: "15e9f064-0861-4f1d-96d3-38d316f9d777") : secret "maas-api-e2e-ait-1c5d1257-serving-cert" not found
Aug 04 00:31:30.352617 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.352594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e9f064-0861-4f1d-96d3-38d316f9d777-openshift-service-ca\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.365205 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.365172    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8fk2\" (UniqueName: \"kubernetes.io/projected/15e9f064-0861-4f1d-96d3-38d316f9d777-kube-api-access-h8fk2\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.856085 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.856055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.858684 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.858659    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls\") pod \"maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:30.903891 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.903857    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"]
Aug 04 00:31:30.907171 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.907153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:30.909800 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.909779    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1c5d1257-dockercfg-mfp9t\""
Aug 04 00:31:30.909897 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.909783    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1c5d1257\""
Aug 04 00:31:30.930440 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.930411    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"]
Aug 04 00:31:30.946554 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.946529    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"]
Aug 04 00:31:30.949609 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.949593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:30.956740 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.956718    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmb2f\" (UniqueName: \"kubernetes.io/projected/0dab6d41-7eea-4955-b967-60a8bfd95823-kube-api-access-hmb2f\") pod \"payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:30.956862 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.956768    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dab6d41-7eea-4955-b967-60a8bfd95823-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:30.985531 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:30.985503    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"]
Aug 04 00:31:31.057896 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.057862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dab6d41-7eea-4955-b967-60a8bfd95823-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:31.057896 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.057902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfbm\" (UniqueName: \"kubernetes.io/projected/79731600-f5e6-457a-a9ec-d2f617d73ed3-kube-api-access-pzfbm\") pod \"payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") " pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.058116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.057924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79731600-f5e6-457a-a9ec-d2f617d73ed3-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") " pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.058116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.058100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmb2f\" (UniqueName: \"kubernetes.io/projected/0dab6d41-7eea-4955-b967-60a8bfd95823-kube-api-access-hmb2f\") pod \"payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:31.058750 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.058734    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dab6d41-7eea-4955-b967-60a8bfd95823-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:31.075165 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.075139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmb2f\" (UniqueName: \"kubernetes.io/projected/0dab6d41-7eea-4955-b967-60a8bfd95823-kube-api-access-hmb2f\") pod \"payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:31.116994 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.116918    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:31.159108 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.159076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfbm\" (UniqueName: \"kubernetes.io/projected/79731600-f5e6-457a-a9ec-d2f617d73ed3-kube-api-access-pzfbm\") pod \"payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") " pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.159269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.159119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79731600-f5e6-457a-a9ec-d2f617d73ed3-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") " pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.160052 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.160028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79731600-f5e6-457a-a9ec-d2f617d73ed3-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") " pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.171912 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.171857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfbm\" (UniqueName: \"kubernetes.io/projected/79731600-f5e6-457a-a9ec-d2f617d73ed3-kube-api-access-pzfbm\") pod \"payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") " pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.218211 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.218095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:31.256098 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.255972    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"]
Aug 04 00:31:31.259312 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:31:31.259005    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e9f064_0861_4f1d_96d3_38d316f9d777.slice/crio-9c0244fb357c15fae9b2f935eca445be343ac1eeec72e3e74cf96f6c13e18420 WatchSource:0}: Error finding container 9c0244fb357c15fae9b2f935eca445be343ac1eeec72e3e74cf96f6c13e18420: Status 404 returned error can't find the container with id 9c0244fb357c15fae9b2f935eca445be343ac1eeec72e3e74cf96f6c13e18420
Aug 04 00:31:31.259312 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.259122    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.263596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.262898    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:31:31.411325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.411300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"]
Aug 04 00:31:31.413852 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:31:31.413819    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79731600_f5e6_457a_a9ec_d2f617d73ed3.slice/crio-4a8075f6ee8ae501f630116bdca7813d658e0354a5c4a02307372936054e2af6 WatchSource:0}: Error finding container 4a8075f6ee8ae501f630116bdca7813d658e0354a5c4a02307372936054e2af6: Status 404 returned error can't find the container with id 4a8075f6ee8ae501f630116bdca7813d658e0354a5c4a02307372936054e2af6
Aug 04 00:31:31.569072 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.569049    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"]
Aug 04 00:31:31.571552 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:31:31.571525    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dab6d41_7eea_4955_b967_60a8bfd95823.slice/crio-0c4eafad6a75f360de51b51ffec3c01f9968bf279935b21311ad5c082d92a9ba WatchSource:0}: Error finding container 0c4eafad6a75f360de51b51ffec3c01f9968bf279935b21311ad5c082d92a9ba: Status 404 returned error can't find the container with id 0c4eafad6a75f360de51b51ffec3c01f9968bf279935b21311ad5c082d92a9ba
Aug 04 00:31:31.843793 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.843685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86" event={"ID":"79731600-f5e6-457a-a9ec-d2f617d73ed3","Type":"ContainerStarted","Data":"222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b"}
Aug 04 00:31:31.844069 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.844045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86" event={"ID":"79731600-f5e6-457a-a9ec-d2f617d73ed3","Type":"ContainerStarted","Data":"4a8075f6ee8ae501f630116bdca7813d658e0354a5c4a02307372936054e2af6"}
Aug 04 00:31:31.844206 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.844192    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:31:31.845739 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.845711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z" event={"ID":"0dab6d41-7eea-4955-b967-60a8bfd95823","Type":"ContainerStarted","Data":"c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81"}
Aug 04 00:31:31.845852 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.845766    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:31.845852 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.845789    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z" event={"ID":"0dab6d41-7eea-4955-b967-60a8bfd95823","Type":"ContainerStarted","Data":"0c4eafad6a75f360de51b51ffec3c01f9968bf279935b21311ad5c082d92a9ba"}
Aug 04 00:31:31.847183 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.847159    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" event={"ID":"15e9f064-0861-4f1d-96d3-38d316f9d777","Type":"ContainerStarted","Data":"9c0244fb357c15fae9b2f935eca445be343ac1eeec72e3e74cf96f6c13e18420"}
Aug 04 00:31:31.861695 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.861646    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86" podStartSLOduration=1.8616284109999999 podStartE2EDuration="1.861628411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:31:31.860346365 +0000 UTC m=+1765.200382231" watchObservedRunningTime="2026-08-04 00:31:31.861628411 +0000 UTC m=+1765.201664277"
Aug 04 00:31:31.877695 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:31.877648    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z" podStartSLOduration=1.8776308720000001 podStartE2EDuration="1.877630872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:31:31.875654634 +0000 UTC m=+1765.215690503" watchObservedRunningTime="2026-08-04 00:31:31.877630872 +0000 UTC m=+1765.217666751"
Aug 04 00:31:33.861365 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:33.861275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" event={"ID":"15e9f064-0861-4f1d-96d3-38d316f9d777","Type":"ContainerStarted","Data":"861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2"}
Aug 04 00:31:33.861365 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:33.861355    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:33.877382 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:33.877335    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" podStartSLOduration=1.540439018 podStartE2EDuration="3.877320149s" totalImagesPullingTime="2.336881131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:31:33.876998071 +0000 UTC m=+1767.217033937" watchObservedRunningTime="2026-08-04 00:31:33.877320149 +0000 UTC m=+1767.217356013"
Aug 04 00:31:39.871475 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:39.871446    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:31:42.855612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:42.855577    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:31:42.856024 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:31:42.855752    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:32:00.886818 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:00.886537    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"]
Aug 04 00:32:00.887299 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:00.886828    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" podUID="15e9f064-0861-4f1d-96d3-38d316f9d777" containerName="maas-api" containerID="cri-o://861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2" gracePeriod=30
Aug 04 00:32:00.962773 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:00.962743    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"]
Aug 04 00:32:00.962966 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:00.962941    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86" podUID="79731600-f5e6-457a-a9ec-d2f617d73ed3" containerName="payload-processing" containerID="cri-o://222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b" gracePeriod=30
Aug 04 00:32:00.974994 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:00.974968    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"]
Aug 04 00:32:00.975285 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:00.975215    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z" podUID="0dab6d41-7eea-4955-b967-60a8bfd95823" containerName="payload-pre-processing" containerID="cri-o://c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81" gracePeriod=30
Aug 04 00:32:01.251095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.251067    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:32:01.253987 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.253962    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:32:01.275573 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.275541    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:32:01.334617 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.334587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8fk2\" (UniqueName: \"kubernetes.io/projected/15e9f064-0861-4f1d-96d3-38d316f9d777-kube-api-access-h8fk2\") pod \"15e9f064-0861-4f1d-96d3-38d316f9d777\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") "
Aug 04 00:32:01.334617 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.334628    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dab6d41-7eea-4955-b967-60a8bfd95823-plugins-config-volume\") pod \"0dab6d41-7eea-4955-b967-60a8bfd95823\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") "
Aug 04 00:32:01.334879 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.334665    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzfbm\" (UniqueName: \"kubernetes.io/projected/79731600-f5e6-457a-a9ec-d2f617d73ed3-kube-api-access-pzfbm\") pod \"79731600-f5e6-457a-a9ec-d2f617d73ed3\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") "
Aug 04 00:32:01.334879 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.334714    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e9f064-0861-4f1d-96d3-38d316f9d777-openshift-service-ca\") pod \"15e9f064-0861-4f1d-96d3-38d316f9d777\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") "
Aug 04 00:32:01.335161 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335126    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dab6d41-7eea-4955-b967-60a8bfd95823-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dab6d41-7eea-4955-b967-60a8bfd95823" (UID: "0dab6d41-7eea-4955-b967-60a8bfd95823"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:01.335445 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335137    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79731600-f5e6-457a-a9ec-d2f617d73ed3-plugins-config-volume\") pod \"79731600-f5e6-457a-a9ec-d2f617d73ed3\" (UID: \"79731600-f5e6-457a-a9ec-d2f617d73ed3\") "
Aug 04 00:32:01.335546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335456    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79731600-f5e6-457a-a9ec-d2f617d73ed3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79731600-f5e6-457a-a9ec-d2f617d73ed3" (UID: "79731600-f5e6-457a-a9ec-d2f617d73ed3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:01.335546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335330    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e9f064-0861-4f1d-96d3-38d316f9d777-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15e9f064-0861-4f1d-96d3-38d316f9d777" (UID: "15e9f064-0861-4f1d-96d3-38d316f9d777"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:01.335546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335523    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls\") pod \"15e9f064-0861-4f1d-96d3-38d316f9d777\" (UID: \"15e9f064-0861-4f1d-96d3-38d316f9d777\") "
Aug 04 00:32:01.335756 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335552    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmb2f\" (UniqueName: \"kubernetes.io/projected/0dab6d41-7eea-4955-b967-60a8bfd95823-kube-api-access-hmb2f\") pod \"0dab6d41-7eea-4955-b967-60a8bfd95823\" (UID: \"0dab6d41-7eea-4955-b967-60a8bfd95823\") "
Aug 04 00:32:01.335841 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335823    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e9f064-0861-4f1d-96d3-38d316f9d777-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.335983 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.335967    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79731600-f5e6-457a-a9ec-d2f617d73ed3-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.338096 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.338018    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e9f064-0861-4f1d-96d3-38d316f9d777-kube-api-access-h8fk2" (OuterVolumeSpecName: "kube-api-access-h8fk2") pod "15e9f064-0861-4f1d-96d3-38d316f9d777" (UID: "15e9f064-0861-4f1d-96d3-38d316f9d777"). InnerVolumeSpecName "kube-api-access-h8fk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:01.339259 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.339236    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79731600-f5e6-457a-a9ec-d2f617d73ed3-kube-api-access-pzfbm" (OuterVolumeSpecName: "kube-api-access-pzfbm") pod "79731600-f5e6-457a-a9ec-d2f617d73ed3" (UID: "79731600-f5e6-457a-a9ec-d2f617d73ed3"). InnerVolumeSpecName "kube-api-access-pzfbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:01.339342 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.339318    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15e9f064-0861-4f1d-96d3-38d316f9d777" (UID: "15e9f064-0861-4f1d-96d3-38d316f9d777"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:32:01.340959 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.340927    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dab6d41-7eea-4955-b967-60a8bfd95823-kube-api-access-hmb2f" (OuterVolumeSpecName: "kube-api-access-hmb2f") pod "0dab6d41-7eea-4955-b967-60a8bfd95823" (UID: "0dab6d41-7eea-4955-b967-60a8bfd95823"). InnerVolumeSpecName "kube-api-access-hmb2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:01.436922 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.436841    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e9f064-0861-4f1d-96d3-38d316f9d777-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.436922 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.436873    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmb2f\" (UniqueName: \"kubernetes.io/projected/0dab6d41-7eea-4955-b967-60a8bfd95823-kube-api-access-hmb2f\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.436922 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.436883    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8fk2\" (UniqueName: \"kubernetes.io/projected/15e9f064-0861-4f1d-96d3-38d316f9d777-kube-api-access-h8fk2\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.436922 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.436891    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dab6d41-7eea-4955-b967-60a8bfd95823-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.436922 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.436900    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzfbm\" (UniqueName: \"kubernetes.io/projected/79731600-f5e6-457a-a9ec-d2f617d73ed3-kube-api-access-pzfbm\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:01.987121 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.987086    2571 generic.go:356] "Generic (PLEG): container finished" podID="79731600-f5e6-457a-a9ec-d2f617d73ed3" containerID="222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b" exitCode=0
Aug 04 00:32:01.987552 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.987125    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"
Aug 04 00:32:01.987552 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.987175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86" event={"ID":"79731600-f5e6-457a-a9ec-d2f617d73ed3","Type":"ContainerDied","Data":"222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b"}
Aug 04 00:32:01.987552 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.987229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86" event={"ID":"79731600-f5e6-457a-a9ec-d2f617d73ed3","Type":"ContainerDied","Data":"4a8075f6ee8ae501f630116bdca7813d658e0354a5c4a02307372936054e2af6"}
Aug 04 00:32:01.987552 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.987258    2571 scope.go:117] "RemoveContainer" containerID="222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b"
Aug 04 00:32:01.988546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.988496    2571 generic.go:356] "Generic (PLEG): container finished" podID="0dab6d41-7eea-4955-b967-60a8bfd95823" containerID="c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81" exitCode=0
Aug 04 00:32:01.988546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.988531    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"
Aug 04 00:32:01.988634 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.988552    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z" event={"ID":"0dab6d41-7eea-4955-b967-60a8bfd95823","Type":"ContainerDied","Data":"c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81"}
Aug 04 00:32:01.988634 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.988614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z" event={"ID":"0dab6d41-7eea-4955-b967-60a8bfd95823","Type":"ContainerDied","Data":"0c4eafad6a75f360de51b51ffec3c01f9968bf279935b21311ad5c082d92a9ba"}
Aug 04 00:32:01.993624 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.990802    2571 generic.go:356] "Generic (PLEG): container finished" podID="15e9f064-0861-4f1d-96d3-38d316f9d777" containerID="861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2" exitCode=0
Aug 04 00:32:01.993624 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.990864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" event={"ID":"15e9f064-0861-4f1d-96d3-38d316f9d777","Type":"ContainerDied","Data":"861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2"}
Aug 04 00:32:01.993624 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.990952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v" event={"ID":"15e9f064-0861-4f1d-96d3-38d316f9d777","Type":"ContainerDied","Data":"9c0244fb357c15fae9b2f935eca445be343ac1eeec72e3e74cf96f6c13e18420"}
Aug 04 00:32:01.993624 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:01.991322    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"
Aug 04 00:32:02.004152 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.003653    2571 scope.go:117] "RemoveContainer" containerID="222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b"
Aug 04 00:32:02.004152 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:32:02.004118    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b\": container with ID starting with 222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b not found: ID does not exist" containerID="222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b"
Aug 04 00:32:02.004294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.004148    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b"} err="failed to get container status \"222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b\": rpc error: code = NotFound desc = could not find container \"222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b\": container with ID starting with 222ac264982ae059b1468b754614ff47cff1735cece249d9fdf71888e8517d9b not found: ID does not exist"
Aug 04 00:32:02.004294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.004172    2571 scope.go:117] "RemoveContainer" containerID="c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81"
Aug 04 00:32:02.012492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.012475    2571 scope.go:117] "RemoveContainer" containerID="c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81"
Aug 04 00:32:02.012795 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:32:02.012768    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81\": container with ID starting with c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81 not found: ID does not exist" containerID="c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81"
Aug 04 00:32:02.012887 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.012804    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81"} err="failed to get container status \"c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81\": rpc error: code = NotFound desc = could not find container \"c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81\": container with ID starting with c1ad65b70514c85f22d46f20fda7210c7f9e0b9e85f6b143a9418d48afdf0a81 not found: ID does not exist"
Aug 04 00:32:02.012887 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.012827    2571 scope.go:117] "RemoveContainer" containerID="861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2"
Aug 04 00:32:02.020673 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.020550    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"]
Aug 04 00:32:02.020772 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.020744    2571 scope.go:117] "RemoveContainer" containerID="861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2"
Aug 04 00:32:02.021056 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:32:02.021037    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2\": container with ID starting with 861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2 not found: ID does not exist" containerID="861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2"
Aug 04 00:32:02.021096 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.021064    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2"} err="failed to get container status \"861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2\": rpc error: code = NotFound desc = could not find container \"861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2\": container with ID starting with 861746bcc03dedb0085acac4526e564c4cbad0f3a4b6e2f92fd70658319baff2 not found: ID does not exist"
Aug 04 00:32:02.026125 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.026103    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c5d1257-5b8f856db8-qf96z"]
Aug 04 00:32:02.039139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.039111    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"]
Aug 04 00:32:02.044982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.044957    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c5d1257-786d4b967b-qgx86"]
Aug 04 00:32:02.055500 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.055478    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"]
Aug 04 00:32:02.062252 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:02.062227    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1c5d1257-dc4dc97c6-b6h7v"]
Aug 04 00:32:03.145596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:03.145560    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dab6d41-7eea-4955-b967-60a8bfd95823" path="/var/lib/kubelet/pods/0dab6d41-7eea-4955-b967-60a8bfd95823/volumes"
Aug 04 00:32:03.145996 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:03.145963    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e9f064-0861-4f1d-96d3-38d316f9d777" path="/var/lib/kubelet/pods/15e9f064-0861-4f1d-96d3-38d316f9d777/volumes"
Aug 04 00:32:03.146283 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:03.146269    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79731600-f5e6-457a-a9ec-d2f617d73ed3" path="/var/lib/kubelet/pods/79731600-f5e6-457a-a9ec-d2f617d73ed3/volumes"
Aug 04 00:32:04.504117 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504082    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"]
Aug 04 00:32:04.504505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504416    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e9f064-0861-4f1d-96d3-38d316f9d777" containerName="maas-api"
Aug 04 00:32:04.504505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504427    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e9f064-0861-4f1d-96d3-38d316f9d777" containerName="maas-api"
Aug 04 00:32:04.504505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504444    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79731600-f5e6-457a-a9ec-d2f617d73ed3" containerName="payload-processing"
Aug 04 00:32:04.504505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504450    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="79731600-f5e6-457a-a9ec-d2f617d73ed3" containerName="payload-processing"
Aug 04 00:32:04.504505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504459    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dab6d41-7eea-4955-b967-60a8bfd95823" containerName="payload-pre-processing"
Aug 04 00:32:04.504505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504467    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dab6d41-7eea-4955-b967-60a8bfd95823" containerName="payload-pre-processing"
Aug 04 00:32:04.504728 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504526    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dab6d41-7eea-4955-b967-60a8bfd95823" containerName="payload-pre-processing"
Aug 04 00:32:04.504728 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504535    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e9f064-0861-4f1d-96d3-38d316f9d777" containerName="maas-api"
Aug 04 00:32:04.504728 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.504545    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="79731600-f5e6-457a-a9ec-d2f617d73ed3" containerName="payload-processing"
Aug 04 00:32:04.509312 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.509289    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.511670 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.511647    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-41f75963-serving-cert\""
Aug 04 00:32:04.511670 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.511663    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:32:04.511991 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.511975    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:32:04.512747 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.512734    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:32:04.519119 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.519038    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"]
Aug 04 00:32:04.561843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.561812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75663d26-20b8-4d91-b1c3-1e79b3698fc8-openshift-service-ca\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.562065 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.561847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfqn\" (UniqueName: \"kubernetes.io/projected/75663d26-20b8-4d91-b1c3-1e79b3698fc8-kube-api-access-rxfqn\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.562065 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.561890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.663178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.663144    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75663d26-20b8-4d91-b1c3-1e79b3698fc8-openshift-service-ca\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.663178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.663177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfqn\" (UniqueName: \"kubernetes.io/projected/75663d26-20b8-4d91-b1c3-1e79b3698fc8-kube-api-access-rxfqn\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.663426 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.663206    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.663426 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:32:04.663334    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-serving-cert: secret "maas-api-e2e-migrate-41f75963-serving-cert" not found
Aug 04 00:32:04.663527 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:32:04.663451    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls podName:75663d26-20b8-4d91-b1c3-1e79b3698fc8 nodeName:}" failed. No retries permitted until 2026-08-04 00:32:05.163375063 +0000 UTC m=+1798.503410912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls") pod "maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" (UID: "75663d26-20b8-4d91-b1c3-1e79b3698fc8") : secret "maas-api-e2e-migrate-41f75963-serving-cert" not found
Aug 04 00:32:04.663878 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.663860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75663d26-20b8-4d91-b1c3-1e79b3698fc8-openshift-service-ca\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:04.676727 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:04.676681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfqn\" (UniqueName: \"kubernetes.io/projected/75663d26-20b8-4d91-b1c3-1e79b3698fc8-kube-api-access-rxfqn\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:05.131779 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.131744    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"]
Aug 04 00:32:05.135248 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.135225    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.137663 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.137641    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-41f75963\""
Aug 04 00:32:05.145825 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.145800    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"]
Aug 04 00:32:05.167334 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.167303    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df098684-bd68-4790-bee9-5e4da70a0ba8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.167497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.167375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:05.167497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.167445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsc8q\" (UniqueName: \"kubernetes.io/projected/df098684-bd68-4790-bee9-5e4da70a0ba8-kube-api-access-vsc8q\") pod \"payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.169761 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.169738    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls\") pod \"maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:05.185631 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.185609    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"]
Aug 04 00:32:05.188998 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.188981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.191473 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.191457    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-41f75963-dockercfg-prrs9\""
Aug 04 00:32:05.200254 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.200230    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"]
Aug 04 00:32:05.268130 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.268099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df098684-bd68-4790-bee9-5e4da70a0ba8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.268281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.268150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsc8q\" (UniqueName: \"kubernetes.io/projected/df098684-bd68-4790-bee9-5e4da70a0ba8-kube-api-access-vsc8q\") pod \"payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.268281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.268248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d613caf-d214-4246-a01c-471be96d2aa0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") " pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.268393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.268311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jq7\" (UniqueName: \"kubernetes.io/projected/3d613caf-d214-4246-a01c-471be96d2aa0-kube-api-access-h4jq7\") pod \"payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") " pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.268980 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.268961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df098684-bd68-4790-bee9-5e4da70a0ba8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.281177 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.281140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsc8q\" (UniqueName: \"kubernetes.io/projected/df098684-bd68-4790-bee9-5e4da70a0ba8-kube-api-access-vsc8q\") pod \"payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.369111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.369077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d613caf-d214-4246-a01c-471be96d2aa0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") " pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.369319 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.369134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jq7\" (UniqueName: \"kubernetes.io/projected/3d613caf-d214-4246-a01c-471be96d2aa0-kube-api-access-h4jq7\") pod \"payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") " pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.369829 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.369809    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d613caf-d214-4246-a01c-471be96d2aa0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") " pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.377123 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.377101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jq7\" (UniqueName: \"kubernetes.io/projected/3d613caf-d214-4246-a01c-471be96d2aa0-kube-api-access-h4jq7\") pod \"payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") " pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.420481 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.420450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:05.446988 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.446880    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:05.499498 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.499462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:05.594671 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.594581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"]
Aug 04 00:32:05.597406 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:32:05.597371    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75663d26_20b8_4d91_b1c3_1e79b3698fc8.slice/crio-82b20c0e86ceeb4dbaa32200c6c4c85f23aed00a73b94157b05c93d1702c2918 WatchSource:0}: Error finding container 82b20c0e86ceeb4dbaa32200c6c4c85f23aed00a73b94157b05c93d1702c2918: Status 404 returned error can't find the container with id 82b20c0e86ceeb4dbaa32200c6c4c85f23aed00a73b94157b05c93d1702c2918
Aug 04 00:32:05.619398 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.618610    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"]
Aug 04 00:32:05.621389 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:32:05.621356    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf098684_bd68_4790_bee9_5e4da70a0ba8.slice/crio-768de73487702f0c9fbaee584dc6fa4fe5f02f09155feb3a49734a077dc6de55 WatchSource:0}: Error finding container 768de73487702f0c9fbaee584dc6fa4fe5f02f09155feb3a49734a077dc6de55: Status 404 returned error can't find the container with id 768de73487702f0c9fbaee584dc6fa4fe5f02f09155feb3a49734a077dc6de55
Aug 04 00:32:05.669261 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:05.669240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"]
Aug 04 00:32:05.672644 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:32:05.672614    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d613caf_d214_4246_a01c_471be96d2aa0.slice/crio-e922a051e9de6bca21df4147fe4c65ec614683f7bc5ba7a8292720d579e28e33 WatchSource:0}: Error finding container e922a051e9de6bca21df4147fe4c65ec614683f7bc5ba7a8292720d579e28e33: Status 404 returned error can't find the container with id e922a051e9de6bca21df4147fe4c65ec614683f7bc5ba7a8292720d579e28e33
Aug 04 00:32:06.015965 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.015933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg" event={"ID":"3d613caf-d214-4246-a01c-471be96d2aa0","Type":"ContainerStarted","Data":"2b0dc22140a8af7a53497161ef1e3c03147833f3190f07a68abaa05906f511d4"}
Aug 04 00:32:06.016114 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.015998    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:06.016114 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.016026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg" event={"ID":"3d613caf-d214-4246-a01c-471be96d2aa0","Type":"ContainerStarted","Data":"e922a051e9de6bca21df4147fe4c65ec614683f7bc5ba7a8292720d579e28e33"}
Aug 04 00:32:06.017141 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.017115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" event={"ID":"75663d26-20b8-4d91-b1c3-1e79b3698fc8","Type":"ContainerStarted","Data":"82b20c0e86ceeb4dbaa32200c6c4c85f23aed00a73b94157b05c93d1702c2918"}
Aug 04 00:32:06.018317 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.018290    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb" event={"ID":"df098684-bd68-4790-bee9-5e4da70a0ba8","Type":"ContainerStarted","Data":"fdac4d4e5726a26d813c6a6e022bdb667866a0aa47d4451c3de3ddb5476c321c"}
Aug 04 00:32:06.018400 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.018332    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb" event={"ID":"df098684-bd68-4790-bee9-5e4da70a0ba8","Type":"ContainerStarted","Data":"768de73487702f0c9fbaee584dc6fa4fe5f02f09155feb3a49734a077dc6de55"}
Aug 04 00:32:06.018463 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.018421    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:06.034122 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.034041    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg" podStartSLOduration=1.03402196 podStartE2EDuration="1.03402196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:06.031403511 +0000 UTC m=+1799.371439376" watchObservedRunningTime="2026-08-04 00:32:06.03402196 +0000 UTC m=+1799.374057831"
Aug 04 00:32:06.047487 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:06.047434    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb" podStartSLOduration=1.047422821 podStartE2EDuration="1.047422821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:06.046216535 +0000 UTC m=+1799.386252400" watchObservedRunningTime="2026-08-04 00:32:06.047422821 +0000 UTC m=+1799.387458685"
Aug 04 00:32:07.024773 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.024735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" event={"ID":"75663d26-20b8-4d91-b1c3-1e79b3698fc8","Type":"ContainerStarted","Data":"fc9b4de323dfaed9a8b1e3e588daf9c6acd226b1a9e8050448440be458ff23fb"}
Aug 04 00:32:07.025289 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.024969    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:07.043069 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.043012    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" podStartSLOduration=2.682722197 podStartE2EDuration="3.04299187s" totalImagesPullingTime="360.269673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:07.040962764 +0000 UTC m=+1800.380998630" watchObservedRunningTime="2026-08-04 00:32:07.04299187 +0000 UTC m=+1800.383027736"
Aug 04 00:32:07.224686 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.224581    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:32:07.226811 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.226786    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:32:07.229002 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.228986    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:32:07.231285 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:07.231261    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:32:13.034220 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:13.034193    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:17.027597 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:17.027567    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:17.028041 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:17.027638    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:35.953382 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:35.953349    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"]
Aug 04 00:32:35.953919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:35.953555    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" podUID="75663d26-20b8-4d91-b1c3-1e79b3698fc8" containerName="maas-api" containerID="cri-o://fc9b4de323dfaed9a8b1e3e588daf9c6acd226b1a9e8050448440be458ff23fb" gracePeriod=30
Aug 04 00:32:36.010118 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.010088    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"]
Aug 04 00:32:36.010369 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.010345    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg" podUID="3d613caf-d214-4246-a01c-471be96d2aa0" containerName="payload-processing" containerID="cri-o://2b0dc22140a8af7a53497161ef1e3c03147833f3190f07a68abaa05906f511d4" gracePeriod=30
Aug 04 00:32:36.017616 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.017592    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"]
Aug 04 00:32:36.017829 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.017807    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb" podUID="df098684-bd68-4790-bee9-5e4da70a0ba8" containerName="payload-pre-processing" containerID="cri-o://fdac4d4e5726a26d813c6a6e022bdb667866a0aa47d4451c3de3ddb5476c321c" gracePeriod=30
Aug 04 00:32:36.161265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.160815    2571 generic.go:356] "Generic (PLEG): container finished" podID="75663d26-20b8-4d91-b1c3-1e79b3698fc8" containerID="fc9b4de323dfaed9a8b1e3e588daf9c6acd226b1a9e8050448440be458ff23fb" exitCode=0
Aug 04 00:32:36.161265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.161228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" event={"ID":"75663d26-20b8-4d91-b1c3-1e79b3698fc8","Type":"ContainerDied","Data":"fc9b4de323dfaed9a8b1e3e588daf9c6acd226b1a9e8050448440be458ff23fb"}
Aug 04 00:32:36.164919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.163972    2571 generic.go:356] "Generic (PLEG): container finished" podID="df098684-bd68-4790-bee9-5e4da70a0ba8" containerID="fdac4d4e5726a26d813c6a6e022bdb667866a0aa47d4451c3de3ddb5476c321c" exitCode=0
Aug 04 00:32:36.164919 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.164223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb" event={"ID":"df098684-bd68-4790-bee9-5e4da70a0ba8","Type":"ContainerDied","Data":"fdac4d4e5726a26d813c6a6e022bdb667866a0aa47d4451c3de3ddb5476c321c"}
Aug 04 00:32:36.167301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.167145    2571 generic.go:356] "Generic (PLEG): container finished" podID="3d613caf-d214-4246-a01c-471be96d2aa0" containerID="2b0dc22140a8af7a53497161ef1e3c03147833f3190f07a68abaa05906f511d4" exitCode=0
Aug 04 00:32:36.167301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.167245    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg" event={"ID":"3d613caf-d214-4246-a01c-471be96d2aa0","Type":"ContainerDied","Data":"2b0dc22140a8af7a53497161ef1e3c03147833f3190f07a68abaa05906f511d4"}
Aug 04 00:32:36.311140 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.311108    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:36.325007 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.324985    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:36.340082 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.340058    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:36.362991 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.362958    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d613caf-d214-4246-a01c-471be96d2aa0-plugins-config-volume\") pod \"3d613caf-d214-4246-a01c-471be96d2aa0\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") "
Aug 04 00:32:36.363139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.363043    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsc8q\" (UniqueName: \"kubernetes.io/projected/df098684-bd68-4790-bee9-5e4da70a0ba8-kube-api-access-vsc8q\") pod \"df098684-bd68-4790-bee9-5e4da70a0ba8\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") "
Aug 04 00:32:36.363139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.363095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4jq7\" (UniqueName: \"kubernetes.io/projected/3d613caf-d214-4246-a01c-471be96d2aa0-kube-api-access-h4jq7\") pod \"3d613caf-d214-4246-a01c-471be96d2aa0\" (UID: \"3d613caf-d214-4246-a01c-471be96d2aa0\") "
Aug 04 00:32:36.363290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.363217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df098684-bd68-4790-bee9-5e4da70a0ba8-plugins-config-volume\") pod \"df098684-bd68-4790-bee9-5e4da70a0ba8\" (UID: \"df098684-bd68-4790-bee9-5e4da70a0ba8\") "
Aug 04 00:32:36.363290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.363276    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls\") pod \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") "
Aug 04 00:32:36.363408 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.363382    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75663d26-20b8-4d91-b1c3-1e79b3698fc8-openshift-service-ca\") pod \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") "
Aug 04 00:32:36.363482 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.363428    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxfqn\" (UniqueName: \"kubernetes.io/projected/75663d26-20b8-4d91-b1c3-1e79b3698fc8-kube-api-access-rxfqn\") pod \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\" (UID: \"75663d26-20b8-4d91-b1c3-1e79b3698fc8\") "
Aug 04 00:32:36.364102 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.364074    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d613caf-d214-4246-a01c-471be96d2aa0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d613caf-d214-4246-a01c-471be96d2aa0" (UID: "3d613caf-d214-4246-a01c-471be96d2aa0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:36.364213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.364153    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df098684-bd68-4790-bee9-5e4da70a0ba8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df098684-bd68-4790-bee9-5e4da70a0ba8" (UID: "df098684-bd68-4790-bee9-5e4da70a0ba8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:36.364559 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.364521    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75663d26-20b8-4d91-b1c3-1e79b3698fc8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75663d26-20b8-4d91-b1c3-1e79b3698fc8" (UID: "75663d26-20b8-4d91-b1c3-1e79b3698fc8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:36.366265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.366239    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d613caf-d214-4246-a01c-471be96d2aa0-kube-api-access-h4jq7" (OuterVolumeSpecName: "kube-api-access-h4jq7") pod "3d613caf-d214-4246-a01c-471be96d2aa0" (UID: "3d613caf-d214-4246-a01c-471be96d2aa0"). InnerVolumeSpecName "kube-api-access-h4jq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:36.366493 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.366471    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df098684-bd68-4790-bee9-5e4da70a0ba8-kube-api-access-vsc8q" (OuterVolumeSpecName: "kube-api-access-vsc8q") pod "df098684-bd68-4790-bee9-5e4da70a0ba8" (UID: "df098684-bd68-4790-bee9-5e4da70a0ba8"). InnerVolumeSpecName "kube-api-access-vsc8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:36.366563 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.366539    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75663d26-20b8-4d91-b1c3-1e79b3698fc8-kube-api-access-rxfqn" (OuterVolumeSpecName: "kube-api-access-rxfqn") pod "75663d26-20b8-4d91-b1c3-1e79b3698fc8" (UID: "75663d26-20b8-4d91-b1c3-1e79b3698fc8"). InnerVolumeSpecName "kube-api-access-rxfqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:36.366960 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.366940    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75663d26-20b8-4d91-b1c3-1e79b3698fc8" (UID: "75663d26-20b8-4d91-b1c3-1e79b3698fc8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:32:36.464438 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464414    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d613caf-d214-4246-a01c-471be96d2aa0-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:36.464438 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464436    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsc8q\" (UniqueName: \"kubernetes.io/projected/df098684-bd68-4790-bee9-5e4da70a0ba8-kube-api-access-vsc8q\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:36.464579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464445    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4jq7\" (UniqueName: \"kubernetes.io/projected/3d613caf-d214-4246-a01c-471be96d2aa0-kube-api-access-h4jq7\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:36.464579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464454    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df098684-bd68-4790-bee9-5e4da70a0ba8-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:36.464579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464464    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75663d26-20b8-4d91-b1c3-1e79b3698fc8-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:36.464579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464472    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75663d26-20b8-4d91-b1c3-1e79b3698fc8-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:36.464579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:36.464480    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxfqn\" (UniqueName: \"kubernetes.io/projected/75663d26-20b8-4d91-b1c3-1e79b3698fc8-kube-api-access-rxfqn\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:32:37.172604 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.172567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb" event={"ID":"df098684-bd68-4790-bee9-5e4da70a0ba8","Type":"ContainerDied","Data":"768de73487702f0c9fbaee584dc6fa4fe5f02f09155feb3a49734a077dc6de55"}
Aug 04 00:32:37.172604 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.172595    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"
Aug 04 00:32:37.173064 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.172628    2571 scope.go:117] "RemoveContainer" containerID="fdac4d4e5726a26d813c6a6e022bdb667866a0aa47d4451c3de3ddb5476c321c"
Aug 04 00:32:37.174761 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.174736    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"
Aug 04 00:32:37.174871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.174740    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg" event={"ID":"3d613caf-d214-4246-a01c-471be96d2aa0","Type":"ContainerDied","Data":"e922a051e9de6bca21df4147fe4c65ec614683f7bc5ba7a8292720d579e28e33"}
Aug 04 00:32:37.176311 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.176287    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk" event={"ID":"75663d26-20b8-4d91-b1c3-1e79b3698fc8","Type":"ContainerDied","Data":"82b20c0e86ceeb4dbaa32200c6c4c85f23aed00a73b94157b05c93d1702c2918"}
Aug 04 00:32:37.176400 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.176370    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"
Aug 04 00:32:37.182960 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.182944    2571 scope.go:117] "RemoveContainer" containerID="2b0dc22140a8af7a53497161ef1e3c03147833f3190f07a68abaa05906f511d4"
Aug 04 00:32:37.191361 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.191342    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"]
Aug 04 00:32:37.192410 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.192395    2571 scope.go:117] "RemoveContainer" containerID="fc9b4de323dfaed9a8b1e3e588daf9c6acd226b1a9e8050448440be458ff23fb"
Aug 04 00:32:37.197812 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.197792    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f75963-8569898fb8-wk5rb"]
Aug 04 00:32:37.207269 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.207248    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"]
Aug 04 00:32:37.213109 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.213090    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-41f75963-84d8bfb497-gkhkg"]
Aug 04 00:32:37.222577 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.222527    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"]
Aug 04 00:32:37.226182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:37.226163    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-41f75963-59d66cd544-hn5wk"]
Aug 04 00:32:39.145519 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:39.145485    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d613caf-d214-4246-a01c-471be96d2aa0" path="/var/lib/kubelet/pods/3d613caf-d214-4246-a01c-471be96d2aa0/volumes"
Aug 04 00:32:39.145973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:39.145884    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75663d26-20b8-4d91-b1c3-1e79b3698fc8" path="/var/lib/kubelet/pods/75663d26-20b8-4d91-b1c3-1e79b3698fc8/volumes"
Aug 04 00:32:39.146190 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:39.146178    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df098684-bd68-4790-bee9-5e4da70a0ba8" path="/var/lib/kubelet/pods/df098684-bd68-4790-bee9-5e4da70a0ba8/volumes"
Aug 04 00:32:40.493170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493136    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"]
Aug 04 00:32:40.493634 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493615    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d613caf-d214-4246-a01c-471be96d2aa0" containerName="payload-processing"
Aug 04 00:32:40.493712 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493639    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d613caf-d214-4246-a01c-471be96d2aa0" containerName="payload-processing"
Aug 04 00:32:40.493712 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493655    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df098684-bd68-4790-bee9-5e4da70a0ba8" containerName="payload-pre-processing"
Aug 04 00:32:40.493712 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493665    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="df098684-bd68-4790-bee9-5e4da70a0ba8" containerName="payload-pre-processing"
Aug 04 00:32:40.493712 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493675    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75663d26-20b8-4d91-b1c3-1e79b3698fc8" containerName="maas-api"
Aug 04 00:32:40.493853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493684    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="75663d26-20b8-4d91-b1c3-1e79b3698fc8" containerName="maas-api"
Aug 04 00:32:40.493853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493816    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="df098684-bd68-4790-bee9-5e4da70a0ba8" containerName="payload-pre-processing"
Aug 04 00:32:40.493853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493829    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d613caf-d214-4246-a01c-471be96d2aa0" containerName="payload-processing"
Aug 04 00:32:40.493853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.493840    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="75663d26-20b8-4d91-b1c3-1e79b3698fc8" containerName="maas-api"
Aug 04 00:32:40.496970 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.496949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.499337 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.499317    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fb51014a-serving-cert\""
Aug 04 00:32:40.499442 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.499367    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:32:40.500284 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.500266    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:32:40.500931 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.500909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:32:40.514822 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.514798    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"]
Aug 04 00:32:40.597618 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.597578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd40e51f-13d6-41ed-8089-144f896f41d1-maas-api-tls\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.597826 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.597636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjgg\" (UniqueName: \"kubernetes.io/projected/cd40e51f-13d6-41ed-8089-144f896f41d1-kube-api-access-djjgg\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.597826 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.597768    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd40e51f-13d6-41ed-8089-144f896f41d1-openshift-service-ca\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.698940 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.698904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd40e51f-13d6-41ed-8089-144f896f41d1-openshift-service-ca\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.699127 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.698984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd40e51f-13d6-41ed-8089-144f896f41d1-maas-api-tls\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.699127 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.699015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjgg\" (UniqueName: \"kubernetes.io/projected/cd40e51f-13d6-41ed-8089-144f896f41d1-kube-api-access-djjgg\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.699527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.699504    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd40e51f-13d6-41ed-8089-144f896f41d1-openshift-service-ca\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.701364 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.701343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd40e51f-13d6-41ed-8089-144f896f41d1-maas-api-tls\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.707188 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.707168    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjgg\" (UniqueName: \"kubernetes.io/projected/cd40e51f-13d6-41ed-8089-144f896f41d1-kube-api-access-djjgg\") pod \"maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.811122 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.811041    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:40.959792 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:40.959770    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"]
Aug 04 00:32:40.961450 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:32:40.961424    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd40e51f_13d6_41ed_8089_144f896f41d1.slice/crio-923e23eb94cb40436ce1ab49165a4b3ef89a47e43e2e9d85ed676c5d29b75854 WatchSource:0}: Error finding container 923e23eb94cb40436ce1ab49165a4b3ef89a47e43e2e9d85ed676c5d29b75854: Status 404 returned error can't find the container with id 923e23eb94cb40436ce1ab49165a4b3ef89a47e43e2e9d85ed676c5d29b75854
Aug 04 00:32:41.199432 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.199402    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl" event={"ID":"cd40e51f-13d6-41ed-8089-144f896f41d1","Type":"ContainerStarted","Data":"923e23eb94cb40436ce1ab49165a4b3ef89a47e43e2e9d85ed676c5d29b75854"}
Aug 04 00:32:41.264586 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.264553    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"]
Aug 04 00:32:41.269076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.269059    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.271774 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.271757    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-fb51014a-dockercfg-wm9c6\""
Aug 04 00:32:41.271896 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.271799    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-fb51014a\""
Aug 04 00:32:41.276318 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.276301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"]
Aug 04 00:32:41.305671 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.305646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48qw\" (UniqueName: \"kubernetes.io/projected/c601c6af-abb9-4964-9864-28ea5c406791-kube-api-access-z48qw\") pod \"payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") " pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.305797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.305683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c601c6af-abb9-4964-9864-28ea5c406791-plugins-config-volume\") pod \"payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") " pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.307915 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.307896    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"]
Aug 04 00:32:41.311259 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.311242    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.322392 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.321863    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"]
Aug 04 00:32:41.406264 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.406234    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z48qw\" (UniqueName: \"kubernetes.io/projected/c601c6af-abb9-4964-9864-28ea5c406791-kube-api-access-z48qw\") pod \"payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") " pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.406417 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.406280    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8666f4a-6235-4628-8fec-0b6070fc41ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.406417 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.406298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c601c6af-abb9-4964-9864-28ea5c406791-plugins-config-volume\") pod \"payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") " pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.406417 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.406362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm26p\" (UniqueName: \"kubernetes.io/projected/f8666f4a-6235-4628-8fec-0b6070fc41ae-kube-api-access-cm26p\") pod \"payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.406979 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.406963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c601c6af-abb9-4964-9864-28ea5c406791-plugins-config-volume\") pod \"payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") " pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.414207 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.414185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48qw\" (UniqueName: \"kubernetes.io/projected/c601c6af-abb9-4964-9864-28ea5c406791-kube-api-access-z48qw\") pod \"payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") " pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.507563 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.507481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8666f4a-6235-4628-8fec-0b6070fc41ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.507563 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.507520    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm26p\" (UniqueName: \"kubernetes.io/projected/f8666f4a-6235-4628-8fec-0b6070fc41ae-kube-api-access-cm26p\") pod \"payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.508314 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.508289    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8666f4a-6235-4628-8fec-0b6070fc41ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.515060 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.515036    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm26p\" (UniqueName: \"kubernetes.io/projected/f8666f4a-6235-4628-8fec-0b6070fc41ae-kube-api-access-cm26p\") pod \"payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.580649 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.580613    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:41.633144 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.633044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:41.724361 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.724314    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"]
Aug 04 00:32:41.728007 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:32:41.726550    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc601c6af_abb9_4964_9864_28ea5c406791.slice/crio-ffa49bcfc81500aa494e5bd5b16bfb648c1888239993d96938c28d2ccb2693da WatchSource:0}: Error finding container ffa49bcfc81500aa494e5bd5b16bfb648c1888239993d96938c28d2ccb2693da: Status 404 returned error can't find the container with id ffa49bcfc81500aa494e5bd5b16bfb648c1888239993d96938c28d2ccb2693da
Aug 04 00:32:41.782632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:41.782569    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"]
Aug 04 00:32:41.784629 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:32:41.784597    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8666f4a_6235_4628_8fec_0b6070fc41ae.slice/crio-160b16ebb4fc1db787421d7e29966fb2658dfe8da4a6e6a6e73c4f19edb798c2 WatchSource:0}: Error finding container 160b16ebb4fc1db787421d7e29966fb2658dfe8da4a6e6a6e73c4f19edb798c2: Status 404 returned error can't find the container with id 160b16ebb4fc1db787421d7e29966fb2658dfe8da4a6e6a6e73c4f19edb798c2
Aug 04 00:32:42.206298 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.206263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl" event={"ID":"cd40e51f-13d6-41ed-8089-144f896f41d1","Type":"ContainerStarted","Data":"46ab1fab0a6ede9f375ad5e021e937878734f255f80cce7ae599917d51b01379"}
Aug 04 00:32:42.206505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.206430    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:42.207815 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.207791    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4" event={"ID":"c601c6af-abb9-4964-9864-28ea5c406791","Type":"ContainerStarted","Data":"0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9"}
Aug 04 00:32:42.207935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.207842    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:32:42.207935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.207865    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4" event={"ID":"c601c6af-abb9-4964-9864-28ea5c406791","Type":"ContainerStarted","Data":"ffa49bcfc81500aa494e5bd5b16bfb648c1888239993d96938c28d2ccb2693da"}
Aug 04 00:32:42.209221 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.209196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm" event={"ID":"f8666f4a-6235-4628-8fec-0b6070fc41ae","Type":"ContainerStarted","Data":"7c2cb699ea71371347205c59640f82d203a06b33675a707ffa076bb95a18876d"}
Aug 04 00:32:42.209315 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.209238    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:42.209315 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.209256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm" event={"ID":"f8666f4a-6235-4628-8fec-0b6070fc41ae","Type":"ContainerStarted","Data":"160b16ebb4fc1db787421d7e29966fb2658dfe8da4a6e6a6e73c4f19edb798c2"}
Aug 04 00:32:42.223394 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.223354    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl" podStartSLOduration=1.885664032 podStartE2EDuration="2.223341765s" totalImagesPullingTime="337.677733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:42.222316478 +0000 UTC m=+1835.562352355" watchObservedRunningTime="2026-08-04 00:32:42.223341765 +0000 UTC m=+1835.563377662"
Aug 04 00:32:42.239264 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.239225    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4" podStartSLOduration=1.23921161 podStartE2EDuration="1.23921161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:42.237809711 +0000 UTC m=+1835.577845576" watchObservedRunningTime="2026-08-04 00:32:42.23921161 +0000 UTC m=+1835.579247526"
Aug 04 00:32:42.255586 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:42.255545    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm" podStartSLOduration=1.255533962 podStartE2EDuration="1.255533962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:42.253248245 +0000 UTC m=+1835.593284110" watchObservedRunningTime="2026-08-04 00:32:42.255533962 +0000 UTC m=+1835.595569827"
Aug 04 00:32:48.218495 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:48.218465    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:32:53.215772 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:53.215745    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:32:53.216171 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:32:53.215812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:33:10.978649 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:10.978610    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"]
Aug 04 00:33:10.979224 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:10.978954    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl" podUID="cd40e51f-13d6-41ed-8089-144f896f41d1" containerName="maas-api" containerID="cri-o://46ab1fab0a6ede9f375ad5e021e937878734f255f80cce7ae599917d51b01379" gracePeriod=30
Aug 04 00:33:11.033920 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.033749    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"]
Aug 04 00:33:11.034366 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.034306    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4" podUID="c601c6af-abb9-4964-9864-28ea5c406791" containerName="payload-processing" containerID="cri-o://0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9" gracePeriod=30
Aug 04 00:33:11.040876 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.040844    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"]
Aug 04 00:33:11.041109 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.041060    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm" podUID="f8666f4a-6235-4628-8fec-0b6070fc41ae" containerName="payload-pre-processing" containerID="cri-o://7c2cb699ea71371347205c59640f82d203a06b33675a707ffa076bb95a18876d" gracePeriod=30
Aug 04 00:33:11.334507 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.334477    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:33:11.343916 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.343888    2571 generic.go:356] "Generic (PLEG): container finished" podID="c601c6af-abb9-4964-9864-28ea5c406791" containerID="0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9" exitCode=0
Aug 04 00:33:11.344029 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.343930    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"
Aug 04 00:33:11.344029 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.343963    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4" event={"ID":"c601c6af-abb9-4964-9864-28ea5c406791","Type":"ContainerDied","Data":"0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9"}
Aug 04 00:33:11.344029 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.344012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4" event={"ID":"c601c6af-abb9-4964-9864-28ea5c406791","Type":"ContainerDied","Data":"ffa49bcfc81500aa494e5bd5b16bfb648c1888239993d96938c28d2ccb2693da"}
Aug 04 00:33:11.344198 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.344046    2571 scope.go:117] "RemoveContainer" containerID="0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9"
Aug 04 00:33:11.345400 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.345378    2571 generic.go:356] "Generic (PLEG): container finished" podID="f8666f4a-6235-4628-8fec-0b6070fc41ae" containerID="7c2cb699ea71371347205c59640f82d203a06b33675a707ffa076bb95a18876d" exitCode=0
Aug 04 00:33:11.345488 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.345463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm" event={"ID":"f8666f4a-6235-4628-8fec-0b6070fc41ae","Type":"ContainerDied","Data":"7c2cb699ea71371347205c59640f82d203a06b33675a707ffa076bb95a18876d"}
Aug 04 00:33:11.347050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.346929    2571 generic.go:356] "Generic (PLEG): container finished" podID="cd40e51f-13d6-41ed-8089-144f896f41d1" containerID="46ab1fab0a6ede9f375ad5e021e937878734f255f80cce7ae599917d51b01379" exitCode=0
Aug 04 00:33:11.347050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.346958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl" event={"ID":"cd40e51f-13d6-41ed-8089-144f896f41d1","Type":"ContainerDied","Data":"46ab1fab0a6ede9f375ad5e021e937878734f255f80cce7ae599917d51b01379"}
Aug 04 00:33:11.358798 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.358708    2571 scope.go:117] "RemoveContainer" containerID="0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9"
Aug 04 00:33:11.359057 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:33:11.359032    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9\": container with ID starting with 0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9 not found: ID does not exist" containerID="0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9"
Aug 04 00:33:11.359143 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.359069    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9"} err="failed to get container status \"0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9\": rpc error: code = NotFound desc = could not find container \"0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9\": container with ID starting with 0cffe2e3e6d5d25ea24338498ede50502d096aeec01346d25003df432fa694f9 not found: ID does not exist"
Aug 04 00:33:11.362786 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.362768    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:33:11.365794 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.365778    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:33:11.463929 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.463902    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd40e51f-13d6-41ed-8089-144f896f41d1-openshift-service-ca\") pod \"cd40e51f-13d6-41ed-8089-144f896f41d1\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") "
Aug 04 00:33:11.464124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.463943    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd40e51f-13d6-41ed-8089-144f896f41d1-maas-api-tls\") pod \"cd40e51f-13d6-41ed-8089-144f896f41d1\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") "
Aug 04 00:33:11.464124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.463990    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djjgg\" (UniqueName: \"kubernetes.io/projected/cd40e51f-13d6-41ed-8089-144f896f41d1-kube-api-access-djjgg\") pod \"cd40e51f-13d6-41ed-8089-144f896f41d1\" (UID: \"cd40e51f-13d6-41ed-8089-144f896f41d1\") "
Aug 04 00:33:11.464124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464009    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48qw\" (UniqueName: \"kubernetes.io/projected/c601c6af-abb9-4964-9864-28ea5c406791-kube-api-access-z48qw\") pod \"c601c6af-abb9-4964-9864-28ea5c406791\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") "
Aug 04 00:33:11.464124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464034    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8666f4a-6235-4628-8fec-0b6070fc41ae-plugins-config-volume\") pod \"f8666f4a-6235-4628-8fec-0b6070fc41ae\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") "
Aug 04 00:33:11.464124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464083    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c601c6af-abb9-4964-9864-28ea5c406791-plugins-config-volume\") pod \"c601c6af-abb9-4964-9864-28ea5c406791\" (UID: \"c601c6af-abb9-4964-9864-28ea5c406791\") "
Aug 04 00:33:11.464124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464116    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm26p\" (UniqueName: \"kubernetes.io/projected/f8666f4a-6235-4628-8fec-0b6070fc41ae-kube-api-access-cm26p\") pod \"f8666f4a-6235-4628-8fec-0b6070fc41ae\" (UID: \"f8666f4a-6235-4628-8fec-0b6070fc41ae\") "
Aug 04 00:33:11.464429 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464338    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd40e51f-13d6-41ed-8089-144f896f41d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd40e51f-13d6-41ed-8089-144f896f41d1" (UID: "cd40e51f-13d6-41ed-8089-144f896f41d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:11.464499 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464476    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8666f4a-6235-4628-8fec-0b6070fc41ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8666f4a-6235-4628-8fec-0b6070fc41ae" (UID: "f8666f4a-6235-4628-8fec-0b6070fc41ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:11.464564 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.464485    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c601c6af-abb9-4964-9864-28ea5c406791-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c601c6af-abb9-4964-9864-28ea5c406791" (UID: "c601c6af-abb9-4964-9864-28ea5c406791"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:11.466244 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.466216    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8666f4a-6235-4628-8fec-0b6070fc41ae-kube-api-access-cm26p" (OuterVolumeSpecName: "kube-api-access-cm26p") pod "f8666f4a-6235-4628-8fec-0b6070fc41ae" (UID: "f8666f4a-6235-4628-8fec-0b6070fc41ae"). InnerVolumeSpecName "kube-api-access-cm26p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:11.466359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.466249    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c601c6af-abb9-4964-9864-28ea5c406791-kube-api-access-z48qw" (OuterVolumeSpecName: "kube-api-access-z48qw") pod "c601c6af-abb9-4964-9864-28ea5c406791" (UID: "c601c6af-abb9-4964-9864-28ea5c406791"). InnerVolumeSpecName "kube-api-access-z48qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:11.466359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.466250    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd40e51f-13d6-41ed-8089-144f896f41d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd40e51f-13d6-41ed-8089-144f896f41d1" (UID: "cd40e51f-13d6-41ed-8089-144f896f41d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:33:11.466359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.466352    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd40e51f-13d6-41ed-8089-144f896f41d1-kube-api-access-djjgg" (OuterVolumeSpecName: "kube-api-access-djjgg") pod "cd40e51f-13d6-41ed-8089-144f896f41d1" (UID: "cd40e51f-13d6-41ed-8089-144f896f41d1"). InnerVolumeSpecName "kube-api-access-djjgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565304    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djjgg\" (UniqueName: \"kubernetes.io/projected/cd40e51f-13d6-41ed-8089-144f896f41d1-kube-api-access-djjgg\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565333    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48qw\" (UniqueName: \"kubernetes.io/projected/c601c6af-abb9-4964-9864-28ea5c406791-kube-api-access-z48qw\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565344    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8666f4a-6235-4628-8fec-0b6070fc41ae-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565356    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c601c6af-abb9-4964-9864-28ea5c406791-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565364    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm26p\" (UniqueName: \"kubernetes.io/projected/f8666f4a-6235-4628-8fec-0b6070fc41ae-kube-api-access-cm26p\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565373    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd40e51f-13d6-41ed-8089-144f896f41d1-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.565390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.565382    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd40e51f-13d6-41ed-8089-144f896f41d1-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:11.664608 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.664570    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"]
Aug 04 00:33:11.669222 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:11.669191    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fb51014a-5cbf44d5b-v5rs4"]
Aug 04 00:33:12.353149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.353063    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"
Aug 04 00:33:12.353149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.353066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl" event={"ID":"cd40e51f-13d6-41ed-8089-144f896f41d1","Type":"ContainerDied","Data":"923e23eb94cb40436ce1ab49165a4b3ef89a47e43e2e9d85ed676c5d29b75854"}
Aug 04 00:33:12.353149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.353148    2571 scope.go:117] "RemoveContainer" containerID="46ab1fab0a6ede9f375ad5e021e937878734f255f80cce7ae599917d51b01379"
Aug 04 00:33:12.355607 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.355583    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm" event={"ID":"f8666f4a-6235-4628-8fec-0b6070fc41ae","Type":"ContainerDied","Data":"160b16ebb4fc1db787421d7e29966fb2658dfe8da4a6e6a6e73c4f19edb798c2"}
Aug 04 00:33:12.355607 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.355598    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"
Aug 04 00:33:12.362303 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.362284    2571 scope.go:117] "RemoveContainer" containerID="7c2cb699ea71371347205c59640f82d203a06b33675a707ffa076bb95a18876d"
Aug 04 00:33:12.376782 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.376762    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"]
Aug 04 00:33:12.380152 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.380131    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb51014a-694d8d6f64-d2mvl"]
Aug 04 00:33:12.389813 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.389794    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"]
Aug 04 00:33:12.393552 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:12.393533    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fb51014a-5d6456996d-dn4dm"]
Aug 04 00:33:13.146116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:13.146087    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c601c6af-abb9-4964-9864-28ea5c406791" path="/var/lib/kubelet/pods/c601c6af-abb9-4964-9864-28ea5c406791/volumes"
Aug 04 00:33:13.146464 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:13.146450    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd40e51f-13d6-41ed-8089-144f896f41d1" path="/var/lib/kubelet/pods/cd40e51f-13d6-41ed-8089-144f896f41d1/volumes"
Aug 04 00:33:13.146800 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:13.146787    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8666f4a-6235-4628-8fec-0b6070fc41ae" path="/var/lib/kubelet/pods/f8666f4a-6235-4628-8fec-0b6070fc41ae/volumes"
Aug 04 00:33:16.964172 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964137    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"]
Aug 04 00:33:16.964649 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964621    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8666f4a-6235-4628-8fec-0b6070fc41ae" containerName="payload-pre-processing"
Aug 04 00:33:16.964649 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964641    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8666f4a-6235-4628-8fec-0b6070fc41ae" containerName="payload-pre-processing"
Aug 04 00:33:16.964775 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964668    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd40e51f-13d6-41ed-8089-144f896f41d1" containerName="maas-api"
Aug 04 00:33:16.964775 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964678    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd40e51f-13d6-41ed-8089-144f896f41d1" containerName="maas-api"
Aug 04 00:33:16.964775 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964728    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c601c6af-abb9-4964-9864-28ea5c406791" containerName="payload-processing"
Aug 04 00:33:16.964775 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964738    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c601c6af-abb9-4964-9864-28ea5c406791" containerName="payload-processing"
Aug 04 00:33:16.964964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964848    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd40e51f-13d6-41ed-8089-144f896f41d1" containerName="maas-api"
Aug 04 00:33:16.964964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964860    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c601c6af-abb9-4964-9864-28ea5c406791" containerName="payload-processing"
Aug 04 00:33:16.964964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.964872    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8666f4a-6235-4628-8fec-0b6070fc41ae" containerName="payload-pre-processing"
Aug 04 00:33:16.969588 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.969568    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:16.972229 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.972079    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:33:16.972716 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.972477    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:33:16.973207 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.973185    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-59a98a02-serving-cert\""
Aug 04 00:33:16.973332 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.973220    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:33:16.975738 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:16.975715    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"]
Aug 04 00:33:17.115738 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.115682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7f023e-aced-4e60-840f-4e8493822b0b-openshift-service-ca\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.115907 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.115811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sh67\" (UniqueName: \"kubernetes.io/projected/ba7f023e-aced-4e60-840f-4e8493822b0b-kube-api-access-5sh67\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.115907 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.115886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7f023e-aced-4e60-840f-4e8493822b0b-maas-api-tls\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.216829 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.216733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh67\" (UniqueName: \"kubernetes.io/projected/ba7f023e-aced-4e60-840f-4e8493822b0b-kube-api-access-5sh67\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.217016 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.216880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7f023e-aced-4e60-840f-4e8493822b0b-maas-api-tls\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.217016 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.216969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7f023e-aced-4e60-840f-4e8493822b0b-openshift-service-ca\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.217748 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.217720    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7f023e-aced-4e60-840f-4e8493822b0b-openshift-service-ca\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.219383 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.219360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7f023e-aced-4e60-840f-4e8493822b0b-maas-api-tls\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.228341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.228306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sh67\" (UniqueName: \"kubernetes.io/projected/ba7f023e-aced-4e60-840f-4e8493822b0b-kube-api-access-5sh67\") pod \"maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.282327 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.282297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:17.414715 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.414673    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"]
Aug 04 00:33:17.419656 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:33:17.419533    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7f023e_aced_4e60_840f_4e8493822b0b.slice/crio-5001070cc59d5a856d43655881b2f8ab5f0ff1215bf35ee5c2578f7af1bb8015 WatchSource:0}: Error finding container 5001070cc59d5a856d43655881b2f8ab5f0ff1215bf35ee5c2578f7af1bb8015: Status 404 returned error can't find the container with id 5001070cc59d5a856d43655881b2f8ab5f0ff1215bf35ee5c2578f7af1bb8015
Aug 04 00:33:17.606292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.606212    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"]
Aug 04 00:33:17.610958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.610934    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.613527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.613503    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-59a98a02\""
Aug 04 00:33:17.613527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.613514    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-59a98a02-dockercfg-4ptvn\""
Aug 04 00:33:17.621419 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.621395    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"]
Aug 04 00:33:17.622927 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.622907    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"]
Aug 04 00:33:17.626038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.626020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.635854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.635744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"]
Aug 04 00:33:17.722393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.722363    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-plugins-config-volume\") pod \"payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") " pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.722575 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.722412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmbz\" (UniqueName: \"kubernetes.io/projected/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-kube-api-access-mbmbz\") pod \"payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") " pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.722575 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.722508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfq5c\" (UniqueName: \"kubernetes.io/projected/c81ee6da-e89b-40e0-8a17-6c599581ec52-kube-api-access-sfq5c\") pod \"payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.722680 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.722577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81ee6da-e89b-40e0-8a17-6c599581ec52-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.823750 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.823716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmbz\" (UniqueName: \"kubernetes.io/projected/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-kube-api-access-mbmbz\") pod \"payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") " pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.823881 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.823798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfq5c\" (UniqueName: \"kubernetes.io/projected/c81ee6da-e89b-40e0-8a17-6c599581ec52-kube-api-access-sfq5c\") pod \"payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.823881 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.823841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81ee6da-e89b-40e0-8a17-6c599581ec52-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.824000 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.823931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-plugins-config-volume\") pod \"payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") " pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.824924 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.824873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-plugins-config-volume\") pod \"payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") " pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.825174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.825116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81ee6da-e89b-40e0-8a17-6c599581ec52-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.831897 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.831874    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfq5c\" (UniqueName: \"kubernetes.io/projected/c81ee6da-e89b-40e0-8a17-6c599581ec52-kube-api-access-sfq5c\") pod \"payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.832170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.832154    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmbz\" (UniqueName: \"kubernetes.io/projected/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-kube-api-access-mbmbz\") pod \"payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") " pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:17.924200 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.924147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:17.938469 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:17.938438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:18.072727 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.072680    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"]
Aug 04 00:33:18.075799 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:33:18.075769    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81ee6da_e89b_40e0_8a17_6c599581ec52.slice/crio-3635b1a0be307ad0168af9cac2041a5a2629109a4696f33460bb3dac6a2abc95 WatchSource:0}: Error finding container 3635b1a0be307ad0168af9cac2041a5a2629109a4696f33460bb3dac6a2abc95: Status 404 returned error can't find the container with id 3635b1a0be307ad0168af9cac2041a5a2629109a4696f33460bb3dac6a2abc95
Aug 04 00:33:18.092303 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.092282    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"]
Aug 04 00:33:18.094855 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:33:18.094817    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bb7eaa_527c_4c6f_b551_355eed7ecb4f.slice/crio-a9cee45920dab1b8840a2581650946b3bfc909e75245d7a6712fac61853cb67c WatchSource:0}: Error finding container a9cee45920dab1b8840a2581650946b3bfc909e75245d7a6712fac61853cb67c: Status 404 returned error can't find the container with id a9cee45920dab1b8840a2581650946b3bfc909e75245d7a6712fac61853cb67c
Aug 04 00:33:18.387198 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.387160    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj" event={"ID":"ba7f023e-aced-4e60-840f-4e8493822b0b","Type":"ContainerStarted","Data":"8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4"}
Aug 04 00:33:18.387385 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.387353    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:18.387466 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.387398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj" event={"ID":"ba7f023e-aced-4e60-840f-4e8493822b0b","Type":"ContainerStarted","Data":"5001070cc59d5a856d43655881b2f8ab5f0ff1215bf35ee5c2578f7af1bb8015"}
Aug 04 00:33:18.388663 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.388631    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq" event={"ID":"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f","Type":"ContainerStarted","Data":"715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d"}
Aug 04 00:33:18.388825 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.388681    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq" event={"ID":"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f","Type":"ContainerStarted","Data":"a9cee45920dab1b8840a2581650946b3bfc909e75245d7a6712fac61853cb67c"}
Aug 04 00:33:18.388825 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.388724    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:18.390112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.390088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j" event={"ID":"c81ee6da-e89b-40e0-8a17-6c599581ec52","Type":"ContainerStarted","Data":"1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680"}
Aug 04 00:33:18.390233 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.390128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j" event={"ID":"c81ee6da-e89b-40e0-8a17-6c599581ec52","Type":"ContainerStarted","Data":"3635b1a0be307ad0168af9cac2041a5a2629109a4696f33460bb3dac6a2abc95"}
Aug 04 00:33:18.390233 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.390149    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:18.406466 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.406407    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj" podStartSLOduration=2.075361101 podStartE2EDuration="2.40639486s" totalImagesPullingTime="331.033759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:33:18.40393927 +0000 UTC m=+1871.743975172" watchObservedRunningTime="2026-08-04 00:33:18.40639486 +0000 UTC m=+1871.746430777"
Aug 04 00:33:18.419590 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.419551    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j" podStartSLOduration=1.419539949 podStartE2EDuration="1.419539949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:33:18.417786425 +0000 UTC m=+1871.757822290" watchObservedRunningTime="2026-08-04 00:33:18.419539949 +0000 UTC m=+1871.759575815"
Aug 04 00:33:18.435139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:18.435097    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq" podStartSLOduration=1.435083549 podStartE2EDuration="1.435083549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:33:18.433210518 +0000 UTC m=+1871.773246382" watchObservedRunningTime="2026-08-04 00:33:18.435083549 +0000 UTC m=+1871.775119413"
Aug 04 00:33:24.401229 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:24.401200    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:29.397814 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:29.397725    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:29.398279 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:29.398259    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:47.458775 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.458744    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"]
Aug 04 00:33:47.459281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.458959    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj" podUID="ba7f023e-aced-4e60-840f-4e8493822b0b" containerName="maas-api" containerID="cri-o://8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4" gracePeriod=30
Aug 04 00:33:47.505993 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.505961    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"]
Aug 04 00:33:47.506661 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.506218    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq" podUID="d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" containerName="payload-processing" containerID="cri-o://715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d" gracePeriod=30
Aug 04 00:33:47.514206 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.514181    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"]
Aug 04 00:33:47.514587 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.514556    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j" podUID="c81ee6da-e89b-40e0-8a17-6c599581ec52" containerName="payload-pre-processing" containerID="cri-o://1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680" gracePeriod=30
Aug 04 00:33:47.773782 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.773755    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:47.797430 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.797406    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:47.803623 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.803600    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:47.888444 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.888371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81ee6da-e89b-40e0-8a17-6c599581ec52-plugins-config-volume\") pod \"c81ee6da-e89b-40e0-8a17-6c599581ec52\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") "
Aug 04 00:33:47.888810 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.888783    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81ee6da-e89b-40e0-8a17-6c599581ec52-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c81ee6da-e89b-40e0-8a17-6c599581ec52" (UID: "c81ee6da-e89b-40e0-8a17-6c599581ec52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:47.888952 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.888892    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbmbz\" (UniqueName: \"kubernetes.io/projected/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-kube-api-access-mbmbz\") pod \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") "
Aug 04 00:33:47.889255 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889234    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfq5c\" (UniqueName: \"kubernetes.io/projected/c81ee6da-e89b-40e0-8a17-6c599581ec52-kube-api-access-sfq5c\") pod \"c81ee6da-e89b-40e0-8a17-6c599581ec52\" (UID: \"c81ee6da-e89b-40e0-8a17-6c599581ec52\") "
Aug 04 00:33:47.889353 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-plugins-config-volume\") pod \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\" (UID: \"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f\") "
Aug 04 00:33:47.889415 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889376    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7f023e-aced-4e60-840f-4e8493822b0b-openshift-service-ca\") pod \"ba7f023e-aced-4e60-840f-4e8493822b0b\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") "
Aug 04 00:33:47.889467 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889412    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7f023e-aced-4e60-840f-4e8493822b0b-maas-api-tls\") pod \"ba7f023e-aced-4e60-840f-4e8493822b0b\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") "
Aug 04 00:33:47.889467 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889452    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sh67\" (UniqueName: \"kubernetes.io/projected/ba7f023e-aced-4e60-840f-4e8493822b0b-kube-api-access-5sh67\") pod \"ba7f023e-aced-4e60-840f-4e8493822b0b\" (UID: \"ba7f023e-aced-4e60-840f-4e8493822b0b\") "
Aug 04 00:33:47.889980 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889889    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81ee6da-e89b-40e0-8a17-6c599581ec52-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:47.890076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.889970    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba7f023e-aced-4e60-840f-4e8493822b0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba7f023e-aced-4e60-840f-4e8493822b0b" (UID: "ba7f023e-aced-4e60-840f-4e8493822b0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:47.890374 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.890352    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" (UID: "d1bb7eaa-527c-4c6f-b551-355eed7ecb4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:47.891961 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.891926    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-kube-api-access-mbmbz" (OuterVolumeSpecName: "kube-api-access-mbmbz") pod "d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" (UID: "d1bb7eaa-527c-4c6f-b551-355eed7ecb4f"). InnerVolumeSpecName "kube-api-access-mbmbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:47.892066 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.892002    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81ee6da-e89b-40e0-8a17-6c599581ec52-kube-api-access-sfq5c" (OuterVolumeSpecName: "kube-api-access-sfq5c") pod "c81ee6da-e89b-40e0-8a17-6c599581ec52" (UID: "c81ee6da-e89b-40e0-8a17-6c599581ec52"). InnerVolumeSpecName "kube-api-access-sfq5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:47.892134 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.892096    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7f023e-aced-4e60-840f-4e8493822b0b-kube-api-access-5sh67" (OuterVolumeSpecName: "kube-api-access-5sh67") pod "ba7f023e-aced-4e60-840f-4e8493822b0b" (UID: "ba7f023e-aced-4e60-840f-4e8493822b0b"). InnerVolumeSpecName "kube-api-access-5sh67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:47.892507 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.892477    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba7f023e-aced-4e60-840f-4e8493822b0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba7f023e-aced-4e60-840f-4e8493822b0b" (UID: "ba7f023e-aced-4e60-840f-4e8493822b0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:33:47.990632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.990545    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7f023e-aced-4e60-840f-4e8493822b0b-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:47.990632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.990575    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7f023e-aced-4e60-840f-4e8493822b0b-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:47.990632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.990587    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sh67\" (UniqueName: \"kubernetes.io/projected/ba7f023e-aced-4e60-840f-4e8493822b0b-kube-api-access-5sh67\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:47.990632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.990596    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbmbz\" (UniqueName: \"kubernetes.io/projected/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-kube-api-access-mbmbz\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:47.990632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.990610    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfq5c\" (UniqueName: \"kubernetes.io/projected/c81ee6da-e89b-40e0-8a17-6c599581ec52-kube-api-access-sfq5c\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:47.990632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:47.990621    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:33:48.532882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.532623    2571 generic.go:356] "Generic (PLEG): container finished" podID="d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" containerID="715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d" exitCode=0
Aug 04 00:33:48.532882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.532746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq" event={"ID":"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f","Type":"ContainerDied","Data":"715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d"}
Aug 04 00:33:48.532882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.532825    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq" event={"ID":"d1bb7eaa-527c-4c6f-b551-355eed7ecb4f","Type":"ContainerDied","Data":"a9cee45920dab1b8840a2581650946b3bfc909e75245d7a6712fac61853cb67c"}
Aug 04 00:33:48.532882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.532860    2571 scope.go:117] "RemoveContainer" containerID="715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d"
Aug 04 00:33:48.532882 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.532873    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"
Aug 04 00:33:48.534759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.534736    2571 generic.go:356] "Generic (PLEG): container finished" podID="c81ee6da-e89b-40e0-8a17-6c599581ec52" containerID="1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680" exitCode=0
Aug 04 00:33:48.534875 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.534793    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"
Aug 04 00:33:48.534875 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.534821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j" event={"ID":"c81ee6da-e89b-40e0-8a17-6c599581ec52","Type":"ContainerDied","Data":"1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680"}
Aug 04 00:33:48.534989 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.534875    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j" event={"ID":"c81ee6da-e89b-40e0-8a17-6c599581ec52","Type":"ContainerDied","Data":"3635b1a0be307ad0168af9cac2041a5a2629109a4696f33460bb3dac6a2abc95"}
Aug 04 00:33:48.536208 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.536182    2571 generic.go:356] "Generic (PLEG): container finished" podID="ba7f023e-aced-4e60-840f-4e8493822b0b" containerID="8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4" exitCode=0
Aug 04 00:33:48.536321 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.536224    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj" event={"ID":"ba7f023e-aced-4e60-840f-4e8493822b0b","Type":"ContainerDied","Data":"8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4"}
Aug 04 00:33:48.536321 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.536261    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj" event={"ID":"ba7f023e-aced-4e60-840f-4e8493822b0b","Type":"ContainerDied","Data":"5001070cc59d5a856d43655881b2f8ab5f0ff1215bf35ee5c2578f7af1bb8015"}
Aug 04 00:33:48.536321 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.536276    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"
Aug 04 00:33:48.543822 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.543804    2571 scope.go:117] "RemoveContainer" containerID="715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d"
Aug 04 00:33:48.544133 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:33:48.544115    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d\": container with ID starting with 715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d not found: ID does not exist" containerID="715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d"
Aug 04 00:33:48.544223 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.544140    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d"} err="failed to get container status \"715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d\": rpc error: code = NotFound desc = could not find container \"715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d\": container with ID starting with 715113f7ffdc48c7aefda7cdb5f2a295f3b776b3ae1461060f420c168cec415d not found: ID does not exist"
Aug 04 00:33:48.544223 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.544159    2571 scope.go:117] "RemoveContainer" containerID="1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680"
Aug 04 00:33:48.553585 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.553570    2571 scope.go:117] "RemoveContainer" containerID="1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680"
Aug 04 00:33:48.553861 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:33:48.553842    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680\": container with ID starting with 1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680 not found: ID does not exist" containerID="1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680"
Aug 04 00:33:48.553958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.553867    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680"} err="failed to get container status \"1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680\": rpc error: code = NotFound desc = could not find container \"1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680\": container with ID starting with 1f1f6583227fab72c9f079f830909572549e8ee11b6fc2f9e904f9fc8108c680 not found: ID does not exist"
Aug 04 00:33:48.553958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.553885    2571 scope.go:117] "RemoveContainer" containerID="8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4"
Aug 04 00:33:48.561838 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.561817    2571 scope.go:117] "RemoveContainer" containerID="8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4"
Aug 04 00:33:48.562067 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:33:48.562048    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4\": container with ID starting with 8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4 not found: ID does not exist" containerID="8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4"
Aug 04 00:33:48.562112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.562074    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4"} err="failed to get container status \"8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4\": rpc error: code = NotFound desc = could not find container \"8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4\": container with ID starting with 8d48ed721aa52d61f0c9f0d372f2ce70b40bc31e75668535a54deeb301e7d3a4 not found: ID does not exist"
Aug 04 00:33:48.568356 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.568337    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"]
Aug 04 00:33:48.577900 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.577874    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-59a98a02-5789b74dc4-5bdpq"]
Aug 04 00:33:48.590635 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.590610    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"]
Aug 04 00:33:48.600483 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.600460    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-59a98a02-7dcf898b7d-jx6qj"]
Aug 04 00:33:48.620672 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.620650    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"]
Aug 04 00:33:48.628128 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:48.628100    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-59a98a02-7644b748d8-7rg4j"]
Aug 04 00:33:49.145229 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:49.145186    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7f023e-aced-4e60-840f-4e8493822b0b" path="/var/lib/kubelet/pods/ba7f023e-aced-4e60-840f-4e8493822b0b/volumes"
Aug 04 00:33:49.145639 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:49.145619    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c81ee6da-e89b-40e0-8a17-6c599581ec52" path="/var/lib/kubelet/pods/c81ee6da-e89b-40e0-8a17-6c599581ec52/volumes"
Aug 04 00:33:49.146039 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:33:49.146021    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" path="/var/lib/kubelet/pods/d1bb7eaa-527c-4c6f-b551-355eed7ecb4f/volumes"
Aug 04 00:35:50.193197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193167    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"]
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193478    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7f023e-aced-4e60-840f-4e8493822b0b" containerName="maas-api"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193488    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7f023e-aced-4e60-840f-4e8493822b0b" containerName="maas-api"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193498    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c81ee6da-e89b-40e0-8a17-6c599581ec52" containerName="payload-pre-processing"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193504    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81ee6da-e89b-40e0-8a17-6c599581ec52" containerName="payload-pre-processing"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193510    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" containerName="payload-processing"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193516    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" containerName="payload-processing"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193572    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7f023e-aced-4e60-840f-4e8493822b0b" containerName="maas-api"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193579    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c81ee6da-e89b-40e0-8a17-6c599581ec52" containerName="payload-pre-processing"
Aug 04 00:35:50.193660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.193585    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1bb7eaa-527c-4c6f-b551-355eed7ecb4f" containerName="payload-processing"
Aug 04 00:35:50.196805 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.196786    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.199243 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.199216    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1915a2d1-serving-cert\""
Aug 04 00:35:50.199243 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.199243    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:35:50.199432 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.199264    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:35:50.199515 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.199498    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:35:50.208061 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.208002    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"]
Aug 04 00:35:50.258083 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.258054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b69d493-35ae-437f-b3a3-d05fe4df269a-openshift-service-ca\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.258233 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.258088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.258233 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.258127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6hkj\" (UniqueName: \"kubernetes.io/projected/9b69d493-35ae-437f-b3a3-d05fe4df269a-kube-api-access-l6hkj\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.359519 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.359485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b69d493-35ae-437f-b3a3-d05fe4df269a-openshift-service-ca\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.359519 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.359525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.359815 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.359561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6hkj\" (UniqueName: \"kubernetes.io/projected/9b69d493-35ae-437f-b3a3-d05fe4df269a-kube-api-access-l6hkj\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.359815 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:35:50.359718    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-serving-cert: secret "maas-api-e2e-mt-1915a2d1-serving-cert" not found
Aug 04 00:35:50.359815 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:35:50.359791    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls podName:9b69d493-35ae-437f-b3a3-d05fe4df269a nodeName:}" failed. No retries permitted until 2026-08-04 00:35:50.859769048 +0000 UTC m=+2024.199804905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls") pod "maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" (UID: "9b69d493-35ae-437f-b3a3-d05fe4df269a") : secret "maas-api-e2e-mt-1915a2d1-serving-cert" not found
Aug 04 00:35:50.360246 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.360226    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b69d493-35ae-437f-b3a3-d05fe4df269a-openshift-service-ca\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.368359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.368339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6hkj\" (UniqueName: \"kubernetes.io/projected/9b69d493-35ae-437f-b3a3-d05fe4df269a-kube-api-access-l6hkj\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.791933 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.791894    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"]
Aug 04 00:35:50.795607 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.795528    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:50.801970 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.801944    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1915a2d1-dockercfg-74p9n\""
Aug 04 00:35:50.801970 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.801952    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1915a2d1\""
Aug 04 00:35:50.805373 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.805352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"]
Aug 04 00:35:50.830366 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.830338    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"]
Aug 04 00:35:50.834145 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.834121    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.845266 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.845246    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"]
Aug 04 00:35:50.864230 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.864205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf26560-8657-4421-8320-a514588ad7aa-plugins-config-volume\") pod \"payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") " pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.864337 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.864261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1109e5d-5e74-48cb-b143-059224c18347-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:50.864337 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.864319    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv25b\" (UniqueName: \"kubernetes.io/projected/b1109e5d-5e74-48cb-b143-059224c18347-kube-api-access-jv25b\") pod \"payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:50.864470 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.864344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts25j\" (UniqueName: \"kubernetes.io/projected/bdf26560-8657-4421-8320-a514588ad7aa-kube-api-access-ts25j\") pod \"payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") " pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.864470 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.864385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.866653 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.866634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls\") pod \"maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:50.965530 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.965502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1109e5d-5e74-48cb-b143-059224c18347-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:50.965742 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.965541    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv25b\" (UniqueName: \"kubernetes.io/projected/b1109e5d-5e74-48cb-b143-059224c18347-kube-api-access-jv25b\") pod \"payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:50.965742 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.965558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts25j\" (UniqueName: \"kubernetes.io/projected/bdf26560-8657-4421-8320-a514588ad7aa-kube-api-access-ts25j\") pod \"payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") " pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.965742 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.965606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf26560-8657-4421-8320-a514588ad7aa-plugins-config-volume\") pod \"payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") " pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.966296 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.966271    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1109e5d-5e74-48cb-b143-059224c18347-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:50.966461 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.966440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf26560-8657-4421-8320-a514588ad7aa-plugins-config-volume\") pod \"payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") " pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.974566 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.974537    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts25j\" (UniqueName: \"kubernetes.io/projected/bdf26560-8657-4421-8320-a514588ad7aa-kube-api-access-ts25j\") pod \"payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") " pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:50.974959 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:50.974939    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv25b\" (UniqueName: \"kubernetes.io/projected/b1109e5d-5e74-48cb-b143-059224c18347-kube-api-access-jv25b\") pod \"payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:51.107727 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:51.107636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:51.108730 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:51.108709    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:51.145323 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:51.145287    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:51.281092 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:51.281004    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"]
Aug 04 00:35:51.283968 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:35:51.283940    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b69d493_35ae_437f_b3a3_d05fe4df269a.slice/crio-1be9bd19dc821914475dda3a161030e48a8d7f726ec6c46de679b9006c571f5f WatchSource:0}: Error finding container 1be9bd19dc821914475dda3a161030e48a8d7f726ec6c46de679b9006c571f5f: Status 404 returned error can't find the container with id 1be9bd19dc821914475dda3a161030e48a8d7f726ec6c46de679b9006c571f5f
Aug 04 00:35:51.312740 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:51.312716    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"]
Aug 04 00:35:51.314514 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:35:51.314486    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf26560_8657_4421_8320_a514588ad7aa.slice/crio-ed6c2ef04632636f383693df445b9e37685c7a433a37aebfe2dc9499472f0bc6 WatchSource:0}: Error finding container ed6c2ef04632636f383693df445b9e37685c7a433a37aebfe2dc9499472f0bc6: Status 404 returned error can't find the container with id ed6c2ef04632636f383693df445b9e37685c7a433a37aebfe2dc9499472f0bc6
Aug 04 00:35:51.460426 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:51.460393    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"]
Aug 04 00:35:51.462951 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:35:51.462924    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1109e5d_5e74_48cb_b143_059224c18347.slice/crio-1362ec11c0bcb1cf45d78edc5a2de14a045147a2887aaa4b030513dde203ff45 WatchSource:0}: Error finding container 1362ec11c0bcb1cf45d78edc5a2de14a045147a2887aaa4b030513dde203ff45: Status 404 returned error can't find the container with id 1362ec11c0bcb1cf45d78edc5a2de14a045147a2887aaa4b030513dde203ff45
Aug 04 00:35:52.094020 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.093931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr" event={"ID":"bdf26560-8657-4421-8320-a514588ad7aa","Type":"ContainerStarted","Data":"6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470"}
Aug 04 00:35:52.094182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.094021    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr" event={"ID":"bdf26560-8657-4421-8320-a514588ad7aa","Type":"ContainerStarted","Data":"ed6c2ef04632636f383693df445b9e37685c7a433a37aebfe2dc9499472f0bc6"}
Aug 04 00:35:52.094182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.094065    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:35:52.095577 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.095556    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" event={"ID":"9b69d493-35ae-437f-b3a3-d05fe4df269a","Type":"ContainerStarted","Data":"839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0"}
Aug 04 00:35:52.095682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.095593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" event={"ID":"9b69d493-35ae-437f-b3a3-d05fe4df269a","Type":"ContainerStarted","Data":"1be9bd19dc821914475dda3a161030e48a8d7f726ec6c46de679b9006c571f5f"}
Aug 04 00:35:52.095682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.095616    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:35:52.096964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.096938    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q" event={"ID":"b1109e5d-5e74-48cb-b143-059224c18347","Type":"ContainerStarted","Data":"01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f"}
Aug 04 00:35:52.097041 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.096986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q" event={"ID":"b1109e5d-5e74-48cb-b143-059224c18347","Type":"ContainerStarted","Data":"1362ec11c0bcb1cf45d78edc5a2de14a045147a2887aaa4b030513dde203ff45"}
Aug 04 00:35:52.097041 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.097027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:35:52.108479 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.108440    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr" podStartSLOduration=2.108427482 podStartE2EDuration="2.108427482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:35:52.107231794 +0000 UTC m=+2025.447267692" watchObservedRunningTime="2026-08-04 00:35:52.108427482 +0000 UTC m=+2025.448463397"
Aug 04 00:35:52.122751 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.122666    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" podStartSLOduration=1.628273836 podStartE2EDuration="2.122648104s" totalImagesPullingTime="494.374268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:35:52.121950547 +0000 UTC m=+2025.461986434" watchObservedRunningTime="2026-08-04 00:35:52.122648104 +0000 UTC m=+2025.462683969"
Aug 04 00:35:52.136740 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:52.136681    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q" podStartSLOduration=2.136670798 podStartE2EDuration="2.136670798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:35:52.135143852 +0000 UTC m=+2025.475179727" watchObservedRunningTime="2026-08-04 00:35:52.136670798 +0000 UTC m=+2025.476706663"
Aug 04 00:35:58.108045 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:35:58.108016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:36:03.103527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:03.103500    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:36:03.104027 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:03.103865    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:36:31.501348 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.501257    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"]
Aug 04 00:36:31.501923 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.501519    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" podUID="9b69d493-35ae-437f-b3a3-d05fe4df269a" containerName="maas-api" containerID="cri-o://839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0" gracePeriod=30
Aug 04 00:36:31.557333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.557300    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"]
Aug 04 00:36:31.557585 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.557556    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr" podUID="bdf26560-8657-4421-8320-a514588ad7aa" containerName="payload-processing" containerID="cri-o://6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470" gracePeriod=30
Aug 04 00:36:31.564076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.563885    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"]
Aug 04 00:36:31.564267 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.564143    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q" podUID="b1109e5d-5e74-48cb-b143-059224c18347" containerName="payload-pre-processing" containerID="cri-o://01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f" gracePeriod=30
Aug 04 00:36:31.824031 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.824006    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:36:31.865451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.865428    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:36:31.869055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.869031    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:36:31.914708 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914670    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls\") pod \"9b69d493-35ae-437f-b3a3-d05fe4df269a\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") "
Aug 04 00:36:31.914894 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914728    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv25b\" (UniqueName: \"kubernetes.io/projected/b1109e5d-5e74-48cb-b143-059224c18347-kube-api-access-jv25b\") pod \"b1109e5d-5e74-48cb-b143-059224c18347\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") "
Aug 04 00:36:31.914894 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914770    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6hkj\" (UniqueName: \"kubernetes.io/projected/9b69d493-35ae-437f-b3a3-d05fe4df269a-kube-api-access-l6hkj\") pod \"9b69d493-35ae-437f-b3a3-d05fe4df269a\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") "
Aug 04 00:36:31.914894 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914863    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf26560-8657-4421-8320-a514588ad7aa-plugins-config-volume\") pod \"bdf26560-8657-4421-8320-a514588ad7aa\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") "
Aug 04 00:36:31.915062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914896    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1109e5d-5e74-48cb-b143-059224c18347-plugins-config-volume\") pod \"b1109e5d-5e74-48cb-b143-059224c18347\" (UID: \"b1109e5d-5e74-48cb-b143-059224c18347\") "
Aug 04 00:36:31.915062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914927    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts25j\" (UniqueName: \"kubernetes.io/projected/bdf26560-8657-4421-8320-a514588ad7aa-kube-api-access-ts25j\") pod \"bdf26560-8657-4421-8320-a514588ad7aa\" (UID: \"bdf26560-8657-4421-8320-a514588ad7aa\") "
Aug 04 00:36:31.915062 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.914963    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b69d493-35ae-437f-b3a3-d05fe4df269a-openshift-service-ca\") pod \"9b69d493-35ae-437f-b3a3-d05fe4df269a\" (UID: \"9b69d493-35ae-437f-b3a3-d05fe4df269a\") "
Aug 04 00:36:31.915291 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.915266    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf26560-8657-4421-8320-a514588ad7aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bdf26560-8657-4421-8320-a514588ad7aa" (UID: "bdf26560-8657-4421-8320-a514588ad7aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:36:31.915493 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.915471    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b69d493-35ae-437f-b3a3-d05fe4df269a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b69d493-35ae-437f-b3a3-d05fe4df269a" (UID: "9b69d493-35ae-437f-b3a3-d05fe4df269a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:36:31.915614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.915514    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1109e5d-5e74-48cb-b143-059224c18347-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1109e5d-5e74-48cb-b143-059224c18347" (UID: "b1109e5d-5e74-48cb-b143-059224c18347"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:36:31.916969 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.916948    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b69d493-35ae-437f-b3a3-d05fe4df269a" (UID: "9b69d493-35ae-437f-b3a3-d05fe4df269a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:36:31.917293 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.917264    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf26560-8657-4421-8320-a514588ad7aa-kube-api-access-ts25j" (OuterVolumeSpecName: "kube-api-access-ts25j") pod "bdf26560-8657-4421-8320-a514588ad7aa" (UID: "bdf26560-8657-4421-8320-a514588ad7aa"). InnerVolumeSpecName "kube-api-access-ts25j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:36:31.917364 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.917333    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1109e5d-5e74-48cb-b143-059224c18347-kube-api-access-jv25b" (OuterVolumeSpecName: "kube-api-access-jv25b") pod "b1109e5d-5e74-48cb-b143-059224c18347" (UID: "b1109e5d-5e74-48cb-b143-059224c18347"). InnerVolumeSpecName "kube-api-access-jv25b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:36:31.917364 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:31.917340    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b69d493-35ae-437f-b3a3-d05fe4df269a-kube-api-access-l6hkj" (OuterVolumeSpecName: "kube-api-access-l6hkj") pod "9b69d493-35ae-437f-b3a3-d05fe4df269a" (UID: "9b69d493-35ae-437f-b3a3-d05fe4df269a"). InnerVolumeSpecName "kube-api-access-l6hkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:36:32.016168 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016132    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b69d493-35ae-437f-b3a3-d05fe4df269a-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.016168 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016162    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b69d493-35ae-437f-b3a3-d05fe4df269a-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.016168 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016172    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv25b\" (UniqueName: \"kubernetes.io/projected/b1109e5d-5e74-48cb-b143-059224c18347-kube-api-access-jv25b\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.016168 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016181    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6hkj\" (UniqueName: \"kubernetes.io/projected/9b69d493-35ae-437f-b3a3-d05fe4df269a-kube-api-access-l6hkj\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.016421 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016190    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf26560-8657-4421-8320-a514588ad7aa-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.016421 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016198    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1109e5d-5e74-48cb-b143-059224c18347-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.016421 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.016206    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts25j\" (UniqueName: \"kubernetes.io/projected/bdf26560-8657-4421-8320-a514588ad7aa-kube-api-access-ts25j\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:36:32.274056 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.274015    2571 generic.go:356] "Generic (PLEG): container finished" podID="9b69d493-35ae-437f-b3a3-d05fe4df269a" containerID="839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0" exitCode=0
Aug 04 00:36:32.274234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.274078    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"
Aug 04 00:36:32.274234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.274108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" event={"ID":"9b69d493-35ae-437f-b3a3-d05fe4df269a","Type":"ContainerDied","Data":"839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0"}
Aug 04 00:36:32.274234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.274174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w" event={"ID":"9b69d493-35ae-437f-b3a3-d05fe4df269a","Type":"ContainerDied","Data":"1be9bd19dc821914475dda3a161030e48a8d7f726ec6c46de679b9006c571f5f"}
Aug 04 00:36:32.274234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.274202    2571 scope.go:117] "RemoveContainer" containerID="839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0"
Aug 04 00:36:32.275423 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.275401    2571 generic.go:356] "Generic (PLEG): container finished" podID="b1109e5d-5e74-48cb-b143-059224c18347" containerID="01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f" exitCode=0
Aug 04 00:36:32.275517 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.275465    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"
Aug 04 00:36:32.275517 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.275486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q" event={"ID":"b1109e5d-5e74-48cb-b143-059224c18347","Type":"ContainerDied","Data":"01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f"}
Aug 04 00:36:32.275626 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.275530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q" event={"ID":"b1109e5d-5e74-48cb-b143-059224c18347","Type":"ContainerDied","Data":"1362ec11c0bcb1cf45d78edc5a2de14a045147a2887aaa4b030513dde203ff45"}
Aug 04 00:36:32.276912 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.276891    2571 generic.go:356] "Generic (PLEG): container finished" podID="bdf26560-8657-4421-8320-a514588ad7aa" containerID="6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470" exitCode=0
Aug 04 00:36:32.277033 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.276942    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr" event={"ID":"bdf26560-8657-4421-8320-a514588ad7aa","Type":"ContainerDied","Data":"6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470"}
Aug 04 00:36:32.277033 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.276974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr" event={"ID":"bdf26560-8657-4421-8320-a514588ad7aa","Type":"ContainerDied","Data":"ed6c2ef04632636f383693df445b9e37685c7a433a37aebfe2dc9499472f0bc6"}
Aug 04 00:36:32.277033 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.276944    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"
Aug 04 00:36:32.284250 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.284220    2571 scope.go:117] "RemoveContainer" containerID="839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0"
Aug 04 00:36:32.284540 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:36:32.284521    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0\": container with ID starting with 839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0 not found: ID does not exist" containerID="839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0"
Aug 04 00:36:32.284626 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.284552    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0"} err="failed to get container status \"839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0\": rpc error: code = NotFound desc = could not find container \"839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0\": container with ID starting with 839b52f631aa2e472beecac9ad67053b002c86eb693a9b3e0035dbc79c55bde0 not found: ID does not exist"
Aug 04 00:36:32.284626 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.284575    2571 scope.go:117] "RemoveContainer" containerID="01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f"
Aug 04 00:36:32.292785 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.292763    2571 scope.go:117] "RemoveContainer" containerID="01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f"
Aug 04 00:36:32.293051 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:36:32.293033    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f\": container with ID starting with 01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f not found: ID does not exist" containerID="01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f"
Aug 04 00:36:32.293125 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.293061    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f"} err="failed to get container status \"01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f\": rpc error: code = NotFound desc = could not find container \"01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f\": container with ID starting with 01d06b59c50d19452002c21185032af25d816e6c7f7fd4b10abd9356b4ca225f not found: ID does not exist"
Aug 04 00:36:32.293125 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.293083    2571 scope.go:117] "RemoveContainer" containerID="6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470"
Aug 04 00:36:32.300461 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.300444    2571 scope.go:117] "RemoveContainer" containerID="6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470"
Aug 04 00:36:32.300675 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:36:32.300659    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470\": container with ID starting with 6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470 not found: ID does not exist" containerID="6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470"
Aug 04 00:36:32.300749 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.300678    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470"} err="failed to get container status \"6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470\": rpc error: code = NotFound desc = could not find container \"6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470\": container with ID starting with 6f0c1b3adaeafb1f8ecd9d51728699b57fd8cdc524509ba25fc93d8c7fd26470 not found: ID does not exist"
Aug 04 00:36:32.303935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.303914    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"]
Aug 04 00:36:32.306761 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.306739    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1915a2d1-665dd7966f-bjr4w"]
Aug 04 00:36:32.317011 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.316989    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"]
Aug 04 00:36:32.321181 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.321160    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1915a2d1-55498699c6-vn59q"]
Aug 04 00:36:32.331339 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.331318    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"]
Aug 04 00:36:32.335377 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:32.335355    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1915a2d1-549599d58b-4hvtr"]
Aug 04 00:36:33.145341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:33.145308    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b69d493-35ae-437f-b3a3-d05fe4df269a" path="/var/lib/kubelet/pods/9b69d493-35ae-437f-b3a3-d05fe4df269a/volumes"
Aug 04 00:36:33.145709 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:33.145669    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1109e5d-5e74-48cb-b143-059224c18347" path="/var/lib/kubelet/pods/b1109e5d-5e74-48cb-b143-059224c18347/volumes"
Aug 04 00:36:33.146023 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:36:33.146009    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdf26560-8657-4421-8320-a514588ad7aa" path="/var/lib/kubelet/pods/bdf26560-8657-4421-8320-a514588ad7aa/volumes"
Aug 04 00:37:07.250587 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:37:07.250474    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:37:07.254124 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:37:07.254103    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:37:07.254866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:37:07.254849    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:37:07.258248 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:37:07.258231    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:38:58.007629 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.007590    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"]
Aug 04 00:38:58.008095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008072    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf26560-8657-4421-8320-a514588ad7aa" containerName="payload-processing"
Aug 04 00:38:58.008095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008087    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf26560-8657-4421-8320-a514588ad7aa" containerName="payload-processing"
Aug 04 00:38:58.008174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008098    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b69d493-35ae-437f-b3a3-d05fe4df269a" containerName="maas-api"
Aug 04 00:38:58.008174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008104    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b69d493-35ae-437f-b3a3-d05fe4df269a" containerName="maas-api"
Aug 04 00:38:58.008174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008116    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1109e5d-5e74-48cb-b143-059224c18347" containerName="payload-pre-processing"
Aug 04 00:38:58.008174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008121    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1109e5d-5e74-48cb-b143-059224c18347" containerName="payload-pre-processing"
Aug 04 00:38:58.008174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008174    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1109e5d-5e74-48cb-b143-059224c18347" containerName="payload-pre-processing"
Aug 04 00:38:58.008352 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008183    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b69d493-35ae-437f-b3a3-d05fe4df269a" containerName="maas-api"
Aug 04 00:38:58.008352 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.008190    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdf26560-8657-4421-8320-a514588ad7aa" containerName="payload-processing"
Aug 04 00:38:58.011064 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.011047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.013644 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.013613    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f4ab9294-serving-cert\""
Aug 04 00:38:58.013783 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.013661    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:38:58.013853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.013800    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:38:58.014524 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.014503    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:38:58.021902 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.021881    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"]
Aug 04 00:38:58.070327 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.070292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.070504 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.070370    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8jgs\" (UniqueName: \"kubernetes.io/projected/5b609606-b53a-4f17-8294-5bc7f5ef0f13-kube-api-access-w8jgs\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.070504 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.070399    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b609606-b53a-4f17-8294-5bc7f5ef0f13-openshift-service-ca\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.171234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.171202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8jgs\" (UniqueName: \"kubernetes.io/projected/5b609606-b53a-4f17-8294-5bc7f5ef0f13-kube-api-access-w8jgs\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.171234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.171236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b609606-b53a-4f17-8294-5bc7f5ef0f13-openshift-service-ca\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.171467 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.171260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.171467 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:38:58.171430    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-serving-cert: secret "maas-api-e2e-mt-f4ab9294-serving-cert" not found
Aug 04 00:38:58.171586 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:38:58.171500    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls podName:5b609606-b53a-4f17-8294-5bc7f5ef0f13 nodeName:}" failed. No retries permitted until 2026-08-04 00:38:58.671483521 +0000 UTC m=+2212.011519364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls") pod "maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" (UID: "5b609606-b53a-4f17-8294-5bc7f5ef0f13") : secret "maas-api-e2e-mt-f4ab9294-serving-cert" not found
Aug 04 00:38:58.171841 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.171823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b609606-b53a-4f17-8294-5bc7f5ef0f13-openshift-service-ca\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.180532 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.180510    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8jgs\" (UniqueName: \"kubernetes.io/projected/5b609606-b53a-4f17-8294-5bc7f5ef0f13-kube-api-access-w8jgs\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.675825 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.675788    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.678075 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.678047    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls\") pod \"maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.797537 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.797509    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"]
Aug 04 00:38:58.800886 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.800870    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:58.803271 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.803251    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f4ab9294\""
Aug 04 00:38:58.803400 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.803349    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f4ab9294-dockercfg-nxdpg\""
Aug 04 00:38:58.811137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.811115    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"]
Aug 04 00:38:58.856865 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.856842    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"]
Aug 04 00:38:58.859984 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.859969    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:58.870444 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.870427    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"]
Aug 04 00:38:58.876867 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.876842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwwv7\" (UniqueName: \"kubernetes.io/projected/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-kube-api-access-pwwv7\") pod \"payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:58.876978 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.876886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-plugins-config-volume\") pod \"payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:58.923000 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.922976    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:58.978457 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.978425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-plugins-config-volume\") pod \"payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:58.978610 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.978540    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwv7\" (UniqueName: \"kubernetes.io/projected/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-kube-api-access-pwwv7\") pod \"payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:58.978678 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.978647    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10540298-09a8-4b5c-9409-733154eb52b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:58.978762 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.978685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s5fp\" (UniqueName: \"kubernetes.io/projected/10540298-09a8-4b5c-9409-733154eb52b0-kube-api-access-9s5fp\") pod \"payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:58.979308 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.979283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-plugins-config-volume\") pod \"payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:58.988091 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:58.988061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwwv7\" (UniqueName: \"kubernetes.io/projected/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-kube-api-access-pwwv7\") pod \"payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:59.053291 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.053215    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"]
Aug 04 00:38:59.056007 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:38:59.055979    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b609606_b53a_4f17_8294_5bc7f5ef0f13.slice/crio-959375b489053126382a5e1607638b940c078bad87e4e77b7fdfa70696c69b1e WatchSource:0}: Error finding container 959375b489053126382a5e1607638b940c078bad87e4e77b7fdfa70696c69b1e: Status 404 returned error can't find the container with id 959375b489053126382a5e1607638b940c078bad87e4e77b7fdfa70696c69b1e
Aug 04 00:38:59.057291 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.057275    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:38:59.079091 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.079069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10540298-09a8-4b5c-9409-733154eb52b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:59.079184 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.079099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s5fp\" (UniqueName: \"kubernetes.io/projected/10540298-09a8-4b5c-9409-733154eb52b0-kube-api-access-9s5fp\") pod \"payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:59.079763 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.079740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10540298-09a8-4b5c-9409-733154eb52b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:59.086905 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.086886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s5fp\" (UniqueName: \"kubernetes.io/projected/10540298-09a8-4b5c-9409-733154eb52b0-kube-api-access-9s5fp\") pod \"payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:59.111729 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.111686    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:59.170324 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.170291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:59.309360 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.309335    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"]
Aug 04 00:38:59.312589 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:38:59.312561    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10540298_09a8_4b5c_9409_733154eb52b0.slice/crio-3ef0d7dccac30e10435ce3f623af5aefd910410421b859992c93b6e66e0c8d77 WatchSource:0}: Error finding container 3ef0d7dccac30e10435ce3f623af5aefd910410421b859992c93b6e66e0c8d77: Status 404 returned error can't find the container with id 3ef0d7dccac30e10435ce3f623af5aefd910410421b859992c93b6e66e0c8d77
Aug 04 00:38:59.459476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.459453    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"]
Aug 04 00:38:59.461598 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:38:59.461563    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29438dc_9e20_4fb0_8070_6afd0c7e81b4.slice/crio-620eea643c5e1e05c351a4526a03b92af80c6f2e870388e147f422944e40b790 WatchSource:0}: Error finding container 620eea643c5e1e05c351a4526a03b92af80c6f2e870388e147f422944e40b790: Status 404 returned error can't find the container with id 620eea643c5e1e05c351a4526a03b92af80c6f2e870388e147f422944e40b790
Aug 04 00:38:59.923996 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.923957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" event={"ID":"10540298-09a8-4b5c-9409-733154eb52b0","Type":"ContainerStarted","Data":"1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04"}
Aug 04 00:38:59.924198 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.924016    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" event={"ID":"10540298-09a8-4b5c-9409-733154eb52b0","Type":"ContainerStarted","Data":"3ef0d7dccac30e10435ce3f623af5aefd910410421b859992c93b6e66e0c8d77"}
Aug 04 00:38:59.924198 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.924076    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:38:59.925517 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.925487    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9" event={"ID":"a29438dc-9e20-4fb0-8070-6afd0c7e81b4","Type":"ContainerStarted","Data":"84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393"}
Aug 04 00:38:59.925650 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.925522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9" event={"ID":"a29438dc-9e20-4fb0-8070-6afd0c7e81b4","Type":"ContainerStarted","Data":"620eea643c5e1e05c351a4526a03b92af80c6f2e870388e147f422944e40b790"}
Aug 04 00:38:59.925650 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.925560    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:38:59.926935 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.926913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" event={"ID":"5b609606-b53a-4f17-8294-5bc7f5ef0f13","Type":"ContainerStarted","Data":"d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4"}
Aug 04 00:38:59.927059 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.926950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" event={"ID":"5b609606-b53a-4f17-8294-5bc7f5ef0f13","Type":"ContainerStarted","Data":"959375b489053126382a5e1607638b940c078bad87e4e77b7fdfa70696c69b1e"}
Aug 04 00:38:59.927115 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.927054    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:38:59.954857 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.954814    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" podStartSLOduration=1.954799059 podStartE2EDuration="1.954799059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:38:59.940042334 +0000 UTC m=+2213.280078200" watchObservedRunningTime="2026-08-04 00:38:59.954799059 +0000 UTC m=+2213.294834929"
Aug 04 00:38:59.956284 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.956247    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" podStartSLOduration=2.472820811 podStartE2EDuration="2.956238871s" totalImagesPullingTime="483.41806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:38:59.954432125 +0000 UTC m=+2213.294467990" watchObservedRunningTime="2026-08-04 00:38:59.956238871 +0000 UTC m=+2213.296274736"
Aug 04 00:38:59.969486 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:38:59.969449    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9" podStartSLOduration=1.969438155 podStartE2EDuration="1.969438155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:38:59.968829807 +0000 UTC m=+2213.308865689" watchObservedRunningTime="2026-08-04 00:38:59.969438155 +0000 UTC m=+2213.309474019"
Aug 04 00:39:05.936924 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:05.936897    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:39:10.933773 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:10.933730    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" podUID="10540298-09a8-4b5c-9409-733154eb52b0" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.48:9004: connect: connection refused"
Aug 04 00:39:10.934324 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:10.934305    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:39:20.932192 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:20.932161    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:39:56.071488 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.071460    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"]
Aug 04 00:39:56.074790 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.074769    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:39:56.077121 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.077101    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:39:56.080774 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.080748    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"]
Aug 04 00:39:56.090640 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.090617    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d09fae4-b4f9-4455-b811-545dad6b82b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk\" (UID: \"3d09fae4-b4f9-4455-b811-545dad6b82b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:39:56.191855 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.191792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d09fae4-b4f9-4455-b811-545dad6b82b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk\" (UID: \"3d09fae4-b4f9-4455-b811-545dad6b82b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:39:56.192326 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.192307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d09fae4-b4f9-4455-b811-545dad6b82b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk\" (UID: \"3d09fae4-b4f9-4455-b811-545dad6b82b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:39:56.387227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.387207    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:39:56.516583 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:56.516553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"]
Aug 04 00:39:56.520919 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:39:56.520878    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d09fae4_b4f9_4455_b811_545dad6b82b9.slice/crio-100c081191cbf9dce3e9428583a5c96b6dd2f6c78b1cc85f15db8f3d9b6b5155 WatchSource:0}: Error finding container 100c081191cbf9dce3e9428583a5c96b6dd2f6c78b1cc85f15db8f3d9b6b5155: Status 404 returned error can't find the container with id 100c081191cbf9dce3e9428583a5c96b6dd2f6c78b1cc85f15db8f3d9b6b5155
Aug 04 00:39:57.186301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:57.186264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk" event={"ID":"3d09fae4-b4f9-4455-b811-545dad6b82b9","Type":"ContainerStarted","Data":"100c081191cbf9dce3e9428583a5c96b6dd2f6c78b1cc85f15db8f3d9b6b5155"}
Aug 04 00:39:59.196287 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:59.196251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk" event={"ID":"3d09fae4-b4f9-4455-b811-545dad6b82b9","Type":"ContainerStarted","Data":"77a576c785fa43d78a1cef5605bfb33df5623ffc64ae5e8eba7dc9c946649ff9"}
Aug 04 00:39:59.211483 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:39:59.211440    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk" podStartSLOduration=1.036096755 podStartE2EDuration="3.21142322s" totalImagesPullingTime="2.175326465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:39:59.210883841 +0000 UTC m=+2272.550919727" watchObservedRunningTime="2026-08-04 00:39:59.21142322 +0000 UTC m=+2272.551459085"
Aug 04 00:40:00.201907 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:00.201877    2571 generic.go:356] "Generic (PLEG): container finished" podID="3d09fae4-b4f9-4455-b811-545dad6b82b9" containerID="77a576c785fa43d78a1cef5605bfb33df5623ffc64ae5e8eba7dc9c946649ff9" exitCode=0
Aug 04 00:40:00.202310 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:00.201964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk" event={"ID":"3d09fae4-b4f9-4455-b811-545dad6b82b9","Type":"ContainerDied","Data":"77a576c785fa43d78a1cef5605bfb33df5623ffc64ae5e8eba7dc9c946649ff9"}
Aug 04 00:40:01.337369 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:01.337339    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:40:01.437818 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:01.437790    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d09fae4-b4f9-4455-b811-545dad6b82b9-maas-api-service-ca\") pod \"3d09fae4-b4f9-4455-b811-545dad6b82b9\" (UID: \"3d09fae4-b4f9-4455-b811-545dad6b82b9\") "
Aug 04 00:40:01.438172 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:01.438145    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d09fae4-b4f9-4455-b811-545dad6b82b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d09fae4-b4f9-4455-b811-545dad6b82b9" (UID: "3d09fae4-b4f9-4455-b811-545dad6b82b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:40:01.538540 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:01.538465    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d09fae4-b4f9-4455-b811-545dad6b82b9-maas-api-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:02.212266 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:02.212233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk" event={"ID":"3d09fae4-b4f9-4455-b811-545dad6b82b9","Type":"ContainerDied","Data":"100c081191cbf9dce3e9428583a5c96b6dd2f6c78b1cc85f15db8f3d9b6b5155"}
Aug 04 00:40:02.212266 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:02.212257    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"
Aug 04 00:40:02.212495 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:02.212277    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="100c081191cbf9dce3e9428583a5c96b6dd2f6c78b1cc85f15db8f3d9b6b5155"
Aug 04 00:40:11.624600 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.624566    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"]
Aug 04 00:40:11.625031 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.624842    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" podUID="5b609606-b53a-4f17-8294-5bc7f5ef0f13" containerName="maas-api" containerID="cri-o://d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4" gracePeriod=30
Aug 04 00:40:11.678279 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.678242    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"]
Aug 04 00:40:11.678510 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.678461    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9" podUID="a29438dc-9e20-4fb0-8070-6afd0c7e81b4" containerName="payload-processing" containerID="cri-o://84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393" gracePeriod=30
Aug 04 00:40:11.685429 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.685389    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"]
Aug 04 00:40:11.685987 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.685620    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" podUID="10540298-09a8-4b5c-9409-733154eb52b0" containerName="payload-pre-processing" containerID="cri-o://1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04" gracePeriod=30
Aug 04 00:40:11.828420 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.828374    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"]
Aug 04 00:40:11.829860 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.829831    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ab9294-4j9vk"]
Aug 04 00:40:11.955760 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.955735    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:40:11.962914 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.962892    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:40:11.973314 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:11.973274    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:40:12.020846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.020819    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-plugins-config-volume\") pod \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") "
Aug 04 00:40:12.020846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.020848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10540298-09a8-4b5c-9409-733154eb52b0-plugins-config-volume\") pod \"10540298-09a8-4b5c-9409-733154eb52b0\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") "
Aug 04 00:40:12.021076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.020869    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwwv7\" (UniqueName: \"kubernetes.io/projected/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-kube-api-access-pwwv7\") pod \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\" (UID: \"a29438dc-9e20-4fb0-8070-6afd0c7e81b4\") "
Aug 04 00:40:12.021076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.020912    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b609606-b53a-4f17-8294-5bc7f5ef0f13-openshift-service-ca\") pod \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") "
Aug 04 00:40:12.021076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.020938    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls\") pod \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") "
Aug 04 00:40:12.021076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.020977    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s5fp\" (UniqueName: \"kubernetes.io/projected/10540298-09a8-4b5c-9409-733154eb52b0-kube-api-access-9s5fp\") pod \"10540298-09a8-4b5c-9409-733154eb52b0\" (UID: \"10540298-09a8-4b5c-9409-733154eb52b0\") "
Aug 04 00:40:12.021304 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021268    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a29438dc-9e20-4fb0-8070-6afd0c7e81b4" (UID: "a29438dc-9e20-4fb0-8070-6afd0c7e81b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:40:12.021370 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021319    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b609606-b53a-4f17-8294-5bc7f5ef0f13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b609606-b53a-4f17-8294-5bc7f5ef0f13" (UID: "5b609606-b53a-4f17-8294-5bc7f5ef0f13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:40:12.021370 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021323    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8jgs\" (UniqueName: \"kubernetes.io/projected/5b609606-b53a-4f17-8294-5bc7f5ef0f13-kube-api-access-w8jgs\") pod \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\" (UID: \"5b609606-b53a-4f17-8294-5bc7f5ef0f13\") "
Aug 04 00:40:12.021459 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10540298-09a8-4b5c-9409-733154eb52b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "10540298-09a8-4b5c-9409-733154eb52b0" (UID: "10540298-09a8-4b5c-9409-733154eb52b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:40:12.021674 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021639    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.021674 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021660    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10540298-09a8-4b5c-9409-733154eb52b0-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.021826 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.021674    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b609606-b53a-4f17-8294-5bc7f5ef0f13-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.023193 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.023167    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-kube-api-access-pwwv7" (OuterVolumeSpecName: "kube-api-access-pwwv7") pod "a29438dc-9e20-4fb0-8070-6afd0c7e81b4" (UID: "a29438dc-9e20-4fb0-8070-6afd0c7e81b4"). InnerVolumeSpecName "kube-api-access-pwwv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:40:12.023288 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.023202    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10540298-09a8-4b5c-9409-733154eb52b0-kube-api-access-9s5fp" (OuterVolumeSpecName: "kube-api-access-9s5fp") pod "10540298-09a8-4b5c-9409-733154eb52b0" (UID: "10540298-09a8-4b5c-9409-733154eb52b0"). InnerVolumeSpecName "kube-api-access-9s5fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:40:12.023288 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.023209    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b609606-b53a-4f17-8294-5bc7f5ef0f13-kube-api-access-w8jgs" (OuterVolumeSpecName: "kube-api-access-w8jgs") pod "5b609606-b53a-4f17-8294-5bc7f5ef0f13" (UID: "5b609606-b53a-4f17-8294-5bc7f5ef0f13"). InnerVolumeSpecName "kube-api-access-w8jgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:40:12.023457 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.023443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b609606-b53a-4f17-8294-5bc7f5ef0f13" (UID: "5b609606-b53a-4f17-8294-5bc7f5ef0f13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:40:12.122637 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.122600    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s5fp\" (UniqueName: \"kubernetes.io/projected/10540298-09a8-4b5c-9409-733154eb52b0-kube-api-access-9s5fp\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.122637 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.122632    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8jgs\" (UniqueName: \"kubernetes.io/projected/5b609606-b53a-4f17-8294-5bc7f5ef0f13-kube-api-access-w8jgs\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.122637 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.122642    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwwv7\" (UniqueName: \"kubernetes.io/projected/a29438dc-9e20-4fb0-8070-6afd0c7e81b4-kube-api-access-pwwv7\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.122900 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.122651    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b609606-b53a-4f17-8294-5bc7f5ef0f13-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:40:12.256364 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.256283    2571 generic.go:356] "Generic (PLEG): container finished" podID="10540298-09a8-4b5c-9409-733154eb52b0" containerID="1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04" exitCode=0
Aug 04 00:40:12.256364 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.256328    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"
Aug 04 00:40:12.256364 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.256356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" event={"ID":"10540298-09a8-4b5c-9409-733154eb52b0","Type":"ContainerDied","Data":"1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04"}
Aug 04 00:40:12.256600 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.256411    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95" event={"ID":"10540298-09a8-4b5c-9409-733154eb52b0","Type":"ContainerDied","Data":"3ef0d7dccac30e10435ce3f623af5aefd910410421b859992c93b6e66e0c8d77"}
Aug 04 00:40:12.256600 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.256443    2571 scope.go:117] "RemoveContainer" containerID="1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04"
Aug 04 00:40:12.257656 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.257637    2571 generic.go:356] "Generic (PLEG): container finished" podID="a29438dc-9e20-4fb0-8070-6afd0c7e81b4" containerID="84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393" exitCode=0
Aug 04 00:40:12.257765 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.257701    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"
Aug 04 00:40:12.257765 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.257719    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9" event={"ID":"a29438dc-9e20-4fb0-8070-6afd0c7e81b4","Type":"ContainerDied","Data":"84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393"}
Aug 04 00:40:12.257861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.257772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9" event={"ID":"a29438dc-9e20-4fb0-8070-6afd0c7e81b4","Type":"ContainerDied","Data":"620eea643c5e1e05c351a4526a03b92af80c6f2e870388e147f422944e40b790"}
Aug 04 00:40:12.259019 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.259001    2571 generic.go:356] "Generic (PLEG): container finished" podID="5b609606-b53a-4f17-8294-5bc7f5ef0f13" containerID="d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4" exitCode=0
Aug 04 00:40:12.259118 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.259038    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"
Aug 04 00:40:12.259180 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.259113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" event={"ID":"5b609606-b53a-4f17-8294-5bc7f5ef0f13","Type":"ContainerDied","Data":"d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4"}
Aug 04 00:40:12.259180 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.259160    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt" event={"ID":"5b609606-b53a-4f17-8294-5bc7f5ef0f13","Type":"ContainerDied","Data":"959375b489053126382a5e1607638b940c078bad87e4e77b7fdfa70696c69b1e"}
Aug 04 00:40:12.275333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.275234    2571 scope.go:117] "RemoveContainer" containerID="1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04"
Aug 04 00:40:12.275853 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:40:12.275825    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04\": container with ID starting with 1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04 not found: ID does not exist" containerID="1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04"
Aug 04 00:40:12.275963 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.275864    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04"} err="failed to get container status \"1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04\": rpc error: code = NotFound desc = could not find container \"1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04\": container with ID starting with 1d2968abb6b3d5619085d73e47b51e68801ce91d5378f8dc4c48310b2e3f1d04 not found: ID does not exist"
Aug 04 00:40:12.275963 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.275889    2571 scope.go:117] "RemoveContainer" containerID="84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393"
Aug 04 00:40:12.284083 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.284066    2571 scope.go:117] "RemoveContainer" containerID="84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393"
Aug 04 00:40:12.284325 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:40:12.284309    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393\": container with ID starting with 84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393 not found: ID does not exist" containerID="84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393"
Aug 04 00:40:12.284373 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.284333    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393"} err="failed to get container status \"84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393\": rpc error: code = NotFound desc = could not find container \"84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393\": container with ID starting with 84ca4cc7f7eb84f43b42df8017a3e0c343658951107c07f3e587ed831fe6a393 not found: ID does not exist"
Aug 04 00:40:12.284373 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.284350    2571 scope.go:117] "RemoveContainer" containerID="d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4"
Aug 04 00:40:12.290535 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.290511    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"]
Aug 04 00:40:12.292874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.292847    2571 scope.go:117] "RemoveContainer" containerID="d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4"
Aug 04 00:40:12.293103 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.293087    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ab9294-d8fb8d5d4-x4l95"]
Aug 04 00:40:12.293149 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:40:12.293128    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4\": container with ID starting with d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4 not found: ID does not exist" containerID="d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4"
Aug 04 00:40:12.293196 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.293154    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4"} err="failed to get container status \"d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4\": rpc error: code = NotFound desc = could not find container \"d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4\": container with ID starting with d7d0ef268f1b50a51aefca0952fa08674b6f11240fb1317cbcc94e1a50c448c4 not found: ID does not exist"
Aug 04 00:40:12.303407 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.303389    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"]
Aug 04 00:40:12.306952 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.306931    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ab9294-fd78c7b74-chkvt"]
Aug 04 00:40:12.317719 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.317682    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"]
Aug 04 00:40:12.321039 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:12.321016    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ab9294-796b6db54b-lw7l9"]
Aug 04 00:40:13.146189 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:13.146156    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10540298-09a8-4b5c-9409-733154eb52b0" path="/var/lib/kubelet/pods/10540298-09a8-4b5c-9409-733154eb52b0/volumes"
Aug 04 00:40:13.146671 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:13.146650    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d09fae4-b4f9-4455-b811-545dad6b82b9" path="/var/lib/kubelet/pods/3d09fae4-b4f9-4455-b811-545dad6b82b9/volumes"
Aug 04 00:40:13.147067 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:13.147048    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b609606-b53a-4f17-8294-5bc7f5ef0f13" path="/var/lib/kubelet/pods/5b609606-b53a-4f17-8294-5bc7f5ef0f13/volumes"
Aug 04 00:40:13.147410 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:40:13.147393    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a29438dc-9e20-4fb0-8070-6afd0c7e81b4" path="/var/lib/kubelet/pods/a29438dc-9e20-4fb0-8070-6afd0c7e81b4/volumes"
Aug 04 00:42:07.277078 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:07.276954    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:42:07.281543 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:07.281522    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:42:07.281874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:07.281855    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:42:07.285803 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:07.285787    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:42:11.022432 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022401    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"]
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022721    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b609606-b53a-4f17-8294-5bc7f5ef0f13" containerName="maas-api"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022733    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b609606-b53a-4f17-8294-5bc7f5ef0f13" containerName="maas-api"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022747    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29438dc-9e20-4fb0-8070-6afd0c7e81b4" containerName="payload-processing"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022753    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29438dc-9e20-4fb0-8070-6afd0c7e81b4" containerName="payload-processing"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022768    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10540298-09a8-4b5c-9409-733154eb52b0" containerName="payload-pre-processing"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022774    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="10540298-09a8-4b5c-9409-733154eb52b0" containerName="payload-pre-processing"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022787    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d09fae4-b4f9-4455-b811-545dad6b82b9" containerName="revoke-keys"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022792    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d09fae4-b4f9-4455-b811-545dad6b82b9" containerName="revoke-keys"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022846    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b609606-b53a-4f17-8294-5bc7f5ef0f13" containerName="maas-api"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022853    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="10540298-09a8-4b5c-9409-733154eb52b0" containerName="payload-pre-processing"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022859    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d09fae4-b4f9-4455-b811-545dad6b82b9" containerName="revoke-keys"
Aug 04 00:42:11.022944 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.022868    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29438dc-9e20-4fb0-8070-6afd0c7e81b4" containerName="payload-processing"
Aug 04 00:42:11.025818 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.025798    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.028204 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.028177    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-964853-serving-cert\""
Aug 04 00:42:11.028325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.028294    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:42:11.029226 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.029210    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:42:11.029302 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.029250    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:42:11.036348 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.036325    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"]
Aug 04 00:42:11.096404 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.096374    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.096404 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.096404    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc000698-3293-45e1-bc5a-7b410b73a89d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.096595 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.096467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnj9x\" (UniqueName: \"kubernetes.io/projected/dc000698-3293-45e1-bc5a-7b410b73a89d-kube-api-access-xnj9x\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.197795 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.197762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.197795 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.197796    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc000698-3293-45e1-bc5a-7b410b73a89d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.198017 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.197850    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnj9x\" (UniqueName: \"kubernetes.io/projected/dc000698-3293-45e1-bc5a-7b410b73a89d-kube-api-access-xnj9x\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.198017 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:42:11.197915    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-serving-cert: secret "maas-api-e2e-inf-a-964853-serving-cert" not found
Aug 04 00:42:11.198017 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:42:11.197985    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls podName:dc000698-3293-45e1-bc5a-7b410b73a89d nodeName:}" failed. No retries permitted until 2026-08-04 00:42:11.697969538 +0000 UTC m=+2405.038005384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls") pod "maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" (UID: "dc000698-3293-45e1-bc5a-7b410b73a89d") : secret "maas-api-e2e-inf-a-964853-serving-cert" not found
Aug 04 00:42:11.198485 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.198468    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc000698-3293-45e1-bc5a-7b410b73a89d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.214071 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.214041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnj9x\" (UniqueName: \"kubernetes.io/projected/dc000698-3293-45e1-bc5a-7b410b73a89d-kube-api-access-xnj9x\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.685789 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.685754    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"]
Aug 04 00:42:11.689094 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.689074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.691497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.691477    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-964853\""
Aug 04 00:42:11.691874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.691858    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-964853-dockercfg-j2dfk\""
Aug 04 00:42:11.700485 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.700467    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"]
Aug 04 00:42:11.700804 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.700782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jkjs\" (UniqueName: \"kubernetes.io/projected/d35b4ef8-e320-40e5-b382-daf66826d781-kube-api-access-9jkjs\") pod \"payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.700892 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.700835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.700952 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.700891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d35b4ef8-e320-40e5-b382-daf66826d781-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.703396 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.703372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls\") pod \"maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:11.707455 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.707432    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"]
Aug 04 00:42:11.710610 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.710590    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.721089 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.721016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"]
Aug 04 00:42:11.801626 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.801590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lj5\" (UniqueName: \"kubernetes.io/projected/29f068e2-80d2-488b-9d41-b7f2ee660f18-kube-api-access-j5lj5\") pod \"payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") " pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.801797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.801676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jkjs\" (UniqueName: \"kubernetes.io/projected/d35b4ef8-e320-40e5-b382-daf66826d781-kube-api-access-9jkjs\") pod \"payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.801797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.801745    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f068e2-80d2-488b-9d41-b7f2ee660f18-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") " pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.801797 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.801786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d35b4ef8-e320-40e5-b382-daf66826d781-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.802389 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.802372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d35b4ef8-e320-40e5-b382-daf66826d781-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.809131 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.809107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jkjs\" (UniqueName: \"kubernetes.io/projected/d35b4ef8-e320-40e5-b382-daf66826d781-kube-api-access-9jkjs\") pod \"payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:11.903065 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.903031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lj5\" (UniqueName: \"kubernetes.io/projected/29f068e2-80d2-488b-9d41-b7f2ee660f18-kube-api-access-j5lj5\") pod \"payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") " pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.903227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.903076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f068e2-80d2-488b-9d41-b7f2ee660f18-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") " pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.903772 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.903755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f068e2-80d2-488b-9d41-b7f2ee660f18-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") " pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.910851 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.910823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lj5\" (UniqueName: \"kubernetes.io/projected/29f068e2-80d2-488b-9d41-b7f2ee660f18-kube-api-access-j5lj5\") pod \"payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") " pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:11.937801 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:11.937717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:12.001184 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.001152    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:12.022961 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.022936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:12.086203 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.086157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"]
Aug 04 00:42:12.091792 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:42:12.091754    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc000698_3293_45e1_bc5a_7b410b73a89d.slice/crio-1487a1fc50c106380f1079870cda75fd716ba88d4c7a44345cb8c300a32ef2cf WatchSource:0}: Error finding container 1487a1fc50c106380f1079870cda75fd716ba88d4c7a44345cb8c300a32ef2cf: Status 404 returned error can't find the container with id 1487a1fc50c106380f1079870cda75fd716ba88d4c7a44345cb8c300a32ef2cf
Aug 04 00:42:12.162192 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.162094    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"]
Aug 04 00:42:12.164400 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:42:12.164372    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35b4ef8_e320_40e5_b382_daf66826d781.slice/crio-498644ac4183b35302aa0b36e259def9d5273f641acc6d521f220329c5a908d1 WatchSource:0}: Error finding container 498644ac4183b35302aa0b36e259def9d5273f641acc6d521f220329c5a908d1: Status 404 returned error can't find the container with id 498644ac4183b35302aa0b36e259def9d5273f641acc6d521f220329c5a908d1
Aug 04 00:42:12.390407 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.390246    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"]
Aug 04 00:42:12.392868 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:42:12.392833    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f068e2_80d2_488b_9d41_b7f2ee660f18.slice/crio-448e17f8ab17103f1d77fb6f044ee9d75a7f58a0ac74a42a11511a1d3d5f8fc4 WatchSource:0}: Error finding container 448e17f8ab17103f1d77fb6f044ee9d75a7f58a0ac74a42a11511a1d3d5f8fc4: Status 404 returned error can't find the container with id 448e17f8ab17103f1d77fb6f044ee9d75a7f58a0ac74a42a11511a1d3d5f8fc4
Aug 04 00:42:12.794766 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.794715    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k" event={"ID":"d35b4ef8-e320-40e5-b382-daf66826d781","Type":"ContainerStarted","Data":"e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864"}
Aug 04 00:42:12.794934 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.794783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k" event={"ID":"d35b4ef8-e320-40e5-b382-daf66826d781","Type":"ContainerStarted","Data":"498644ac4183b35302aa0b36e259def9d5273f641acc6d521f220329c5a908d1"}
Aug 04 00:42:12.794934 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.794892    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:12.796223 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.796201    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n" event={"ID":"29f068e2-80d2-488b-9d41-b7f2ee660f18","Type":"ContainerStarted","Data":"6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440"}
Aug 04 00:42:12.796336 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.796244    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n" event={"ID":"29f068e2-80d2-488b-9d41-b7f2ee660f18","Type":"ContainerStarted","Data":"448e17f8ab17103f1d77fb6f044ee9d75a7f58a0ac74a42a11511a1d3d5f8fc4"}
Aug 04 00:42:12.796336 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.796294    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:12.797529 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.797508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" event={"ID":"dc000698-3293-45e1-bc5a-7b410b73a89d","Type":"ContainerStarted","Data":"7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9"}
Aug 04 00:42:12.797616 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.797551    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" event={"ID":"dc000698-3293-45e1-bc5a-7b410b73a89d","Type":"ContainerStarted","Data":"1487a1fc50c106380f1079870cda75fd716ba88d4c7a44345cb8c300a32ef2cf"}
Aug 04 00:42:12.797616 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.797573    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:12.809492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.809454    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k" podStartSLOduration=1.8094427020000001 podStartE2EDuration="1.809442702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:12.80882826 +0000 UTC m=+2406.148864126" watchObservedRunningTime="2026-08-04 00:42:12.809442702 +0000 UTC m=+2406.149478566"
Aug 04 00:42:12.824877 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.824839    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n" podStartSLOduration=1.82482644 podStartE2EDuration="1.82482644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:12.823734152 +0000 UTC m=+2406.163770018" watchObservedRunningTime="2026-08-04 00:42:12.82482644 +0000 UTC m=+2406.164862305"
Aug 04 00:42:12.840402 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:12.840353    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" podStartSLOduration=1.255807479 podStartE2EDuration="1.840339806s" totalImagesPullingTime="584.532327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:12.838090115 +0000 UTC m=+2406.178125980" watchObservedRunningTime="2026-08-04 00:42:12.840339806 +0000 UTC m=+2406.180375671"
Aug 04 00:42:18.809208 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:18.809178    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:42:23.805820 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:23.805788    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:42:23.806220 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:23.805856    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:42:39.473967 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.473935    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"]
Aug 04 00:42:39.477938 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.477912    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.480631 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.480608    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5d4def-serving-cert\""
Aug 04 00:42:39.489639 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.489614    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"]
Aug 04 00:42:39.659055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.659012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/425ae09a-f201-4645-a8b7-6b64b7e883b5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.659249 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.659085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kzl\" (UniqueName: \"kubernetes.io/projected/425ae09a-f201-4645-a8b7-6b64b7e883b5-kube-api-access-n9kzl\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.659249 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.659157    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.759952 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.759856    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/425ae09a-f201-4645-a8b7-6b64b7e883b5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.759952 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.759919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kzl\" (UniqueName: \"kubernetes.io/projected/425ae09a-f201-4645-a8b7-6b64b7e883b5-kube-api-access-n9kzl\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.760197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.759999    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.760197 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:42:39.760121    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-serving-cert: secret "maas-api-e2e-inf-b-5d4def-serving-cert" not found
Aug 04 00:42:39.760197 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:42:39.760194    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls podName:425ae09a-f201-4645-a8b7-6b64b7e883b5 nodeName:}" failed. No retries permitted until 2026-08-04 00:42:40.260172834 +0000 UTC m=+2433.600208695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls") pod "maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" (UID: "425ae09a-f201-4645-a8b7-6b64b7e883b5") : secret "maas-api-e2e-inf-b-5d4def-serving-cert" not found
Aug 04 00:42:39.760586 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.760565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/425ae09a-f201-4645-a8b7-6b64b7e883b5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:39.768866 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:39.768845    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kzl\" (UniqueName: \"kubernetes.io/projected/425ae09a-f201-4645-a8b7-6b64b7e883b5-kube-api-access-n9kzl\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:40.139659 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.139619    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"]
Aug 04 00:42:40.143441 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.143377    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.146544 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.146526    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-5d4def-dockercfg-t5rkh\""
Aug 04 00:42:40.146897 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.146880    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-5d4def\""
Aug 04 00:42:40.154428 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.154364    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"]
Aug 04 00:42:40.199177 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.199144    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"]
Aug 04 00:42:40.202505 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.202489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.210596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.210574    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"]
Aug 04 00:42:40.263153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.263118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7075b185-42d3-4136-aebe-b0b283572480-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.263379 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.263289    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:40.263379 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.263335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7s78\" (UniqueName: \"kubernetes.io/projected/7075b185-42d3-4136-aebe-b0b283572480-kube-api-access-k7s78\") pod \"payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.265889 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.265856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:40.363834 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.363801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7075b185-42d3-4136-aebe-b0b283572480-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.364016 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.363871    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.364016 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.363902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7s78\" (UniqueName: \"kubernetes.io/projected/7075b185-42d3-4136-aebe-b0b283572480-kube-api-access-k7s78\") pod \"payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.364016 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.363927    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-kube-api-access-vvqzj\") pod \"payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.368715 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.365050    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7075b185-42d3-4136-aebe-b0b283572480-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.373564 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.373533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7s78\" (UniqueName: \"kubernetes.io/projected/7075b185-42d3-4136-aebe-b0b283572480-kube-api-access-k7s78\") pod \"payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.389956 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.389888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:40.455225 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.455194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.465559 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.464866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.465559 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.464919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-kube-api-access-vvqzj\") pod \"payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.465752 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.465671    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.477274 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.477145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-kube-api-access-vvqzj\") pod \"payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.513137 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.513104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.537719 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.536948    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"]
Aug 04 00:42:40.539900 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:42:40.539852    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425ae09a_f201_4645_a8b7_6b64b7e883b5.slice/crio-453035ea1ffc588a63bd799e5dbd7eb2e1a1997f1dd5ce3edf86a59afea33fc1 WatchSource:0}: Error finding container 453035ea1ffc588a63bd799e5dbd7eb2e1a1997f1dd5ce3edf86a59afea33fc1: Status 404 returned error can't find the container with id 453035ea1ffc588a63bd799e5dbd7eb2e1a1997f1dd5ce3edf86a59afea33fc1
Aug 04 00:42:40.611578 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.611553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"]
Aug 04 00:42:40.613429 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:42:40.613405    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7075b185_42d3_4136_aebe_b0b283572480.slice/crio-ab347c0e6a4eaecc4ccd6c8bb29ccdef3c5d2d58b210c0a8e0ad3336f05243e1 WatchSource:0}: Error finding container ab347c0e6a4eaecc4ccd6c8bb29ccdef3c5d2d58b210c0a8e0ad3336f05243e1: Status 404 returned error can't find the container with id ab347c0e6a4eaecc4ccd6c8bb29ccdef3c5d2d58b210c0a8e0ad3336f05243e1
Aug 04 00:42:40.675293 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.675228    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"]
Aug 04 00:42:40.676952 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:42:40.676925    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab2173a_bbf3_4bae_9bdc_a80029d44e65.slice/crio-2f5cdf66d6a0caed1b3fa6ed05be3a7713109a7d3eccdc57bf9857e1c83cadc1 WatchSource:0}: Error finding container 2f5cdf66d6a0caed1b3fa6ed05be3a7713109a7d3eccdc57bf9857e1c83cadc1: Status 404 returned error can't find the container with id 2f5cdf66d6a0caed1b3fa6ed05be3a7713109a7d3eccdc57bf9857e1c83cadc1
Aug 04 00:42:40.929901 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.929808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" event={"ID":"5ab2173a-bbf3-4bae-9bdc-a80029d44e65","Type":"ContainerStarted","Data":"d159213f8513d9a849c513394dcd8026a6490113d1a9fd8d442a897b5276fe46"}
Aug 04 00:42:40.929901 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.929861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" event={"ID":"5ab2173a-bbf3-4bae-9bdc-a80029d44e65","Type":"ContainerStarted","Data":"2f5cdf66d6a0caed1b3fa6ed05be3a7713109a7d3eccdc57bf9857e1c83cadc1"}
Aug 04 00:42:40.930115 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.929936    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:42:40.931407 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.931383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w" event={"ID":"7075b185-42d3-4136-aebe-b0b283572480","Type":"ContainerStarted","Data":"85732eee8ee4f99aa0f550c07996fc2008e58c19117b2f3b00740d678043cd3d"}
Aug 04 00:42:40.931530 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.931423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w" event={"ID":"7075b185-42d3-4136-aebe-b0b283572480","Type":"ContainerStarted","Data":"ab347c0e6a4eaecc4ccd6c8bb29ccdef3c5d2d58b210c0a8e0ad3336f05243e1"}
Aug 04 00:42:40.931530 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.931469    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:42:40.932647 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.932620    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" event={"ID":"425ae09a-f201-4645-a8b7-6b64b7e883b5","Type":"ContainerStarted","Data":"453035ea1ffc588a63bd799e5dbd7eb2e1a1997f1dd5ce3edf86a59afea33fc1"}
Aug 04 00:42:40.946889 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.946842    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" podStartSLOduration=0.946829297 podStartE2EDuration="946.829297ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:40.945549479 +0000 UTC m=+2434.285585346" watchObservedRunningTime="2026-08-04 00:42:40.946829297 +0000 UTC m=+2434.286865162"
Aug 04 00:42:40.964325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:40.964279    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w" podStartSLOduration=0.964261532 podStartE2EDuration="964.261532ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:40.962441231 +0000 UTC m=+2434.302477098" watchObservedRunningTime="2026-08-04 00:42:40.964261532 +0000 UTC m=+2434.304297443"
Aug 04 00:42:41.940347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:41.940312    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" event={"ID":"425ae09a-f201-4645-a8b7-6b64b7e883b5","Type":"ContainerStarted","Data":"579dcfc731ac911dc9df3b28ea9c9c94757ed8d6bb2a6d692072abe9445de5b8"}
Aug 04 00:42:41.940830 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:41.940586    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:41.958463 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:41.958417    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" podStartSLOduration=2.50738976 podStartE2EDuration="2.95839212s" totalImagesPullingTime="451.00236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:41.956635131 +0000 UTC m=+2435.296670996" watchObservedRunningTime="2026-08-04 00:42:41.95839212 +0000 UTC m=+2435.298427984"
Aug 04 00:42:47.950160 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:47.950132    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:42:51.942565 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:51.942524    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: connect: connection refused"
Aug 04 00:42:51.943036 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:42:51.942842    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:43:00.513903 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:43:00.513863    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: connect: connection refused"
Aug 04 00:43:01.940967 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:43:01.940925    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: connect: connection refused"
Aug 04 00:43:11.941940 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:43:11.941897    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:44:08.425951 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.425863    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"]
Aug 04 00:44:08.429995 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.429965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:08.432500 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.432475    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:44:08.435351 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.435321    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"]
Aug 04 00:44:08.465813 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.465783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef8a7a-a313-42e1-bc1e-2117279618b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-964853-ltc87\" (UID: \"24ef8a7a-a313-42e1-bc1e-2117279618b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:08.567147 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.567119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef8a7a-a313-42e1-bc1e-2117279618b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-964853-ltc87\" (UID: \"24ef8a7a-a313-42e1-bc1e-2117279618b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:08.567686 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.567668    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef8a7a-a313-42e1-bc1e-2117279618b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-964853-ltc87\" (UID: \"24ef8a7a-a313-42e1-bc1e-2117279618b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:08.743340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.743273    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:08.871546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:08.871520    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"]
Aug 04 00:44:08.874350 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:44:08.874326    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ef8a7a_a313_42e1_bc1e_2117279618b3.slice/crio-8de89df665026f6b909a1f4b1d59a4fc4e2c6599f5adb3db530b6f67482c52fb WatchSource:0}: Error finding container 8de89df665026f6b909a1f4b1d59a4fc4e2c6599f5adb3db530b6f67482c52fb: Status 404 returned error can't find the container with id 8de89df665026f6b909a1f4b1d59a4fc4e2c6599f5adb3db530b6f67482c52fb
Aug 04 00:44:09.356405 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:09.356311    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87" event={"ID":"24ef8a7a-a313-42e1-bc1e-2117279618b3","Type":"ContainerStarted","Data":"d0f5e1a28d4be0a0deb1e78f2caa8b934d3af060223e31fa6b000dd86bd5ff2a"}
Aug 04 00:44:09.356405 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:09.356378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87" event={"ID":"24ef8a7a-a313-42e1-bc1e-2117279618b3","Type":"ContainerStarted","Data":"8de89df665026f6b909a1f4b1d59a4fc4e2c6599f5adb3db530b6f67482c52fb"}
Aug 04 00:44:09.371279 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:09.371230    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87" podStartSLOduration=1.371208599 podStartE2EDuration="1.371208599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:44:09.371051521 +0000 UTC m=+2522.711087386" watchObservedRunningTime="2026-08-04 00:44:09.371208599 +0000 UTC m=+2522.711244466"
Aug 04 00:44:10.362141 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:10.362105    2571 generic.go:356] "Generic (PLEG): container finished" podID="24ef8a7a-a313-42e1-bc1e-2117279618b3" containerID="d0f5e1a28d4be0a0deb1e78f2caa8b934d3af060223e31fa6b000dd86bd5ff2a" exitCode=0
Aug 04 00:44:10.362572 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:10.362195    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87" event={"ID":"24ef8a7a-a313-42e1-bc1e-2117279618b3","Type":"ContainerDied","Data":"d0f5e1a28d4be0a0deb1e78f2caa8b934d3af060223e31fa6b000dd86bd5ff2a"}
Aug 04 00:44:11.502294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:11.502260    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:11.596273 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:11.596242    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef8a7a-a313-42e1-bc1e-2117279618b3-maas-api-service-ca\") pod \"24ef8a7a-a313-42e1-bc1e-2117279618b3\" (UID: \"24ef8a7a-a313-42e1-bc1e-2117279618b3\") "
Aug 04 00:44:11.596653 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:11.596633    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ef8a7a-a313-42e1-bc1e-2117279618b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24ef8a7a-a313-42e1-bc1e-2117279618b3" (UID: "24ef8a7a-a313-42e1-bc1e-2117279618b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:11.697909 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:11.697880    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef8a7a-a313-42e1-bc1e-2117279618b3-maas-api-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:12.373368 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:12.373338    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"
Aug 04 00:44:12.373368 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:12.373339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87" event={"ID":"24ef8a7a-a313-42e1-bc1e-2117279618b3","Type":"ContainerDied","Data":"8de89df665026f6b909a1f4b1d59a4fc4e2c6599f5adb3db530b6f67482c52fb"}
Aug 04 00:44:12.373625 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:12.373390    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8de89df665026f6b909a1f4b1d59a4fc4e2c6599f5adb3db530b6f67482c52fb"
Aug 04 00:44:18.871144 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:18.871101    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"]
Aug 04 00:44:18.871625 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:18.871359    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" podUID="dc000698-3293-45e1-bc5a-7b410b73a89d" containerName="maas-api" containerID="cri-o://7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9" gracePeriod=30
Aug 04 00:44:18.923553 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:18.923522    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"]
Aug 04 00:44:18.924127 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:18.923986    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n" podUID="29f068e2-80d2-488b-9d41-b7f2ee660f18" containerName="payload-processing" containerID="cri-o://6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440" gracePeriod=30
Aug 04 00:44:18.932573 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:18.932547    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"]
Aug 04 00:44:18.932843 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:18.932814    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k" podUID="d35b4ef8-e320-40e5-b382-daf66826d781" containerName="payload-pre-processing" containerID="cri-o://e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864" gracePeriod=30
Aug 04 00:44:19.079268 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.079211    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"]
Aug 04 00:44:19.088210 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.087546    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-964853-ltc87"]
Aug 04 00:44:19.146647 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.146616    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ef8a7a-a313-42e1-bc1e-2117279618b3" path="/var/lib/kubelet/pods/24ef8a7a-a313-42e1-bc1e-2117279618b3/volumes"
Aug 04 00:44:19.195460 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.195429    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:44:19.232620 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.232601    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:44:19.236915 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.236892    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:44:19.265077 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265054    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d35b4ef8-e320-40e5-b382-daf66826d781-plugins-config-volume\") pod \"d35b4ef8-e320-40e5-b382-daf66826d781\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") "
Aug 04 00:44:19.265211 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265098    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc000698-3293-45e1-bc5a-7b410b73a89d-openshift-service-ca\") pod \"dc000698-3293-45e1-bc5a-7b410b73a89d\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") "
Aug 04 00:44:19.265211 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265124    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jkjs\" (UniqueName: \"kubernetes.io/projected/d35b4ef8-e320-40e5-b382-daf66826d781-kube-api-access-9jkjs\") pod \"d35b4ef8-e320-40e5-b382-daf66826d781\" (UID: \"d35b4ef8-e320-40e5-b382-daf66826d781\") "
Aug 04 00:44:19.265211 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265144    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls\") pod \"dc000698-3293-45e1-bc5a-7b410b73a89d\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") "
Aug 04 00:44:19.265211 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265169    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnj9x\" (UniqueName: \"kubernetes.io/projected/dc000698-3293-45e1-bc5a-7b410b73a89d-kube-api-access-xnj9x\") pod \"dc000698-3293-45e1-bc5a-7b410b73a89d\" (UID: \"dc000698-3293-45e1-bc5a-7b410b73a89d\") "
Aug 04 00:44:19.265582 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265553    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d35b4ef8-e320-40e5-b382-daf66826d781-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d35b4ef8-e320-40e5-b382-daf66826d781" (UID: "d35b4ef8-e320-40e5-b382-daf66826d781"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:19.265674 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.265640    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc000698-3293-45e1-bc5a-7b410b73a89d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc000698-3293-45e1-bc5a-7b410b73a89d" (UID: "dc000698-3293-45e1-bc5a-7b410b73a89d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:19.267348 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.267317    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc000698-3293-45e1-bc5a-7b410b73a89d" (UID: "dc000698-3293-45e1-bc5a-7b410b73a89d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:44:19.267348 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.267337    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35b4ef8-e320-40e5-b382-daf66826d781-kube-api-access-9jkjs" (OuterVolumeSpecName: "kube-api-access-9jkjs") pod "d35b4ef8-e320-40e5-b382-daf66826d781" (UID: "d35b4ef8-e320-40e5-b382-daf66826d781"). InnerVolumeSpecName "kube-api-access-9jkjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:19.267481 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.267366    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc000698-3293-45e1-bc5a-7b410b73a89d-kube-api-access-xnj9x" (OuterVolumeSpecName: "kube-api-access-xnj9x") pod "dc000698-3293-45e1-bc5a-7b410b73a89d" (UID: "dc000698-3293-45e1-bc5a-7b410b73a89d"). InnerVolumeSpecName "kube-api-access-xnj9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:19.366001 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.365970    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5lj5\" (UniqueName: \"kubernetes.io/projected/29f068e2-80d2-488b-9d41-b7f2ee660f18-kube-api-access-j5lj5\") pod \"29f068e2-80d2-488b-9d41-b7f2ee660f18\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") "
Aug 04 00:44:19.366001 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366008    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f068e2-80d2-488b-9d41-b7f2ee660f18-plugins-config-volume\") pod \"29f068e2-80d2-488b-9d41-b7f2ee660f18\" (UID: \"29f068e2-80d2-488b-9d41-b7f2ee660f18\") "
Aug 04 00:44:19.366241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366228    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d35b4ef8-e320-40e5-b382-daf66826d781-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.366333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366244    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc000698-3293-45e1-bc5a-7b410b73a89d-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.366333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366252    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jkjs\" (UniqueName: \"kubernetes.io/projected/d35b4ef8-e320-40e5-b382-daf66826d781-kube-api-access-9jkjs\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.366333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366265    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc000698-3293-45e1-bc5a-7b410b73a89d-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.366333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366283    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnj9x\" (UniqueName: \"kubernetes.io/projected/dc000698-3293-45e1-bc5a-7b410b73a89d-kube-api-access-xnj9x\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.366457 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.366387    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f068e2-80d2-488b-9d41-b7f2ee660f18-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29f068e2-80d2-488b-9d41-b7f2ee660f18" (UID: "29f068e2-80d2-488b-9d41-b7f2ee660f18"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:19.368091 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.368070    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f068e2-80d2-488b-9d41-b7f2ee660f18-kube-api-access-j5lj5" (OuterVolumeSpecName: "kube-api-access-j5lj5") pod "29f068e2-80d2-488b-9d41-b7f2ee660f18" (UID: "29f068e2-80d2-488b-9d41-b7f2ee660f18"). InnerVolumeSpecName "kube-api-access-j5lj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:19.409460 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.409371    2571 generic.go:356] "Generic (PLEG): container finished" podID="d35b4ef8-e320-40e5-b382-daf66826d781" containerID="e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864" exitCode=0
Aug 04 00:44:19.409460 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.409416    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"
Aug 04 00:44:19.409714 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.409464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k" event={"ID":"d35b4ef8-e320-40e5-b382-daf66826d781","Type":"ContainerDied","Data":"e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864"}
Aug 04 00:44:19.409714 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.409522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k" event={"ID":"d35b4ef8-e320-40e5-b382-daf66826d781","Type":"ContainerDied","Data":"498644ac4183b35302aa0b36e259def9d5273f641acc6d521f220329c5a908d1"}
Aug 04 00:44:19.409714 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.409551    2571 scope.go:117] "RemoveContainer" containerID="e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864"
Aug 04 00:44:19.411955 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.411238    2571 generic.go:356] "Generic (PLEG): container finished" podID="29f068e2-80d2-488b-9d41-b7f2ee660f18" containerID="6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440" exitCode=0
Aug 04 00:44:19.411955 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.411387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n" event={"ID":"29f068e2-80d2-488b-9d41-b7f2ee660f18","Type":"ContainerDied","Data":"6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440"}
Aug 04 00:44:19.411955 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.411445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n" event={"ID":"29f068e2-80d2-488b-9d41-b7f2ee660f18","Type":"ContainerDied","Data":"448e17f8ab17103f1d77fb6f044ee9d75a7f58a0ac74a42a11511a1d3d5f8fc4"}
Aug 04 00:44:19.411955 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.411537    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"
Aug 04 00:44:19.413660 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.413625    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc000698-3293-45e1-bc5a-7b410b73a89d" containerID="7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9" exitCode=0
Aug 04 00:44:19.413813 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.413678    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"
Aug 04 00:44:19.413813 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.413735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" event={"ID":"dc000698-3293-45e1-bc5a-7b410b73a89d","Type":"ContainerDied","Data":"7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9"}
Aug 04 00:44:19.413813 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.413781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g" event={"ID":"dc000698-3293-45e1-bc5a-7b410b73a89d","Type":"ContainerDied","Data":"1487a1fc50c106380f1079870cda75fd716ba88d4c7a44345cb8c300a32ef2cf"}
Aug 04 00:44:19.421525 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.421408    2571 scope.go:117] "RemoveContainer" containerID="e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864"
Aug 04 00:44:19.421779 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:44:19.421752    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864\": container with ID starting with e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864 not found: ID does not exist" containerID="e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864"
Aug 04 00:44:19.421899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.421789    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864"} err="failed to get container status \"e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864\": rpc error: code = NotFound desc = could not find container \"e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864\": container with ID starting with e7de9d75f3eaea9c4e9b1de29ca5f289acdd3ccdc653eb945cc176a1e73da864 not found: ID does not exist"
Aug 04 00:44:19.421899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.421823    2571 scope.go:117] "RemoveContainer" containerID="6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440"
Aug 04 00:44:19.429888 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.429873    2571 scope.go:117] "RemoveContainer" containerID="6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440"
Aug 04 00:44:19.430130 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:44:19.430112    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440\": container with ID starting with 6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440 not found: ID does not exist" containerID="6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440"
Aug 04 00:44:19.430182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.430137    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440"} err="failed to get container status \"6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440\": rpc error: code = NotFound desc = could not find container \"6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440\": container with ID starting with 6d315b63f3d31652d1873b04a6ddbbc460703df3e8d6e3899fd10f772f66d440 not found: ID does not exist"
Aug 04 00:44:19.430182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.430155    2571 scope.go:117] "RemoveContainer" containerID="7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9"
Aug 04 00:44:19.437483 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.437458    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"]
Aug 04 00:44:19.437968 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.437945    2571 scope.go:117] "RemoveContainer" containerID="7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9"
Aug 04 00:44:19.438297 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:44:19.438264    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9\": container with ID starting with 7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9 not found: ID does not exist" containerID="7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9"
Aug 04 00:44:19.438399 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.438301    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9"} err="failed to get container status \"7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9\": rpc error: code = NotFound desc = could not find container \"7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9\": container with ID starting with 7667d73b2d948ef414c11dcf67fe2dfa51a2268de86d67d892305facec1640e9 not found: ID does not exist"
Aug 04 00:44:19.440379 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.440362    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-964853-8b97f95b4-2nl4k"]
Aug 04 00:44:19.450146 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.450126    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"]
Aug 04 00:44:19.452584 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.452565    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-964853-85d6d47f6-g9h5n"]
Aug 04 00:44:19.462964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.462941    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"]
Aug 04 00:44:19.467402 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.467372    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5lj5\" (UniqueName: \"kubernetes.io/projected/29f068e2-80d2-488b-9d41-b7f2ee660f18-kube-api-access-j5lj5\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.467402 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.467401    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f068e2-80d2-488b-9d41-b7f2ee660f18-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:19.469234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:19.469216    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-964853-5c7f5ccc96-k822g"]
Aug 04 00:44:21.145340 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:21.145306    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f068e2-80d2-488b-9d41-b7f2ee660f18" path="/var/lib/kubelet/pods/29f068e2-80d2-488b-9d41-b7f2ee660f18/volumes"
Aug 04 00:44:21.145753 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:21.145653    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35b4ef8-e320-40e5-b382-daf66826d781" path="/var/lib/kubelet/pods/d35b4ef8-e320-40e5-b382-daf66826d781/volumes"
Aug 04 00:44:21.146011 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:21.145998    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc000698-3293-45e1-bc5a-7b410b73a89d" path="/var/lib/kubelet/pods/dc000698-3293-45e1-bc5a-7b410b73a89d/volumes"
Aug 04 00:44:25.799189 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799156    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"]
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799497    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f068e2-80d2-488b-9d41-b7f2ee660f18" containerName="payload-processing"
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799510    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f068e2-80d2-488b-9d41-b7f2ee660f18" containerName="payload-processing"
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799521    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d35b4ef8-e320-40e5-b382-daf66826d781" containerName="payload-pre-processing"
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799527    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35b4ef8-e320-40e5-b382-daf66826d781" containerName="payload-pre-processing"
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799550    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc000698-3293-45e1-bc5a-7b410b73a89d" containerName="maas-api"
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799557    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc000698-3293-45e1-bc5a-7b410b73a89d" containerName="maas-api"
Aug 04 00:44:25.799560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799564    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ef8a7a-a313-42e1-bc1e-2117279618b3" containerName="revoke-keys"
Aug 04 00:44:25.799787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799571    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ef8a7a-a313-42e1-bc1e-2117279618b3" containerName="revoke-keys"
Aug 04 00:44:25.799787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799633    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d35b4ef8-e320-40e5-b382-daf66826d781" containerName="payload-pre-processing"
Aug 04 00:44:25.799787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799645    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f068e2-80d2-488b-9d41-b7f2ee660f18" containerName="payload-processing"
Aug 04 00:44:25.799787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799653    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc000698-3293-45e1-bc5a-7b410b73a89d" containerName="maas-api"
Aug 04 00:44:25.799787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.799660    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ef8a7a-a313-42e1-bc1e-2117279618b3" containerName="revoke-keys"
Aug 04 00:44:25.804203 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.804185    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:25.806774 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.806753    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:44:25.809423 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.809401    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"]
Aug 04 00:44:25.927026 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:25.926994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58\" (UID: \"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:26.027894 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:26.027861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58\" (UID: \"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:26.028431 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:26.028413    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58\" (UID: \"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:26.116808 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:26.116728    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:26.244463 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:26.244442    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"]
Aug 04 00:44:26.247498 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:44:26.247465    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffacb004_d1bf_4e86_b3ce_e9b41b1f9ce3.slice/crio-de6102abb8e6f3c39da53e1d1d135dd7a689c4b1f524844882f15bf1e972ac7c WatchSource:0}: Error finding container de6102abb8e6f3c39da53e1d1d135dd7a689c4b1f524844882f15bf1e972ac7c: Status 404 returned error can't find the container with id de6102abb8e6f3c39da53e1d1d135dd7a689c4b1f524844882f15bf1e972ac7c
Aug 04 00:44:26.452858 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:26.452823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58" event={"ID":"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3","Type":"ContainerStarted","Data":"de6102abb8e6f3c39da53e1d1d135dd7a689c4b1f524844882f15bf1e972ac7c"}
Aug 04 00:44:27.459012 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:27.458978    2571 generic.go:356] "Generic (PLEG): container finished" podID="ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3" containerID="fe8ef00f73844f4df6f45803a5269ffd4cfe63bbd28a82d548b0026374682bce" exitCode=0
Aug 04 00:44:27.459454 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:27.459066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58" event={"ID":"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3","Type":"ContainerDied","Data":"fe8ef00f73844f4df6f45803a5269ffd4cfe63bbd28a82d548b0026374682bce"}
Aug 04 00:44:28.598612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:28.598586    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:28.654527 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:28.654500    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3-maas-api-service-ca\") pod \"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3\" (UID: \"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3\") "
Aug 04 00:44:28.654852 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:28.654828    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3" (UID: "ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:28.755981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:28.755914    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3-maas-api-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:29.470108 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:29.470023    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"
Aug 04 00:44:29.470294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:29.470019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58" event={"ID":"ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3","Type":"ContainerDied","Data":"de6102abb8e6f3c39da53e1d1d135dd7a689c4b1f524844882f15bf1e972ac7c"}
Aug 04 00:44:29.470294 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:29.470148    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de6102abb8e6f3c39da53e1d1d135dd7a689c4b1f524844882f15bf1e972ac7c"
Aug 04 00:44:36.206033 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.205990    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"]
Aug 04 00:44:36.206542 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.206234    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" podUID="425ae09a-f201-4645-a8b7-6b64b7e883b5" containerName="maas-api" containerID="cri-o://579dcfc731ac911dc9df3b28ea9c9c94757ed8d6bb2a6d692072abe9445de5b8" gracePeriod=30
Aug 04 00:44:36.261165 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.261134    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"]
Aug 04 00:44:36.261362 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.261337    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w" podUID="7075b185-42d3-4136-aebe-b0b283572480" containerName="payload-processing" containerID="cri-o://85732eee8ee4f99aa0f550c07996fc2008e58c19117b2f3b00740d678043cd3d" gracePeriod=30
Aug 04 00:44:36.271447 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.271314    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"]
Aug 04 00:44:36.271864 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.271831    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing" containerID="cri-o://d159213f8513d9a849c513394dcd8026a6490113d1a9fd8d442a897b5276fe46" gracePeriod=30
Aug 04 00:44:36.410359 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.410294    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"]
Aug 04 00:44:36.415873 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.414672    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d4def-bfm58"]
Aug 04 00:44:36.532095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.531937    2571 generic.go:356] "Generic (PLEG): container finished" podID="425ae09a-f201-4645-a8b7-6b64b7e883b5" containerID="579dcfc731ac911dc9df3b28ea9c9c94757ed8d6bb2a6d692072abe9445de5b8" exitCode=0
Aug 04 00:44:36.532095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.531982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" event={"ID":"425ae09a-f201-4645-a8b7-6b64b7e883b5","Type":"ContainerDied","Data":"579dcfc731ac911dc9df3b28ea9c9c94757ed8d6bb2a6d692072abe9445de5b8"}
Aug 04 00:44:36.534801 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.534764    2571 generic.go:356] "Generic (PLEG): container finished" podID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerID="d159213f8513d9a849c513394dcd8026a6490113d1a9fd8d442a897b5276fe46" exitCode=0
Aug 04 00:44:36.535004 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.534851    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" event={"ID":"5ab2173a-bbf3-4bae-9bdc-a80029d44e65","Type":"ContainerDied","Data":"d159213f8513d9a849c513394dcd8026a6490113d1a9fd8d442a897b5276fe46"}
Aug 04 00:44:36.536597 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.536572    2571 generic.go:356] "Generic (PLEG): container finished" podID="7075b185-42d3-4136-aebe-b0b283572480" containerID="85732eee8ee4f99aa0f550c07996fc2008e58c19117b2f3b00740d678043cd3d" exitCode=0
Aug 04 00:44:36.536713 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.536619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w" event={"ID":"7075b185-42d3-4136-aebe-b0b283572480","Type":"ContainerDied","Data":"85732eee8ee4f99aa0f550c07996fc2008e58c19117b2f3b00740d678043cd3d"}
Aug 04 00:44:36.553841 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.553814    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:44:36.579521 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.579497    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:44:36.593329 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.593306    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:44:36.721287 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721255    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7075b185-42d3-4136-aebe-b0b283572480-plugins-config-volume\") pod \"7075b185-42d3-4136-aebe-b0b283572480\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") "
Aug 04 00:44:36.721287 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721295    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7s78\" (UniqueName: \"kubernetes.io/projected/7075b185-42d3-4136-aebe-b0b283572480-kube-api-access-k7s78\") pod \"7075b185-42d3-4136-aebe-b0b283572480\" (UID: \"7075b185-42d3-4136-aebe-b0b283572480\") "
Aug 04 00:44:36.721581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721337    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/425ae09a-f201-4645-a8b7-6b64b7e883b5-openshift-service-ca\") pod \"425ae09a-f201-4645-a8b7-6b64b7e883b5\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") "
Aug 04 00:44:36.721581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721352    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-kube-api-access-vvqzj\") pod \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") "
Aug 04 00:44:36.721581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721394    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls\") pod \"425ae09a-f201-4645-a8b7-6b64b7e883b5\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") "
Aug 04 00:44:36.721581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721415    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-plugins-config-volume\") pod \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\" (UID: \"5ab2173a-bbf3-4bae-9bdc-a80029d44e65\") "
Aug 04 00:44:36.721581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721464    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9kzl\" (UniqueName: \"kubernetes.io/projected/425ae09a-f201-4645-a8b7-6b64b7e883b5-kube-api-access-n9kzl\") pod \"425ae09a-f201-4645-a8b7-6b64b7e883b5\" (UID: \"425ae09a-f201-4645-a8b7-6b64b7e883b5\") "
Aug 04 00:44:36.721897 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721788    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7075b185-42d3-4136-aebe-b0b283572480-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7075b185-42d3-4136-aebe-b0b283572480" (UID: "7075b185-42d3-4136-aebe-b0b283572480"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:36.721954 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.721898    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/425ae09a-f201-4645-a8b7-6b64b7e883b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "425ae09a-f201-4645-a8b7-6b64b7e883b5" (UID: "425ae09a-f201-4645-a8b7-6b64b7e883b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:36.722270 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.722236    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ab2173a-bbf3-4bae-9bdc-a80029d44e65" (UID: "5ab2173a-bbf3-4bae-9bdc-a80029d44e65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:36.723708 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.723659    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "425ae09a-f201-4645-a8b7-6b64b7e883b5" (UID: "425ae09a-f201-4645-a8b7-6b64b7e883b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:44:36.723708 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.723670    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-kube-api-access-vvqzj" (OuterVolumeSpecName: "kube-api-access-vvqzj") pod "5ab2173a-bbf3-4bae-9bdc-a80029d44e65" (UID: "5ab2173a-bbf3-4bae-9bdc-a80029d44e65"). InnerVolumeSpecName "kube-api-access-vvqzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:36.723844 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.723730    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7075b185-42d3-4136-aebe-b0b283572480-kube-api-access-k7s78" (OuterVolumeSpecName: "kube-api-access-k7s78") pod "7075b185-42d3-4136-aebe-b0b283572480" (UID: "7075b185-42d3-4136-aebe-b0b283572480"). InnerVolumeSpecName "kube-api-access-k7s78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:36.723844 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.723787    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425ae09a-f201-4645-a8b7-6b64b7e883b5-kube-api-access-n9kzl" (OuterVolumeSpecName: "kube-api-access-n9kzl") pod "425ae09a-f201-4645-a8b7-6b64b7e883b5" (UID: "425ae09a-f201-4645-a8b7-6b64b7e883b5"). InnerVolumeSpecName "kube-api-access-n9kzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822822    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/425ae09a-f201-4645-a8b7-6b64b7e883b5-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822850    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-kube-api-access-vvqzj\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822864    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/425ae09a-f201-4645-a8b7-6b64b7e883b5-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822876    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab2173a-bbf3-4bae-9bdc-a80029d44e65-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822888    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9kzl\" (UniqueName: \"kubernetes.io/projected/425ae09a-f201-4645-a8b7-6b64b7e883b5-kube-api-access-n9kzl\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822899    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7075b185-42d3-4136-aebe-b0b283572480-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:36.822918 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:36.822912    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7s78\" (UniqueName: \"kubernetes.io/projected/7075b185-42d3-4136-aebe-b0b283572480-kube-api-access-k7s78\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:44:37.145483 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.145442    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3" path="/var/lib/kubelet/pods/ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3/volumes"
Aug 04 00:44:37.545582 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.545501    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"
Aug 04 00:44:37.546042 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.545503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp" event={"ID":"5ab2173a-bbf3-4bae-9bdc-a80029d44e65","Type":"ContainerDied","Data":"2f5cdf66d6a0caed1b3fa6ed05be3a7713109a7d3eccdc57bf9857e1c83cadc1"}
Aug 04 00:44:37.546042 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.545637    2571 scope.go:117] "RemoveContainer" containerID="d159213f8513d9a849c513394dcd8026a6490113d1a9fd8d442a897b5276fe46"
Aug 04 00:44:37.546981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.546834    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"
Aug 04 00:44:37.546981 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.546894    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w" event={"ID":"7075b185-42d3-4136-aebe-b0b283572480","Type":"ContainerDied","Data":"ab347c0e6a4eaecc4ccd6c8bb29ccdef3c5d2d58b210c0a8e0ad3336f05243e1"}
Aug 04 00:44:37.548315 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.548295    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn" event={"ID":"425ae09a-f201-4645-a8b7-6b64b7e883b5","Type":"ContainerDied","Data":"453035ea1ffc588a63bd799e5dbd7eb2e1a1997f1dd5ce3edf86a59afea33fc1"}
Aug 04 00:44:37.548315 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.548308    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"
Aug 04 00:44:37.555140 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.555126    2571 scope.go:117] "RemoveContainer" containerID="85732eee8ee4f99aa0f550c07996fc2008e58c19117b2f3b00740d678043cd3d"
Aug 04 00:44:37.562777 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.562760    2571 scope.go:117] "RemoveContainer" containerID="579dcfc731ac911dc9df3b28ea9c9c94757ed8d6bb2a6d692072abe9445de5b8"
Aug 04 00:44:37.568931 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.568911    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"]
Aug 04 00:44:37.574933 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.574914    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d4def-865d8d998d-pq99w"]
Aug 04 00:44:37.585393 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.585368    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"]
Aug 04 00:44:37.589210 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.589188    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5d4def-65c675d6c4-w2jvn"]
Aug 04 00:44:37.598579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.598553    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"]
Aug 04 00:44:37.600725 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:37.600706    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d4def-d9b9948d8-8q6tp"]
Aug 04 00:44:39.145746 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:39.145717    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="425ae09a-f201-4645-a8b7-6b64b7e883b5" path="/var/lib/kubelet/pods/425ae09a-f201-4645-a8b7-6b64b7e883b5/volumes"
Aug 04 00:44:39.146114 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:39.146064    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" path="/var/lib/kubelet/pods/5ab2173a-bbf3-4bae-9bdc-a80029d44e65/volumes"
Aug 04 00:44:39.146380 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:39.146367    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7075b185-42d3-4136-aebe-b0b283572480" path="/var/lib/kubelet/pods/7075b185-42d3-4136-aebe-b0b283572480/volumes"
Aug 04 00:44:48.005303 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005271    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"]
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005604    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3" containerName="revoke-keys"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005615    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3" containerName="revoke-keys"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005628    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="425ae09a-f201-4645-a8b7-6b64b7e883b5" containerName="maas-api"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005635    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="425ae09a-f201-4645-a8b7-6b64b7e883b5" containerName="maas-api"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005647    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7075b185-42d3-4136-aebe-b0b283572480" containerName="payload-processing"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005656    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7075b185-42d3-4136-aebe-b0b283572480" containerName="payload-processing"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005666    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing"
Aug 04 00:44:48.005677 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005677    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing"
Aug 04 00:44:48.005992 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005802    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7075b185-42d3-4136-aebe-b0b283572480" containerName="payload-processing"
Aug 04 00:44:48.005992 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005814    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffacb004-d1bf-4e86-b3ce-e9b41b1f9ce3" containerName="revoke-keys"
Aug 04 00:44:48.005992 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005821    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ab2173a-bbf3-4bae-9bdc-a80029d44e65" containerName="payload-pre-processing"
Aug 04 00:44:48.005992 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.005829    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="425ae09a-f201-4645-a8b7-6b64b7e883b5" containerName="maas-api"
Aug 04 00:44:48.008721 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.008706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.011065 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.011044    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:44:48.011166 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.011052    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:44:48.012108 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.012091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b26f4b-serving-cert\""
Aug 04 00:44:48.012160 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.012140    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:44:48.017496 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.017475    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"]
Aug 04 00:44:48.019855 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.019830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjr6\" (UniqueName: \"kubernetes.io/projected/1ac03f85-7c42-461a-94ae-3d1724bf0159-kube-api-access-gsjr6\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.019952 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.019901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac03f85-7c42-461a-94ae-3d1724bf0159-openshift-service-ca\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.019995 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.019961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac03f85-7c42-461a-94ae-3d1724bf0159-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.120391 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.120357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjr6\" (UniqueName: \"kubernetes.io/projected/1ac03f85-7c42-461a-94ae-3d1724bf0159-kube-api-access-gsjr6\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.120553 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.120424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac03f85-7c42-461a-94ae-3d1724bf0159-openshift-service-ca\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.120553 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.120484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac03f85-7c42-461a-94ae-3d1724bf0159-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.121095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.121075    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac03f85-7c42-461a-94ae-3d1724bf0159-openshift-service-ca\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.123007 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.122988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac03f85-7c42-461a-94ae-3d1724bf0159-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.129155 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.129131    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjr6\" (UniqueName: \"kubernetes.io/projected/1ac03f85-7c42-461a-94ae-3d1724bf0159-kube-api-access-gsjr6\") pod \"maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.319301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.319226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:48.657291 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.657101    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"]
Aug 04 00:44:48.659206 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.659182    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"]
Aug 04 00:44:48.659862 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:44:48.659836    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac03f85_7c42_461a_94ae_3d1724bf0159.slice/crio-33c8f50239e79b73514ad470ce4569e19e7e09a999a9622ffc8ed908d14e8c2d WatchSource:0}: Error finding container 33c8f50239e79b73514ad470ce4569e19e7e09a999a9622ffc8ed908d14e8c2d: Status 404 returned error can't find the container with id 33c8f50239e79b73514ad470ce4569e19e7e09a999a9622ffc8ed908d14e8c2d
Aug 04 00:44:48.666990 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.666965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.668181 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.668160    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:44:48.669795 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.669771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b26f4b-dockercfg-xj242\""
Aug 04 00:44:48.669881 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.669783    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b26f4b\""
Aug 04 00:44:48.673931 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.673909    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"]
Aug 04 00:44:48.686639 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.686618    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"]
Aug 04 00:44:48.690145 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.690126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.699213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.699191    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"]
Aug 04 00:44:48.724890 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.724865    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7452\" (UniqueName: \"kubernetes.io/projected/89334910-738b-41a8-9b4d-cf0c5057d840-kube-api-access-p7452\") pod \"payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") " pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.725019 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.724907    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a66a0859-04f2-4e44-b026-c3e015982eb4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.725019 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.724994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89334910-738b-41a8-9b4d-cf0c5057d840-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") " pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.725141 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.725056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtl5\" (UniqueName: \"kubernetes.io/projected/a66a0859-04f2-4e44-b026-c3e015982eb4-kube-api-access-smtl5\") pod \"payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.826039 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.825998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smtl5\" (UniqueName: \"kubernetes.io/projected/a66a0859-04f2-4e44-b026-c3e015982eb4-kube-api-access-smtl5\") pod \"payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.826225 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.826062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7452\" (UniqueName: \"kubernetes.io/projected/89334910-738b-41a8-9b4d-cf0c5057d840-kube-api-access-p7452\") pod \"payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") " pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.826225 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.826092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a66a0859-04f2-4e44-b026-c3e015982eb4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.826225 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.826161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89334910-738b-41a8-9b4d-cf0c5057d840-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") " pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.826945 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.826921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a66a0859-04f2-4e44-b026-c3e015982eb4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.826945 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.826937    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89334910-738b-41a8-9b4d-cf0c5057d840-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") " pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.834169 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.834117    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7452\" (UniqueName: \"kubernetes.io/projected/89334910-738b-41a8-9b4d-cf0c5057d840-kube-api-access-p7452\") pod \"payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") " pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:48.834169 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.834118    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtl5\" (UniqueName: \"kubernetes.io/projected/a66a0859-04f2-4e44-b026-c3e015982eb4-kube-api-access-smtl5\") pod \"payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:48.978804 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:48.978718    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:49.000317 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.000286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:49.127149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.127118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"]
Aug 04 00:44:49.129904 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:44:49.129879    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66a0859_04f2_4e44_b026_c3e015982eb4.slice/crio-afe1f1ecc392dc77678aa938db5a0289477179d100ea247dad5b64c1e58c1629 WatchSource:0}: Error finding container afe1f1ecc392dc77678aa938db5a0289477179d100ea247dad5b64c1e58c1629: Status 404 returned error can't find the container with id afe1f1ecc392dc77678aa938db5a0289477179d100ea247dad5b64c1e58c1629
Aug 04 00:44:49.150330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.150304    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"]
Aug 04 00:44:49.151357 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:44:49.151332    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89334910_738b_41a8_9b4d_cf0c5057d840.slice/crio-ac11d1ddd58d27317168e97e7b36552d55e7d1b35e38f8c6acf1d5588a4e8374 WatchSource:0}: Error finding container ac11d1ddd58d27317168e97e7b36552d55e7d1b35e38f8c6acf1d5588a4e8374: Status 404 returned error can't find the container with id ac11d1ddd58d27317168e97e7b36552d55e7d1b35e38f8c6acf1d5588a4e8374
Aug 04 00:44:49.607986 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.607904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z" event={"ID":"1ac03f85-7c42-461a-94ae-3d1724bf0159","Type":"ContainerStarted","Data":"75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91"}
Aug 04 00:44:49.607986 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.607958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z" event={"ID":"1ac03f85-7c42-461a-94ae-3d1724bf0159","Type":"ContainerStarted","Data":"33c8f50239e79b73514ad470ce4569e19e7e09a999a9622ffc8ed908d14e8c2d"}
Aug 04 00:44:49.608192 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.608001    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:44:49.609560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.609531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j" event={"ID":"a66a0859-04f2-4e44-b026-c3e015982eb4","Type":"ContainerStarted","Data":"ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f"}
Aug 04 00:44:49.609670 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.609581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j" event={"ID":"a66a0859-04f2-4e44-b026-c3e015982eb4","Type":"ContainerStarted","Data":"afe1f1ecc392dc77678aa938db5a0289477179d100ea247dad5b64c1e58c1629"}
Aug 04 00:44:49.609670 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.609619    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:44:49.610938 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.610908    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w" event={"ID":"89334910-738b-41a8-9b4d-cf0c5057d840","Type":"ContainerStarted","Data":"fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e"}
Aug 04 00:44:49.611049 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.610945    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w" event={"ID":"89334910-738b-41a8-9b4d-cf0c5057d840","Type":"ContainerStarted","Data":"ac11d1ddd58d27317168e97e7b36552d55e7d1b35e38f8c6acf1d5588a4e8374"}
Aug 04 00:44:49.611049 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.611038    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:44:49.625213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.625175    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z" podStartSLOduration=1.9672553179999999 podStartE2EDuration="2.625161643s" totalImagesPullingTime="657.906325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:44:49.62385701 +0000 UTC m=+2562.963892876" watchObservedRunningTime="2026-08-04 00:44:49.625161643 +0000 UTC m=+2562.965197508"
Aug 04 00:44:49.639153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.639117    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w" podStartSLOduration=1.6391043490000001 podStartE2EDuration="1.639104349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:44:49.638239085 +0000 UTC m=+2562.978274950" watchObservedRunningTime="2026-08-04 00:44:49.639104349 +0000 UTC m=+2562.979140231"
Aug 04 00:44:49.653247 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:49.653210    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j" podStartSLOduration=1.653198365 podStartE2EDuration="1.653198365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:44:49.652402055 +0000 UTC m=+2562.992437932" watchObservedRunningTime="2026-08-04 00:44:49.653198365 +0000 UTC m=+2562.993234230"
Aug 04 00:44:55.622579 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:44:55.622548    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:45:00.619129 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:00.619099    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:45:00.619749 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:00.619169    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:45:16.287281 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.287245    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"]
Aug 04 00:45:16.290940 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.290919    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.295115 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.295093    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-907df3-serving-cert\""
Aug 04 00:45:16.306365 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.306339    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"]
Aug 04 00:45:16.357522 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.357491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2qvw\" (UniqueName: \"kubernetes.io/projected/b522153f-a007-4073-8b1b-e3c8be7feab8-kube-api-access-h2qvw\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.357727 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.357526    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b522153f-a007-4073-8b1b-e3c8be7feab8-openshift-service-ca\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.357727 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.357606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b522153f-a007-4073-8b1b-e3c8be7feab8-maas-api-tls\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.458300 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.458269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2qvw\" (UniqueName: \"kubernetes.io/projected/b522153f-a007-4073-8b1b-e3c8be7feab8-kube-api-access-h2qvw\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.458300 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.458301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b522153f-a007-4073-8b1b-e3c8be7feab8-openshift-service-ca\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.458523 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.458362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b522153f-a007-4073-8b1b-e3c8be7feab8-maas-api-tls\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.459084 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.459064    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b522153f-a007-4073-8b1b-e3c8be7feab8-openshift-service-ca\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.460775 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.460757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b522153f-a007-4073-8b1b-e3c8be7feab8-maas-api-tls\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.466842 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.466814    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2qvw\" (UniqueName: \"kubernetes.io/projected/b522153f-a007-4073-8b1b-e3c8be7feab8-kube-api-access-h2qvw\") pod \"maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.600903 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.600822    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:16.730208 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.730177    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"]
Aug 04 00:45:16.731659 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:45:16.731632    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb522153f_a007_4073_8b1b_e3c8be7feab8.slice/crio-8e7d9b0c0b53545580a4b79a1c72f1ed9383f00bcc4f7db4fa4d2238e4abaf8b WatchSource:0}: Error finding container 8e7d9b0c0b53545580a4b79a1c72f1ed9383f00bcc4f7db4fa4d2238e4abaf8b: Status 404 returned error can't find the container with id 8e7d9b0c0b53545580a4b79a1c72f1ed9383f00bcc4f7db4fa4d2238e4abaf8b
Aug 04 00:45:16.742976 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.742955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb" event={"ID":"b522153f-a007-4073-8b1b-e3c8be7feab8","Type":"ContainerStarted","Data":"8e7d9b0c0b53545580a4b79a1c72f1ed9383f00bcc4f7db4fa4d2238e4abaf8b"}
Aug 04 00:45:16.900021 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.899991    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"]
Aug 04 00:45:16.904384 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.904367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:16.907170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.907148    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-907df3\""
Aug 04 00:45:16.912353 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.912068    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"]
Aug 04 00:45:16.927302 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.927281    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"]
Aug 04 00:45:16.930454 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.930435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:16.932905 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.932878    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-907df3-dockercfg-65q58\""
Aug 04 00:45:16.942154 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.942134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"]
Aug 04 00:45:16.962166 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.962135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w45b8\" (UniqueName: \"kubernetes.io/projected/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-kube-api-access-w45b8\") pod \"payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:16.962272 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:16.962217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.062886 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.062848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w45b8\" (UniqueName: \"kubernetes.io/projected/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-kube-api-access-w45b8\") pod \"payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.063063 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.062929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.063063 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.062963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-plugins-config-volume\") pod \"payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") " pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.063063 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.063043    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbz7j\" (UniqueName: \"kubernetes.io/projected/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-kube-api-access-cbz7j\") pod \"payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") " pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.063570 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.063552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.075915 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.075889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w45b8\" (UniqueName: \"kubernetes.io/projected/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-kube-api-access-w45b8\") pod \"payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.164469 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.164396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-plugins-config-volume\") pod \"payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") " pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.164469 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.164449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz7j\" (UniqueName: \"kubernetes.io/projected/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-kube-api-access-cbz7j\") pod \"payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") " pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.165076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.165056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-plugins-config-volume\") pod \"payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") " pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.171956 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.171934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbz7j\" (UniqueName: \"kubernetes.io/projected/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-kube-api-access-cbz7j\") pod \"payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") " pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.216903 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.216880    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.240806 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.240782    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.383189 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.383165    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"]
Aug 04 00:45:17.560333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.560309    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"]
Aug 04 00:45:17.563015 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:45:17.562973    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3f3e73_6f13_4a69_89bf_87108fb5e1d8.slice/crio-3413001a68574dc0c433b03b77f0bbbec8e6565ab71fca526b872a1cb09abcc1 WatchSource:0}: Error finding container 3413001a68574dc0c433b03b77f0bbbec8e6565ab71fca526b872a1cb09abcc1: Status 404 returned error can't find the container with id 3413001a68574dc0c433b03b77f0bbbec8e6565ab71fca526b872a1cb09abcc1
Aug 04 00:45:17.750751 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.750560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5" event={"ID":"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1","Type":"ContainerStarted","Data":"eff224cb07a645f601b08480aef63697f6ba14deff4f573c25730b1509d58442"}
Aug 04 00:45:17.750751 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.750633    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5" event={"ID":"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1","Type":"ContainerStarted","Data":"a589ccb0d70e6fb76f5d6fb37c9c2d43860d35a4d4a63667334282e74b002a2a"}
Aug 04 00:45:17.750751 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.750714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:17.752316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.752275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb" event={"ID":"b522153f-a007-4073-8b1b-e3c8be7feab8","Type":"ContainerStarted","Data":"ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9"}
Aug 04 00:45:17.752453 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.752341    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:17.753961 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.753940    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2" event={"ID":"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8","Type":"ContainerStarted","Data":"3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a"}
Aug 04 00:45:17.754067 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.753975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2" event={"ID":"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8","Type":"ContainerStarted","Data":"3413001a68574dc0c433b03b77f0bbbec8e6565ab71fca526b872a1cb09abcc1"}
Aug 04 00:45:17.754106 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.754090    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:17.766112 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.766071    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5" podStartSLOduration=1.766055643 podStartE2EDuration="1.766055643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:45:17.764920405 +0000 UTC m=+2591.104956274" watchObservedRunningTime="2026-08-04 00:45:17.766055643 +0000 UTC m=+2591.106091485"
Aug 04 00:45:17.780611 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.780565    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2" podStartSLOduration=1.780548695 podStartE2EDuration="1.780548695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:45:17.779607815 +0000 UTC m=+2591.119643679" watchObservedRunningTime="2026-08-04 00:45:17.780548695 +0000 UTC m=+2591.120584560"
Aug 04 00:45:17.798379 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:17.798337    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb" podStartSLOduration=1.106038337 podStartE2EDuration="1.798318806s" totalImagesPullingTime="692.280469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:45:17.79720277 +0000 UTC m=+2591.137238635" watchObservedRunningTime="2026-08-04 00:45:17.798318806 +0000 UTC m=+2591.138354671"
Aug 04 00:45:23.765913 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:23.765883    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:45:28.762736 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:28.762709    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:45:28.763203 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:28.762836    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:45:58.221380 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.221348    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"]
Aug 04 00:45:58.221921 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.221588    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z" podUID="1ac03f85-7c42-461a-94ae-3d1724bf0159" containerName="maas-api" containerID="cri-o://75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91" gracePeriod=30
Aug 04 00:45:58.279321 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.279286    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"]
Aug 04 00:45:58.279567 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.279540    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w" podUID="89334910-738b-41a8-9b4d-cf0c5057d840" containerName="payload-processing" containerID="cri-o://fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e" gracePeriod=30
Aug 04 00:45:58.289120 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.289091    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"]
Aug 04 00:45:58.289606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.289341    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j" podUID="a66a0859-04f2-4e44-b026-c3e015982eb4" containerName="payload-pre-processing" containerID="cri-o://ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f" gracePeriod=30
Aug 04 00:45:58.532953 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.532925    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:45:58.591330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.591304    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:45:58.603551 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.603529    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:45:58.617733 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.617712    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac03f85-7c42-461a-94ae-3d1724bf0159-openshift-service-ca\") pod \"1ac03f85-7c42-461a-94ae-3d1724bf0159\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") "
Aug 04 00:45:58.617829 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.617805    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsjr6\" (UniqueName: \"kubernetes.io/projected/1ac03f85-7c42-461a-94ae-3d1724bf0159-kube-api-access-gsjr6\") pod \"1ac03f85-7c42-461a-94ae-3d1724bf0159\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") "
Aug 04 00:45:58.617889 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.617828    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac03f85-7c42-461a-94ae-3d1724bf0159-maas-api-tls\") pod \"1ac03f85-7c42-461a-94ae-3d1724bf0159\" (UID: \"1ac03f85-7c42-461a-94ae-3d1724bf0159\") "
Aug 04 00:45:58.618038 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.618019    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac03f85-7c42-461a-94ae-3d1724bf0159-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ac03f85-7c42-461a-94ae-3d1724bf0159" (UID: "1ac03f85-7c42-461a-94ae-3d1724bf0159"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:45:58.619877 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.619853    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac03f85-7c42-461a-94ae-3d1724bf0159-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ac03f85-7c42-461a-94ae-3d1724bf0159" (UID: "1ac03f85-7c42-461a-94ae-3d1724bf0159"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:45:58.619963 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.619936    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac03f85-7c42-461a-94ae-3d1724bf0159-kube-api-access-gsjr6" (OuterVolumeSpecName: "kube-api-access-gsjr6") pod "1ac03f85-7c42-461a-94ae-3d1724bf0159" (UID: "1ac03f85-7c42-461a-94ae-3d1724bf0159"). InnerVolumeSpecName "kube-api-access-gsjr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:45:58.718893 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.718855    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a66a0859-04f2-4e44-b026-c3e015982eb4-plugins-config-volume\") pod \"a66a0859-04f2-4e44-b026-c3e015982eb4\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") "
Aug 04 00:45:58.718893 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.718898    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89334910-738b-41a8-9b4d-cf0c5057d840-plugins-config-volume\") pod \"89334910-738b-41a8-9b4d-cf0c5057d840\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") "
Aug 04 00:45:58.719095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.718965    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7452\" (UniqueName: \"kubernetes.io/projected/89334910-738b-41a8-9b4d-cf0c5057d840-kube-api-access-p7452\") pod \"89334910-738b-41a8-9b4d-cf0c5057d840\" (UID: \"89334910-738b-41a8-9b4d-cf0c5057d840\") "
Aug 04 00:45:58.719095 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.718994    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smtl5\" (UniqueName: \"kubernetes.io/projected/a66a0859-04f2-4e44-b026-c3e015982eb4-kube-api-access-smtl5\") pod \"a66a0859-04f2-4e44-b026-c3e015982eb4\" (UID: \"a66a0859-04f2-4e44-b026-c3e015982eb4\") "
Aug 04 00:45:58.719276 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.719258    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsjr6\" (UniqueName: \"kubernetes.io/projected/1ac03f85-7c42-461a-94ae-3d1724bf0159-kube-api-access-gsjr6\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.719317 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.719285    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac03f85-7c42-461a-94ae-3d1724bf0159-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.719317 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.719300    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac03f85-7c42-461a-94ae-3d1724bf0159-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.719317 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.719307    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a66a0859-04f2-4e44-b026-c3e015982eb4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a66a0859-04f2-4e44-b026-c3e015982eb4" (UID: "a66a0859-04f2-4e44-b026-c3e015982eb4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:45:58.719420 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.719378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89334910-738b-41a8-9b4d-cf0c5057d840-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89334910-738b-41a8-9b4d-cf0c5057d840" (UID: "89334910-738b-41a8-9b4d-cf0c5057d840"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:45:58.721100 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.721072    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89334910-738b-41a8-9b4d-cf0c5057d840-kube-api-access-p7452" (OuterVolumeSpecName: "kube-api-access-p7452") pod "89334910-738b-41a8-9b4d-cf0c5057d840" (UID: "89334910-738b-41a8-9b4d-cf0c5057d840"). InnerVolumeSpecName "kube-api-access-p7452". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:45:58.721209 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.721136    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66a0859-04f2-4e44-b026-c3e015982eb4-kube-api-access-smtl5" (OuterVolumeSpecName: "kube-api-access-smtl5") pod "a66a0859-04f2-4e44-b026-c3e015982eb4" (UID: "a66a0859-04f2-4e44-b026-c3e015982eb4"). InnerVolumeSpecName "kube-api-access-smtl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:45:58.820497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.820407    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7452\" (UniqueName: \"kubernetes.io/projected/89334910-738b-41a8-9b4d-cf0c5057d840-kube-api-access-p7452\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.820497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.820435    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smtl5\" (UniqueName: \"kubernetes.io/projected/a66a0859-04f2-4e44-b026-c3e015982eb4-kube-api-access-smtl5\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.820497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.820445    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a66a0859-04f2-4e44-b026-c3e015982eb4-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.820497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.820456    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89334910-738b-41a8-9b4d-cf0c5057d840-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:45:58.964556 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.964523    2571 generic.go:356] "Generic (PLEG): container finished" podID="1ac03f85-7c42-461a-94ae-3d1724bf0159" containerID="75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91" exitCode=0
Aug 04 00:45:58.964766 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.964569    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"
Aug 04 00:45:58.964766 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.964610    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z" event={"ID":"1ac03f85-7c42-461a-94ae-3d1724bf0159","Type":"ContainerDied","Data":"75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91"}
Aug 04 00:45:58.964766 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.964673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z" event={"ID":"1ac03f85-7c42-461a-94ae-3d1724bf0159","Type":"ContainerDied","Data":"33c8f50239e79b73514ad470ce4569e19e7e09a999a9622ffc8ed908d14e8c2d"}
Aug 04 00:45:58.964766 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.964720    2571 scope.go:117] "RemoveContainer" containerID="75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91"
Aug 04 00:45:58.965846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.965803    2571 generic.go:356] "Generic (PLEG): container finished" podID="a66a0859-04f2-4e44-b026-c3e015982eb4" containerID="ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f" exitCode=0
Aug 04 00:45:58.965846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.965839    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"
Aug 04 00:45:58.965976 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.965886    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j" event={"ID":"a66a0859-04f2-4e44-b026-c3e015982eb4","Type":"ContainerDied","Data":"ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f"}
Aug 04 00:45:58.965976 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.965933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j" event={"ID":"a66a0859-04f2-4e44-b026-c3e015982eb4","Type":"ContainerDied","Data":"afe1f1ecc392dc77678aa938db5a0289477179d100ea247dad5b64c1e58c1629"}
Aug 04 00:45:58.967170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.967152    2571 generic.go:356] "Generic (PLEG): container finished" podID="89334910-738b-41a8-9b4d-cf0c5057d840" containerID="fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e" exitCode=0
Aug 04 00:45:58.967270 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.967181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w" event={"ID":"89334910-738b-41a8-9b4d-cf0c5057d840","Type":"ContainerDied","Data":"fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e"}
Aug 04 00:45:58.967270 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.967232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w" event={"ID":"89334910-738b-41a8-9b4d-cf0c5057d840","Type":"ContainerDied","Data":"ac11d1ddd58d27317168e97e7b36552d55e7d1b35e38f8c6acf1d5588a4e8374"}
Aug 04 00:45:58.967270 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.967189    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"
Aug 04 00:45:58.975589 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.975567    2571 scope.go:117] "RemoveContainer" containerID="75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91"
Aug 04 00:45:58.975888 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:45:58.975871    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91\": container with ID starting with 75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91 not found: ID does not exist" containerID="75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91"
Aug 04 00:45:58.975972 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.975897    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91"} err="failed to get container status \"75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91\": rpc error: code = NotFound desc = could not find container \"75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91\": container with ID starting with 75bbccb0f11803f9aa186fe07c2ad488c3a96c3afead5844784c9c985535eb91 not found: ID does not exist"
Aug 04 00:45:58.975972 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.975919    2571 scope.go:117] "RemoveContainer" containerID="ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f"
Aug 04 00:45:58.984260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.984244    2571 scope.go:117] "RemoveContainer" containerID="ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f"
Aug 04 00:45:58.984495 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:45:58.984477    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f\": container with ID starting with ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f not found: ID does not exist" containerID="ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f"
Aug 04 00:45:58.984542 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.984502    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f"} err="failed to get container status \"ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f\": rpc error: code = NotFound desc = could not find container \"ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f\": container with ID starting with ee281a11b0b5d11e0e62f5fa7cf31f3469ab894a7a6eb84e007b3c1918b7f73f not found: ID does not exist"
Aug 04 00:45:58.984542 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.984518    2571 scope.go:117] "RemoveContainer" containerID="fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e"
Aug 04 00:45:58.991486 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.991463    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"]
Aug 04 00:45:58.992381 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.992361    2571 scope.go:117] "RemoveContainer" containerID="fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e"
Aug 04 00:45:58.992640 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:45:58.992623    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e\": container with ID starting with fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e not found: ID does not exist" containerID="fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e"
Aug 04 00:45:58.992718 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.992646    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e"} err="failed to get container status \"fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e\": rpc error: code = NotFound desc = could not find container \"fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e\": container with ID starting with fab33043662bf016a989d76c2bab4428f746adbe19b1c2058b97cf74fe11a86e not found: ID does not exist"
Aug 04 00:45:58.997780 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:58.997760    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f4b-79549b697b-t9w7z"]
Aug 04 00:45:59.007136 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.007115    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"]
Aug 04 00:45:59.012448 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.012430    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b26f4b-7899bcf4bd-j298w"]
Aug 04 00:45:59.022174 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.022154    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"]
Aug 04 00:45:59.027983 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.027964    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b26f4b-58f7ff788-t2d5j"]
Aug 04 00:45:59.145119 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.145090    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac03f85-7c42-461a-94ae-3d1724bf0159" path="/var/lib/kubelet/pods/1ac03f85-7c42-461a-94ae-3d1724bf0159/volumes"
Aug 04 00:45:59.145499 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.145484    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89334910-738b-41a8-9b4d-cf0c5057d840" path="/var/lib/kubelet/pods/89334910-738b-41a8-9b4d-cf0c5057d840/volumes"
Aug 04 00:45:59.145869 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:45:59.145856    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a66a0859-04f2-4e44-b026-c3e015982eb4" path="/var/lib/kubelet/pods/a66a0859-04f2-4e44-b026-c3e015982eb4/volumes"
Aug 04 00:46:05.139073 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139041    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"]
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139358    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66a0859-04f2-4e44-b026-c3e015982eb4" containerName="payload-pre-processing"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139370    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66a0859-04f2-4e44-b026-c3e015982eb4" containerName="payload-pre-processing"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139386    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89334910-738b-41a8-9b4d-cf0c5057d840" containerName="payload-processing"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139392    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="89334910-738b-41a8-9b4d-cf0c5057d840" containerName="payload-processing"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139407    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac03f85-7c42-461a-94ae-3d1724bf0159" containerName="maas-api"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139413    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac03f85-7c42-461a-94ae-3d1724bf0159" containerName="maas-api"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139465    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac03f85-7c42-461a-94ae-3d1724bf0159" containerName="maas-api"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139476    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="89334910-738b-41a8-9b4d-cf0c5057d840" containerName="payload-processing"
Aug 04 00:46:05.139658 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.139482    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66a0859-04f2-4e44-b026-c3e015982eb4" containerName="payload-pre-processing"
Aug 04 00:46:05.144087 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.144061    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:05.146341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.146321    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:46:05.151651 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.151624    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"]
Aug 04 00:46:05.276887 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.276851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baaa909d-f459-4530-88f5-187ad532d9af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-907df3-5z46b\" (UID: \"baaa909d-f459-4530-88f5-187ad532d9af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:05.378264 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.378231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baaa909d-f459-4530-88f5-187ad532d9af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-907df3-5z46b\" (UID: \"baaa909d-f459-4530-88f5-187ad532d9af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:05.378861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.378844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baaa909d-f459-4530-88f5-187ad532d9af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-907df3-5z46b\" (UID: \"baaa909d-f459-4530-88f5-187ad532d9af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:05.460076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.459989    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:05.589544 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:05.589521    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"]
Aug 04 00:46:05.591617 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:46:05.591589    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaaa909d_f459_4530_88f5_187ad532d9af.slice/crio-f7efecd03285dc8bc6ddad2d1ccc0928902f2a3a8751c52ef10791b492964b74 WatchSource:0}: Error finding container f7efecd03285dc8bc6ddad2d1ccc0928902f2a3a8751c52ef10791b492964b74: Status 404 returned error can't find the container with id f7efecd03285dc8bc6ddad2d1ccc0928902f2a3a8751c52ef10791b492964b74
Aug 04 00:46:06.011239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:06.011149    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b" event={"ID":"baaa909d-f459-4530-88f5-187ad532d9af","Type":"ContainerStarted","Data":"f234ebf41f5da34256b587a09cf5d81a4c95d1fdb9dd7423c938f7b508ff495f"}
Aug 04 00:46:06.011239 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:06.011204    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b" event={"ID":"baaa909d-f459-4530-88f5-187ad532d9af","Type":"ContainerStarted","Data":"f7efecd03285dc8bc6ddad2d1ccc0928902f2a3a8751c52ef10791b492964b74"}
Aug 04 00:46:06.027303 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:06.027258    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b" podStartSLOduration=1.027241794 podStartE2EDuration="1.027241794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:46:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:46:06.025326792 +0000 UTC m=+2639.365362658" watchObservedRunningTime="2026-08-04 00:46:06.027241794 +0000 UTC m=+2639.367277659"
Aug 04 00:46:07.016900 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:07.016868    2571 generic.go:356] "Generic (PLEG): container finished" podID="baaa909d-f459-4530-88f5-187ad532d9af" containerID="f234ebf41f5da34256b587a09cf5d81a4c95d1fdb9dd7423c938f7b508ff495f" exitCode=0
Aug 04 00:46:07.016900 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:07.016904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b" event={"ID":"baaa909d-f459-4530-88f5-187ad532d9af","Type":"ContainerDied","Data":"f234ebf41f5da34256b587a09cf5d81a4c95d1fdb9dd7423c938f7b508ff495f"}
Aug 04 00:46:07.440612 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:07.440583    2571 scope.go:117] "RemoveContainer" containerID="77a576c785fa43d78a1cef5605bfb33df5623ffc64ae5e8eba7dc9c946649ff9"
Aug 04 00:46:08.151290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:08.151258    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:08.302636 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:08.302545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baaa909d-f459-4530-88f5-187ad532d9af-maas-api-service-ca\") pod \"baaa909d-f459-4530-88f5-187ad532d9af\" (UID: \"baaa909d-f459-4530-88f5-187ad532d9af\") "
Aug 04 00:46:08.302937 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:08.302914    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baaa909d-f459-4530-88f5-187ad532d9af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "baaa909d-f459-4530-88f5-187ad532d9af" (UID: "baaa909d-f459-4530-88f5-187ad532d9af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:46:08.404114 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:08.404082    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baaa909d-f459-4530-88f5-187ad532d9af-maas-api-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:09.026713 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:09.026657    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b" event={"ID":"baaa909d-f459-4530-88f5-187ad532d9af","Type":"ContainerDied","Data":"f7efecd03285dc8bc6ddad2d1ccc0928902f2a3a8751c52ef10791b492964b74"}
Aug 04 00:46:09.026861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:09.026740    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7efecd03285dc8bc6ddad2d1ccc0928902f2a3a8751c52ef10791b492964b74"
Aug 04 00:46:09.026861 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:09.026670    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"
Aug 04 00:46:20.739086 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.739044    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"]
Aug 04 00:46:20.739497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.739252    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb" podUID="b522153f-a007-4073-8b1b-e3c8be7feab8" containerName="maas-api" containerID="cri-o://ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9" gracePeriod=30
Aug 04 00:46:20.792595 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.792561    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"]
Aug 04 00:46:20.792830 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.792793    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5" podUID="4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" containerName="payload-processing" containerID="cri-o://eff224cb07a645f601b08480aef63697f6ba14deff4f573c25730b1509d58442" gracePeriod=30
Aug 04 00:46:20.798345 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.798310    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"]
Aug 04 00:46:20.798547 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.798526    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2" podUID="0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" containerName="payload-pre-processing" containerID="cri-o://3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a" gracePeriod=30
Aug 04 00:46:20.943241 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.943201    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"]
Aug 04 00:46:20.946994 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:20.946964    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-907df3-5z46b"]
Aug 04 00:46:21.062278 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.062243    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:46:21.084734 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.084706    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:46:21.085682 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.085654    2571 generic.go:356] "Generic (PLEG): container finished" podID="0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" containerID="3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a" exitCode=0
Aug 04 00:46:21.085835 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.085756    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2" event={"ID":"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8","Type":"ContainerDied","Data":"3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a"}
Aug 04 00:46:21.085835 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.085822    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2" event={"ID":"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8","Type":"ContainerDied","Data":"3413001a68574dc0c433b03b77f0bbbec8e6565ab71fca526b872a1cb09abcc1"}
Aug 04 00:46:21.085945 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.085849    2571 scope.go:117] "RemoveContainer" containerID="3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a"
Aug 04 00:46:21.087518 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.087409    2571 generic.go:356] "Generic (PLEG): container finished" podID="4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" containerID="eff224cb07a645f601b08480aef63697f6ba14deff4f573c25730b1509d58442" exitCode=0
Aug 04 00:46:21.087518 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.087444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5" event={"ID":"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1","Type":"ContainerDied","Data":"eff224cb07a645f601b08480aef63697f6ba14deff4f573c25730b1509d58442"}
Aug 04 00:46:21.089024 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.089006    2571 generic.go:356] "Generic (PLEG): container finished" podID="b522153f-a007-4073-8b1b-e3c8be7feab8" containerID="ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9" exitCode=0
Aug 04 00:46:21.089120 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.089061    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"
Aug 04 00:46:21.089120 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.089106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb" event={"ID":"b522153f-a007-4073-8b1b-e3c8be7feab8","Type":"ContainerDied","Data":"ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9"}
Aug 04 00:46:21.089219 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.089146    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb" event={"ID":"b522153f-a007-4073-8b1b-e3c8be7feab8","Type":"ContainerDied","Data":"8e7d9b0c0b53545580a4b79a1c72f1ed9383f00bcc4f7db4fa4d2238e4abaf8b"}
Aug 04 00:46:21.093910 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.093890    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:46:21.099076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.099060    2571 scope.go:117] "RemoveContainer" containerID="3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a"
Aug 04 00:46:21.099350 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:46:21.099326    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a\": container with ID starting with 3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a not found: ID does not exist" containerID="3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a"
Aug 04 00:46:21.099420 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.099354    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a"} err="failed to get container status \"3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a\": rpc error: code = NotFound desc = could not find container \"3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a\": container with ID starting with 3d1b95da147812e6fddd8c296af4a3cc46d447d20e28e21ef53a7c8fda726b1a not found: ID does not exist"
Aug 04 00:46:21.099420 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.099372    2571 scope.go:117] "RemoveContainer" containerID="ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9"
Aug 04 00:46:21.108975 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.108948    2571 scope.go:117] "RemoveContainer" containerID="ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9"
Aug 04 00:46:21.109337 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:46:21.109265    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9\": container with ID starting with ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9 not found: ID does not exist" containerID="ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9"
Aug 04 00:46:21.109337 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.109297    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9"} err="failed to get container status \"ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9\": rpc error: code = NotFound desc = could not find container \"ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9\": container with ID starting with ebe3f7d87a3986c0e6330355b115dcc08643dfdd181e1fc0e55ac2cf91d4bdc9 not found: ID does not exist"
Aug 04 00:46:21.145113 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.145083    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baaa909d-f459-4530-88f5-187ad532d9af" path="/var/lib/kubelet/pods/baaa909d-f459-4530-88f5-187ad532d9af/volumes"
Aug 04 00:46:21.216706 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216673    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b522153f-a007-4073-8b1b-e3c8be7feab8-openshift-service-ca\") pod \"b522153f-a007-4073-8b1b-e3c8be7feab8\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") "
Aug 04 00:46:21.216871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216770    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b522153f-a007-4073-8b1b-e3c8be7feab8-maas-api-tls\") pod \"b522153f-a007-4073-8b1b-e3c8be7feab8\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") "
Aug 04 00:46:21.216871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216797    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w45b8\" (UniqueName: \"kubernetes.io/projected/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-kube-api-access-w45b8\") pod \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") "
Aug 04 00:46:21.216871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216822    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbz7j\" (UniqueName: \"kubernetes.io/projected/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-kube-api-access-cbz7j\") pod \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") "
Aug 04 00:46:21.216871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216843    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-plugins-config-volume\") pod \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\" (UID: \"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1\") "
Aug 04 00:46:21.216871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-plugins-config-volume\") pod \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\" (UID: \"0c3f3e73-6f13-4a69-89bf-87108fb5e1d8\") "
Aug 04 00:46:21.217136 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.216884    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2qvw\" (UniqueName: \"kubernetes.io/projected/b522153f-a007-4073-8b1b-e3c8be7feab8-kube-api-access-h2qvw\") pod \"b522153f-a007-4073-8b1b-e3c8be7feab8\" (UID: \"b522153f-a007-4073-8b1b-e3c8be7feab8\") "
Aug 04 00:46:21.217220 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.217090    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b522153f-a007-4073-8b1b-e3c8be7feab8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b522153f-a007-4073-8b1b-e3c8be7feab8" (UID: "b522153f-a007-4073-8b1b-e3c8be7feab8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:46:21.217341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.217306    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" (UID: "0c3f3e73-6f13-4a69-89bf-87108fb5e1d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:46:21.217341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.217314    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" (UID: "4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:46:21.219085 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.219057    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-kube-api-access-w45b8" (OuterVolumeSpecName: "kube-api-access-w45b8") pod "0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" (UID: "0c3f3e73-6f13-4a69-89bf-87108fb5e1d8"). InnerVolumeSpecName "kube-api-access-w45b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:21.219165 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.219089    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-kube-api-access-cbz7j" (OuterVolumeSpecName: "kube-api-access-cbz7j") pod "4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" (UID: "4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1"). InnerVolumeSpecName "kube-api-access-cbz7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:21.219451 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.219437    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b522153f-a007-4073-8b1b-e3c8be7feab8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b522153f-a007-4073-8b1b-e3c8be7feab8" (UID: "b522153f-a007-4073-8b1b-e3c8be7feab8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:46:21.219511 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.219444    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b522153f-a007-4073-8b1b-e3c8be7feab8-kube-api-access-h2qvw" (OuterVolumeSpecName: "kube-api-access-h2qvw") pod "b522153f-a007-4073-8b1b-e3c8be7feab8" (UID: "b522153f-a007-4073-8b1b-e3c8be7feab8"). InnerVolumeSpecName "kube-api-access-h2qvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317798    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b522153f-a007-4073-8b1b-e3c8be7feab8-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317825    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b522153f-a007-4073-8b1b-e3c8be7feab8-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317834    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w45b8\" (UniqueName: \"kubernetes.io/projected/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-kube-api-access-w45b8\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317844    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbz7j\" (UniqueName: \"kubernetes.io/projected/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-kube-api-access-cbz7j\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317853    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317862    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.317884 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.317871    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2qvw\" (UniqueName: \"kubernetes.io/projected/b522153f-a007-4073-8b1b-e3c8be7feab8-kube-api-access-h2qvw\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:46:21.409802 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.409770    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"]
Aug 04 00:46:21.414733 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:21.414708    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-907df3-59d8f9b796-l2rvb"]
Aug 04 00:46:22.094680 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.094598    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"
Aug 04 00:46:22.094680 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.094605    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5" event={"ID":"4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1","Type":"ContainerDied","Data":"a589ccb0d70e6fb76f5d6fb37c9c2d43860d35a4d4a63667334282e74b002a2a"}
Aug 04 00:46:22.094680 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.094669    2571 scope.go:117] "RemoveContainer" containerID="eff224cb07a645f601b08480aef63697f6ba14deff4f573c25730b1509d58442"
Aug 04 00:46:22.096637 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.096618    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"
Aug 04 00:46:22.121186 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.121158    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"]
Aug 04 00:46:22.128999 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.126029    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-907df3-5b69595668-42xq2"]
Aug 04 00:46:22.134390 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.134366    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"]
Aug 04 00:46:22.138060 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:22.138038    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-907df3-b7fc49bdd-nm8n5"]
Aug 04 00:46:23.145472 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:23.145441    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" path="/var/lib/kubelet/pods/0c3f3e73-6f13-4a69-89bf-87108fb5e1d8/volumes"
Aug 04 00:46:23.145859 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:23.145791    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" path="/var/lib/kubelet/pods/4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1/volumes"
Aug 04 00:46:23.146130 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:23.146117    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b522153f-a007-4073-8b1b-e3c8be7feab8" path="/var/lib/kubelet/pods/b522153f-a007-4073-8b1b-e3c8be7feab8/volumes"
Aug 04 00:46:31.777227 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777194    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"]
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777536    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b522153f-a007-4073-8b1b-e3c8be7feab8" containerName="maas-api"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777547    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b522153f-a007-4073-8b1b-e3c8be7feab8" containerName="maas-api"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777563    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baaa909d-f459-4530-88f5-187ad532d9af" containerName="revoke-keys"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777568    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="baaa909d-f459-4530-88f5-187ad532d9af" containerName="revoke-keys"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777581    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" containerName="payload-processing"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777587    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" containerName="payload-processing"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777601    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" containerName="payload-pre-processing"
Aug 04 00:46:31.777614 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777610    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" containerName="payload-pre-processing"
Aug 04 00:46:31.777899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777661    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4503360f-8f9a-4fe6-ab7f-8cac0f7c94c1" containerName="payload-processing"
Aug 04 00:46:31.777899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777669    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c3f3e73-6f13-4a69-89bf-87108fb5e1d8" containerName="payload-pre-processing"
Aug 04 00:46:31.777899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777678    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="baaa909d-f459-4530-88f5-187ad532d9af" containerName="revoke-keys"
Aug 04 00:46:31.777899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.777686    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b522153f-a007-4073-8b1b-e3c8be7feab8" containerName="maas-api"
Aug 04 00:46:31.782290 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.782270    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.784802 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.784778    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:46:31.784922 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.784841    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a5b2e0-serving-cert\""
Aug 04 00:46:31.784986 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.784923    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:46:31.785785 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.785768    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqm87\""
Aug 04 00:46:31.789317 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.789215    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"]
Aug 04 00:46:31.819581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.819546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ed26a4-5c35-4f17-9de7-fb80392bb636-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.819741 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.819587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.819808 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.819753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjnm\" (UniqueName: \"kubernetes.io/projected/d4ed26a4-5c35-4f17-9de7-fb80392bb636-kube-api-access-5fjnm\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.920645 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.920610    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjnm\" (UniqueName: \"kubernetes.io/projected/d4ed26a4-5c35-4f17-9de7-fb80392bb636-kube-api-access-5fjnm\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.920844 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.920662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ed26a4-5c35-4f17-9de7-fb80392bb636-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.920844 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.920700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.920844 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:46:31.920798    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-serving-cert: secret "maas-api-e2e-shared-a-a5b2e0-serving-cert" not found
Aug 04 00:46:31.920970 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:46:31.920853    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls podName:d4ed26a4-5c35-4f17-9de7-fb80392bb636 nodeName:}" failed. No retries permitted until 2026-08-04 00:46:32.42083704 +0000 UTC m=+2665.760872883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls") pod "maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" (UID: "d4ed26a4-5c35-4f17-9de7-fb80392bb636") : secret "maas-api-e2e-shared-a-a5b2e0-serving-cert" not found
Aug 04 00:46:31.921323 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.921301    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ed26a4-5c35-4f17-9de7-fb80392bb636-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:31.929182 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:31.929157    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjnm\" (UniqueName: \"kubernetes.io/projected/d4ed26a4-5c35-4f17-9de7-fb80392bb636-kube-api-access-5fjnm\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:32.399711 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.399653    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"]
Aug 04 00:46:32.403261 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.403241    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.405602 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.405576    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-a5b2e0-dockercfg-5z6rx\""
Aug 04 00:46:32.405702 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.405610    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-a5b2e0\""
Aug 04 00:46:32.413873 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.413847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"]
Aug 04 00:46:32.424467 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.424440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:32.424622 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.424515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.424622 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.424558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpc2w\" (UniqueName: \"kubernetes.io/projected/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-kube-api-access-hpc2w\") pod \"payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.426854 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.426832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls\") pod \"maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:32.442960 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.442936    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"]
Aug 04 00:46:32.446144 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.446129    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.457955 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.457929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"]
Aug 04 00:46:32.526330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.526052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.526330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.526127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpc2w\" (UniqueName: \"kubernetes.io/projected/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-kube-api-access-hpc2w\") pod \"payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.526330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.526166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vp6f\" (UniqueName: \"kubernetes.io/projected/26ded846-b065-4088-9bfc-7ada6f09100e-kube-api-access-5vp6f\") pod \"payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.526330 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.526202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26ded846-b065-4088-9bfc-7ada6f09100e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.527333 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.527307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.536899 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.536872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpc2w\" (UniqueName: \"kubernetes.io/projected/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-kube-api-access-hpc2w\") pod \"payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.627292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.627251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vp6f\" (UniqueName: \"kubernetes.io/projected/26ded846-b065-4088-9bfc-7ada6f09100e-kube-api-access-5vp6f\") pod \"payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.627292 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.627291    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26ded846-b065-4088-9bfc-7ada6f09100e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.628090 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.628069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26ded846-b065-4088-9bfc-7ada6f09100e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.635581 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.635546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vp6f\" (UniqueName: \"kubernetes.io/projected/26ded846-b065-4088-9bfc-7ada6f09100e-kube-api-access-5vp6f\") pod \"payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.695976 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.695883    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:32.714894 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.714864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:32.757170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.757133    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:32.852399 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.852370    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"]
Aug 04 00:46:32.853808 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:46:32.853759    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ed26a4_5c35_4f17_9de7_fb80392bb636.slice/crio-38e695422ae779843bcf7879c90b5f1038b89b245d120c228227fdcedccbaafe WatchSource:0}: Error finding container 38e695422ae779843bcf7879c90b5f1038b89b245d120c228227fdcedccbaafe: Status 404 returned error can't find the container with id 38e695422ae779843bcf7879c90b5f1038b89b245d120c228227fdcedccbaafe
Aug 04 00:46:32.892913 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.892882    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"]
Aug 04 00:46:32.897243 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:46:32.897197    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2e83c5_cf2c_45bf_89ef_f2d64c2cd775.slice/crio-5a9d328bc4bd2c2787f87cc79cfc403e5b26981f775ca57674697d6c59025424 WatchSource:0}: Error finding container 5a9d328bc4bd2c2787f87cc79cfc403e5b26981f775ca57674697d6c59025424: Status 404 returned error can't find the container with id 5a9d328bc4bd2c2787f87cc79cfc403e5b26981f775ca57674697d6c59025424
Aug 04 00:46:32.921732 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:32.921703    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"]
Aug 04 00:46:32.928917 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:46:32.928887    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ded846_b065_4088_9bfc_7ada6f09100e.slice/crio-16156d1e0516bb947a28fed8e7e351ccf3c5ce75c9717402f74366b1dd9617b1 WatchSource:0}: Error finding container 16156d1e0516bb947a28fed8e7e351ccf3c5ce75c9717402f74366b1dd9617b1: Status 404 returned error can't find the container with id 16156d1e0516bb947a28fed8e7e351ccf3c5ce75c9717402f74366b1dd9617b1
Aug 04 00:46:33.148760 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.148714    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" event={"ID":"d4ed26a4-5c35-4f17-9de7-fb80392bb636","Type":"ContainerStarted","Data":"38e695422ae779843bcf7879c90b5f1038b89b245d120c228227fdcedccbaafe"}
Aug 04 00:46:33.150490 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.150460    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf" event={"ID":"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775","Type":"ContainerStarted","Data":"367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63"}
Aug 04 00:46:33.150632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.150512    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf" event={"ID":"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775","Type":"ContainerStarted","Data":"5a9d328bc4bd2c2787f87cc79cfc403e5b26981f775ca57674697d6c59025424"}
Aug 04 00:46:33.150632 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.150542    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:33.152045 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.152019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt" event={"ID":"26ded846-b065-4088-9bfc-7ada6f09100e","Type":"ContainerStarted","Data":"d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447"}
Aug 04 00:46:33.152149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.152070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:46:33.152149 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.152086    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt" event={"ID":"26ded846-b065-4088-9bfc-7ada6f09100e","Type":"ContainerStarted","Data":"16156d1e0516bb947a28fed8e7e351ccf3c5ce75c9717402f74366b1dd9617b1"}
Aug 04 00:46:33.166916 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.166869    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf" podStartSLOduration=1.166852023 podStartE2EDuration="1.166852023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:46:33.165426776 +0000 UTC m=+2666.505462642" watchObservedRunningTime="2026-08-04 00:46:33.166852023 +0000 UTC m=+2666.506887888"
Aug 04 00:46:33.181529 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:33.181486    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt" podStartSLOduration=1.181471644 podStartE2EDuration="1.181471644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:46:33.178906513 +0000 UTC m=+2666.518942379" watchObservedRunningTime="2026-08-04 00:46:33.181471644 +0000 UTC m=+2666.521507508"
Aug 04 00:46:34.158846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:34.158807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" event={"ID":"d4ed26a4-5c35-4f17-9de7-fb80392bb636","Type":"ContainerStarted","Data":"fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a"}
Aug 04 00:46:34.159263 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:34.159056    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:34.177883 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:34.177832    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" podStartSLOduration=2.8251827819999997 podStartE2EDuration="3.177815045s" totalImagesPullingTime="352.632263ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:46:34.176008728 +0000 UTC m=+2667.516044595" watchObservedRunningTime="2026-08-04 00:46:34.177815045 +0000 UTC m=+2667.517850909"
Aug 04 00:46:40.169166 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:40.169141    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 00:46:44.161347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:44.161316    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 00:46:44.161753 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:46:44.161383    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 00:47:00.649868 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.649788    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"]
Aug 04 00:47:00.653164 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.653148    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.656808 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.656785    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-5396f3-serving-cert\""
Aug 04 00:47:00.674653 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.674627    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"]
Aug 04 00:47:00.784874 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.784837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb5145a-158e-4ffb-a977-ed3bf142cda2-maas-api-tls\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.785079 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.784898    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxkwm\" (UniqueName: \"kubernetes.io/projected/aeb5145a-158e-4ffb-a977-ed3bf142cda2-kube-api-access-lxkwm\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.785079 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.784948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb5145a-158e-4ffb-a977-ed3bf142cda2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.886109 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.886077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb5145a-158e-4ffb-a977-ed3bf142cda2-maas-api-tls\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.886297 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.886131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxkwm\" (UniqueName: \"kubernetes.io/projected/aeb5145a-158e-4ffb-a977-ed3bf142cda2-kube-api-access-lxkwm\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.886297 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.886160    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb5145a-158e-4ffb-a977-ed3bf142cda2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.886838 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.886806    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb5145a-158e-4ffb-a977-ed3bf142cda2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.888608 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.888590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb5145a-158e-4ffb-a977-ed3bf142cda2-maas-api-tls\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.893844 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.893826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxkwm\" (UniqueName: \"kubernetes.io/projected/aeb5145a-158e-4ffb-a977-ed3bf142cda2-kube-api-access-lxkwm\") pod \"maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:00.962729 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:00.962630    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:01.098230 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.098207    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"]
Aug 04 00:47:01.100606 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:47:01.100574    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb5145a_158e_4ffb_a977_ed3bf142cda2.slice/crio-3a0ac1439369664d2538208049fe2d340b2dbc45460f750eab4e6dc083cbf724 WatchSource:0}: Error finding container 3a0ac1439369664d2538208049fe2d340b2dbc45460f750eab4e6dc083cbf724: Status 404 returned error can't find the container with id 3a0ac1439369664d2538208049fe2d340b2dbc45460f750eab4e6dc083cbf724
Aug 04 00:47:01.283596 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.283519    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54" event={"ID":"aeb5145a-158e-4ffb-a977-ed3bf142cda2","Type":"ContainerStarted","Data":"3a0ac1439369664d2538208049fe2d340b2dbc45460f750eab4e6dc083cbf724"}
Aug 04 00:47:01.326197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.326164    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"]
Aug 04 00:47:01.330606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.330590    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.332898 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.332876    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-5396f3\""
Aug 04 00:47:01.333022 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.332934    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-5396f3-dockercfg-6vnxh\""
Aug 04 00:47:01.341316 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.341282    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"]
Aug 04 00:47:01.354206 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.354171    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"]
Aug 04 00:47:01.357814 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.357791    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.370078 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.370053    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"]
Aug 04 00:47:01.491389 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.491350    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47ca6cc-0298-4d0b-afe1-17ffebeea937-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.491568 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.491414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf6pg\" (UniqueName: \"kubernetes.io/projected/d47ca6cc-0298-4d0b-afe1-17ffebeea937-kube-api-access-zf6pg\") pod \"payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.491568 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.491436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd969e4-9ca9-41e9-9a17-4820df36811b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.491568 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.491455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6whz\" (UniqueName: \"kubernetes.io/projected/4fd969e4-9ca9-41e9-9a17-4820df36811b-kube-api-access-s6whz\") pod \"payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.592145 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.592111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47ca6cc-0298-4d0b-afe1-17ffebeea937-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.592318 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.592170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf6pg\" (UniqueName: \"kubernetes.io/projected/d47ca6cc-0298-4d0b-afe1-17ffebeea937-kube-api-access-zf6pg\") pod \"payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.592318 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.592188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd969e4-9ca9-41e9-9a17-4820df36811b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.592318 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.592205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6whz\" (UniqueName: \"kubernetes.io/projected/4fd969e4-9ca9-41e9-9a17-4820df36811b-kube-api-access-s6whz\") pod \"payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.593102 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.593081    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47ca6cc-0298-4d0b-afe1-17ffebeea937-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.593150 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.593081    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd969e4-9ca9-41e9-9a17-4820df36811b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.600979 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.600953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf6pg\" (UniqueName: \"kubernetes.io/projected/d47ca6cc-0298-4d0b-afe1-17ffebeea937-kube-api-access-zf6pg\") pod \"payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.601100 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.600953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6whz\" (UniqueName: \"kubernetes.io/projected/4fd969e4-9ca9-41e9-9a17-4820df36811b-kube-api-access-s6whz\") pod \"payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.642680 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.642651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:01.671111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.671071    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:01.793973 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:01.793940    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"]
Aug 04 00:47:01.796176 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:47:01.796142    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47ca6cc_0298_4d0b_afe1_17ffebeea937.slice/crio-f71d974130589ea69029acf0ba15224b4c1077d1472e4d7c928395bc31638697 WatchSource:0}: Error finding container f71d974130589ea69029acf0ba15224b4c1077d1472e4d7c928395bc31638697: Status 404 returned error can't find the container with id f71d974130589ea69029acf0ba15224b4c1077d1472e4d7c928395bc31638697
Aug 04 00:47:02.027980 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.027872    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"]
Aug 04 00:47:02.030344 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:47:02.030313    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd969e4_9ca9_41e9_9a17_4820df36811b.slice/crio-6d77e17b071b0cbd60a8c334510336ae84a6eb7faffbe762cf7c6da1f675ddce WatchSource:0}: Error finding container 6d77e17b071b0cbd60a8c334510336ae84a6eb7faffbe762cf7c6da1f675ddce: Status 404 returned error can't find the container with id 6d77e17b071b0cbd60a8c334510336ae84a6eb7faffbe762cf7c6da1f675ddce
Aug 04 00:47:02.290197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.290166    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54" event={"ID":"aeb5145a-158e-4ffb-a977-ed3bf142cda2","Type":"ContainerStarted","Data":"1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce"}
Aug 04 00:47:02.290407 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.290228    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:02.291590 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.291563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x" event={"ID":"4fd969e4-9ca9-41e9-9a17-4820df36811b","Type":"ContainerStarted","Data":"e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84"}
Aug 04 00:47:02.291746 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.291610    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x" event={"ID":"4fd969e4-9ca9-41e9-9a17-4820df36811b","Type":"ContainerStarted","Data":"6d77e17b071b0cbd60a8c334510336ae84a6eb7faffbe762cf7c6da1f675ddce"}
Aug 04 00:47:02.291746 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.291641    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:02.292983 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.292959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" event={"ID":"d47ca6cc-0298-4d0b-afe1-17ffebeea937","Type":"ContainerStarted","Data":"ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2"}
Aug 04 00:47:02.293100 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.293002    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" event={"ID":"d47ca6cc-0298-4d0b-afe1-17ffebeea937","Type":"ContainerStarted","Data":"f71d974130589ea69029acf0ba15224b4c1077d1472e4d7c928395bc31638697"}
Aug 04 00:47:02.293100 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.293034    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:47:02.306988 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.306934    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54" podStartSLOduration=1.914199933 podStartE2EDuration="2.306916253s" totalImagesPullingTime="392.71632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:47:02.305280987 +0000 UTC m=+2695.645316854" watchObservedRunningTime="2026-08-04 00:47:02.306916253 +0000 UTC m=+2695.646952118"
Aug 04 00:47:02.320497 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.320382    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" podStartSLOduration=1.320360631 podStartE2EDuration="1.320360631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:47:02.319181024 +0000 UTC m=+2695.659216890" watchObservedRunningTime="2026-08-04 00:47:02.320360631 +0000 UTC m=+2695.660396496"
Aug 04 00:47:02.337166 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:02.337103    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x" podStartSLOduration=1.337082728 podStartE2EDuration="1.337082728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:47:02.335077772 +0000 UTC m=+2695.675113640" watchObservedRunningTime="2026-08-04 00:47:02.337082728 +0000 UTC m=+2695.677118595"
Aug 04 00:47:07.305736 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:07.305612    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:47:07.321195 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:07.310154    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:47:07.321195 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:07.310409    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:47:07.321195 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:07.314954    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:47:08.304787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:08.304757    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 00:47:13.300102 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:13.300059    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" podUID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.69:9004: connect: connection refused"
Aug 04 00:47:13.300714 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:13.300524    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 00:47:23.298633 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:47:23.298600    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 00:51:07.506742 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:51:07.506714    2571 scope.go:117] "RemoveContainer" containerID="d0f5e1a28d4be0a0deb1e78f2caa8b934d3af060223e31fa6b000dd86bd5ff2a"
Aug 04 00:51:07.515170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:51:07.515146    2571 scope.go:117] "RemoveContainer" containerID="fe8ef00f73844f4df6f45803a5269ffd4cfe63bbd28a82d548b0026374682bce"
Aug 04 00:52:07.333343 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:52:07.333235    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:52:07.337720 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:52:07.337701    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:52:07.339043 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:52:07.339023    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:52:07.343116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:52:07.343101    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:52:07.537341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:52:07.537303    2571 scope.go:117] "RemoveContainer" containerID="f234ebf41f5da34256b587a09cf5d81a4c95d1fdb9dd7423c938f7b508ff495f"
Aug 04 00:56:36.743399 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.743362    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"]
Aug 04 00:56:36.746997 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.746976    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.749251 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.749229    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-579628-serving-cert\""
Aug 04 00:56:36.757464 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.757436    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"]
Aug 04 00:56:36.870852 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.870817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.870852 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.870851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66flv\" (UniqueName: \"kubernetes.io/projected/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-kube-api-access-66flv\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.871081 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.870892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.972358 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.972311    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.972358 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.972349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66flv\" (UniqueName: \"kubernetes.io/projected/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-kube-api-access-66flv\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.972590 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.972473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.972642 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:56:36.972604    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-serving-cert: secret "maas-api-e2e-ipp-a-579628-serving-cert" not found
Aug 04 00:56:36.972685 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:56:36.972666    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls podName:cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316 nodeName:}" failed. No retries permitted until 2026-08-04 00:56:37.472647218 +0000 UTC m=+3270.812683066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls") pod "maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" (UID: "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316") : secret "maas-api-e2e-ipp-a-579628-serving-cert" not found
Aug 04 00:56:36.973031 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.973009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:36.980815 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:36.980794    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66flv\" (UniqueName: \"kubernetes.io/projected/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-kube-api-access-66flv\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:37.382713 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.382654    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"]
Aug 04 00:56:37.386170 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.386153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.388617 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.388595    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-579628\""
Aug 04 00:56:37.388759 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.388636    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-579628-dockercfg-q5xbr\""
Aug 04 00:56:37.397476 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.397439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"]
Aug 04 00:56:37.408709 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.408669    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"]
Aug 04 00:56:37.412486 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.412462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.427276 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.427241    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"]
Aug 04 00:56:37.478204 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.478164    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:37.481151 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.481123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls\") pod \"maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:37.579109 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.579072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.579109 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.579111    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppgsw\" (UniqueName: \"kubernetes.io/projected/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-kube-api-access-ppgsw\") pod \"payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.579336 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.579142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqgwb\" (UniqueName: \"kubernetes.io/projected/19737ea1-3af7-494f-8b8e-8e21c499fe1e-kube-api-access-hqgwb\") pod \"payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.579336 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.579254    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19737ea1-3af7-494f-8b8e-8e21c499fe1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.659261 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.659171    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:37.680540 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.680508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19737ea1-3af7-494f-8b8e-8e21c499fe1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.681423 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.680623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.681423 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.681304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppgsw\" (UniqueName: \"kubernetes.io/projected/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-kube-api-access-ppgsw\") pod \"payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.681423 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.681363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqgwb\" (UniqueName: \"kubernetes.io/projected/19737ea1-3af7-494f-8b8e-8e21c499fe1e-kube-api-access-hqgwb\") pod \"payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.681666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.681419    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19737ea1-3af7-494f-8b8e-8e21c499fe1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.681666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.681479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.690510 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.690481    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqgwb\" (UniqueName: \"kubernetes.io/projected/19737ea1-3af7-494f-8b8e-8e21c499fe1e-kube-api-access-hqgwb\") pod \"payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.690629 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.690519    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppgsw\" (UniqueName: \"kubernetes.io/projected/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-kube-api-access-ppgsw\") pod \"payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.698311 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.698254    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.723331 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.723033    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:37.825871 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.825833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"]
Aug 04 00:56:37.830454 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:56:37.830419    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfbaf2d_77ba_4f20_a5e6_5bc1b64a7316.slice/crio-06f0cb49a2f7b037696d0cbc420cadacfc7c14e51d011b211dd7cf62de9358e1 WatchSource:0}: Error finding container 06f0cb49a2f7b037696d0cbc420cadacfc7c14e51d011b211dd7cf62de9358e1: Status 404 returned error can't find the container with id 06f0cb49a2f7b037696d0cbc420cadacfc7c14e51d011b211dd7cf62de9358e1
Aug 04 00:56:37.832639 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.832617    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:56:37.869846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.869815    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"]
Aug 04 00:56:37.872335 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:56:37.872307    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19737ea1_3af7_494f_8b8e_8e21c499fe1e.slice/crio-d73c8bc1ccf667797b9a6074283bbbf67662e0493eb2ddc1d1c41eb9a559624e WatchSource:0}: Error finding container d73c8bc1ccf667797b9a6074283bbbf67662e0493eb2ddc1d1c41eb9a559624e: Status 404 returned error can't find the container with id d73c8bc1ccf667797b9a6074283bbbf67662e0493eb2ddc1d1c41eb9a559624e
Aug 04 00:56:37.899001 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.898981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"]
Aug 04 00:56:37.908922 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:56:37.908891    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3bdbf6_110f_40b5_98c3_6a76c60d2836.slice/crio-47db5de292e831f7bae99ff9d4e9d4af8bdd0733ab1e7f6132e567b1cb3d7486 WatchSource:0}: Error finding container 47db5de292e831f7bae99ff9d4e9d4af8bdd0733ab1e7f6132e567b1cb3d7486: Status 404 returned error can't find the container with id 47db5de292e831f7bae99ff9d4e9d4af8bdd0733ab1e7f6132e567b1cb3d7486
Aug 04 00:56:37.963997 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.963964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq" event={"ID":"cb3bdbf6-110f-40b5-98c3-6a76c60d2836","Type":"ContainerStarted","Data":"47db5de292e831f7bae99ff9d4e9d4af8bdd0733ab1e7f6132e567b1cb3d7486"}
Aug 04 00:56:37.965368 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.965341    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" event={"ID":"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316","Type":"ContainerStarted","Data":"06f0cb49a2f7b037696d0cbc420cadacfc7c14e51d011b211dd7cf62de9358e1"}
Aug 04 00:56:37.967066 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.967034    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9" event={"ID":"19737ea1-3af7-494f-8b8e-8e21c499fe1e","Type":"ContainerStarted","Data":"e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213"}
Aug 04 00:56:37.967159 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.967084    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9" event={"ID":"19737ea1-3af7-494f-8b8e-8e21c499fe1e","Type":"ContainerStarted","Data":"d73c8bc1ccf667797b9a6074283bbbf67662e0493eb2ddc1d1c41eb9a559624e"}
Aug 04 00:56:37.967250 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.967234    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:37.984482 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:37.984404    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9" podStartSLOduration=0.984386357 podStartE2EDuration="984.386357ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:56:37.982675416 +0000 UTC m=+3271.322711284" watchObservedRunningTime="2026-08-04 00:56:37.984386357 +0000 UTC m=+3271.324422231"
Aug 04 00:56:38.974194 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:38.974154    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq" event={"ID":"cb3bdbf6-110f-40b5-98c3-6a76c60d2836","Type":"ContainerStarted","Data":"4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e"}
Aug 04 00:56:38.974731 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:38.974278    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:56:38.975686 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:38.975664    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" event={"ID":"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316","Type":"ContainerStarted","Data":"b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55"}
Aug 04 00:56:38.975809 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:38.975794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:38.990523 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:38.990483    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq" podStartSLOduration=1.990469794 podStartE2EDuration="1.990469794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:56:38.989117922 +0000 UTC m=+3272.329153787" watchObservedRunningTime="2026-08-04 00:56:38.990469794 +0000 UTC m=+3272.330505658"
Aug 04 00:56:39.006279 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:39.006236    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" podStartSLOduration=2.55317591 podStartE2EDuration="3.006220719s" totalImagesPullingTime="453.044809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:56:39.004994164 +0000 UTC m=+3272.345030032" watchObservedRunningTime="2026-08-04 00:56:39.006220719 +0000 UTC m=+3272.346256658"
Aug 04 00:56:44.986279 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:44.986253    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:56:48.978550 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:48.978522    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:56:49.982729 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:56:49.982676    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:57:05.919111 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:05.919074    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"]
Aug 04 00:57:05.923301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:05.923279    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:05.925937 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:05.925902    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f277ac-serving-cert\""
Aug 04 00:57:05.933554 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:05.933527    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"]
Aug 04 00:57:06.046153 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.046116    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.046325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.046175    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7c518e-7e6d-407e-9666-7d090828b30b-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.046325 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.046205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7fj8\" (UniqueName: \"kubernetes.io/projected/4b7c518e-7e6d-407e-9666-7d090828b30b-kube-api-access-h7fj8\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.146942 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.146909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.147130 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.146966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7c518e-7e6d-407e-9666-7d090828b30b-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.147130 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.146996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7fj8\" (UniqueName: \"kubernetes.io/projected/4b7c518e-7e6d-407e-9666-7d090828b30b-kube-api-access-h7fj8\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.147130 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:57:06.147076    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-serving-cert: secret "maas-api-e2e-ipp-b-f277ac-serving-cert" not found
Aug 04 00:57:06.147306 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:57:06.147150    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls podName:4b7c518e-7e6d-407e-9666-7d090828b30b nodeName:}" failed. No retries permitted until 2026-08-04 00:57:06.647133847 +0000 UTC m=+3299.987169690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls") pod "maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" (UID: "4b7c518e-7e6d-407e-9666-7d090828b30b") : secret "maas-api-e2e-ipp-b-f277ac-serving-cert" not found
Aug 04 00:57:06.147800 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.147745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7c518e-7e6d-407e-9666-7d090828b30b-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.157347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.157325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7fj8\" (UniqueName: \"kubernetes.io/projected/4b7c518e-7e6d-407e-9666-7d090828b30b-kube-api-access-h7fj8\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.651202 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.651166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.653641 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.653610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.671009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.670985    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"]
Aug 04 00:57:06.674468 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.674453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.677028 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.677006    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-f277ac\""
Aug 04 00:57:06.684807 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.684787    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"]
Aug 04 00:57:06.703928 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.703902    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"]
Aug 04 00:57:06.707234 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.707219    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.709482 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.709463    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-f277ac-dockercfg-9d6cr\""
Aug 04 00:57:06.714484 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.714296    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"]
Aug 04 00:57:06.751848 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.751818    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2691d22d-b562-4ba5-91a5-b1e311dab77a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.751848 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.751848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2dl\" (UniqueName: \"kubernetes.io/projected/2691d22d-b562-4ba5-91a5-b1e311dab77a-kube-api-access-6b2dl\") pod \"payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.836587 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.836551    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:06.853009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.852975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2691d22d-b562-4ba5-91a5-b1e311dab77a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.853197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.853017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2dl\" (UniqueName: \"kubernetes.io/projected/2691d22d-b562-4ba5-91a5-b1e311dab77a-kube-api-access-6b2dl\") pod \"payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.853197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.853096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6b7j\" (UniqueName: \"kubernetes.io/projected/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-kube-api-access-f6b7j\") pod \"payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.853197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.853190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.853964 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.853939    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2691d22d-b562-4ba5-91a5-b1e311dab77a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.860815 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.860784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2dl\" (UniqueName: \"kubernetes.io/projected/2691d22d-b562-4ba5-91a5-b1e311dab77a-kube-api-access-6b2dl\") pod \"payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:06.954047 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.954011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.954546 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.954132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6b7j\" (UniqueName: \"kubernetes.io/projected/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-kube-api-access-f6b7j\") pod \"payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.956060 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.956004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.961667 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.961645    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6b7j\" (UniqueName: \"kubernetes.io/projected/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-kube-api-access-f6b7j\") pod \"payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:06.985576 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:06.985542    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:07.018846 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.018819    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:07.185113 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.185088    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"]
Aug 04 00:57:07.186451 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:57:07.186396    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7c518e_7e6d_407e_9666_7d090828b30b.slice/crio-63f12757f0e5593d9321022b9adc7491f1f106a19dccb4f1d87b691a9b006a31 WatchSource:0}: Error finding container 63f12757f0e5593d9321022b9adc7491f1f106a19dccb4f1d87b691a9b006a31: Status 404 returned error can't find the container with id 63f12757f0e5593d9321022b9adc7491f1f106a19dccb4f1d87b691a9b006a31
Aug 04 00:57:07.359265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.341405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"]
Aug 04 00:57:07.359265 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:57:07.344528    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2691d22d_b562_4ba5_91a5_b1e311dab77a.slice/crio-7e81ceda8bf8c68b173f4ad26d5a6d10d346fba4375040c7983a3c3d92641094 WatchSource:0}: Error finding container 7e81ceda8bf8c68b173f4ad26d5a6d10d346fba4375040c7983a3c3d92641094: Status 404 returned error can't find the container with id 7e81ceda8bf8c68b173f4ad26d5a6d10d346fba4375040c7983a3c3d92641094
Aug 04 00:57:07.368458 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.368433    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:57:07.372549 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.372530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 00:57:07.376914 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.376897    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:57:07.377560 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.377542    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"]
Aug 04 00:57:07.381940 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:07.381922    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97p4s_c2eeb15d-6446-49aa-8eb8-17c7998be3b4/ovn-acl-logging/0.log"
Aug 04 00:57:07.387879 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:57:07.387856    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e325c61_f2a5_45fe_a60e_ca4f6947c85c.slice/crio-9104e61c0fb0e6b83837503e60ac3c5cea53f30af07bdc5c931a47a7a280a8ae WatchSource:0}: Error finding container 9104e61c0fb0e6b83837503e60ac3c5cea53f30af07bdc5c931a47a7a280a8ae: Status 404 returned error can't find the container with id 9104e61c0fb0e6b83837503e60ac3c5cea53f30af07bdc5c931a47a7a280a8ae
Aug 04 00:57:08.121245 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.121216    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc" event={"ID":"2691d22d-b562-4ba5-91a5-b1e311dab77a","Type":"ContainerStarted","Data":"8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33"}
Aug 04 00:57:08.121787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.121264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc" event={"ID":"2691d22d-b562-4ba5-91a5-b1e311dab77a","Type":"ContainerStarted","Data":"7e81ceda8bf8c68b173f4ad26d5a6d10d346fba4375040c7983a3c3d92641094"}
Aug 04 00:57:08.121787 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.121336    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:08.122815 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.122792    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk" event={"ID":"0e325c61-f2a5-45fe-a60e-ca4f6947c85c","Type":"ContainerStarted","Data":"096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6"}
Aug 04 00:57:08.122930 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.122838    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:08.122930 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.122860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk" event={"ID":"0e325c61-f2a5-45fe-a60e-ca4f6947c85c","Type":"ContainerStarted","Data":"9104e61c0fb0e6b83837503e60ac3c5cea53f30af07bdc5c931a47a7a280a8ae"}
Aug 04 00:57:08.124203 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.124184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" event={"ID":"4b7c518e-7e6d-407e-9666-7d090828b30b","Type":"ContainerStarted","Data":"110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a"}
Aug 04 00:57:08.124301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.124223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" event={"ID":"4b7c518e-7e6d-407e-9666-7d090828b30b","Type":"ContainerStarted","Data":"63f12757f0e5593d9321022b9adc7491f1f106a19dccb4f1d87b691a9b006a31"}
Aug 04 00:57:08.124301 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.124250    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:08.137939 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.137895    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc" podStartSLOduration=2.137878572 podStartE2EDuration="2.137878572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:57:08.136212265 +0000 UTC m=+3301.476248135" watchObservedRunningTime="2026-08-04 00:57:08.137878572 +0000 UTC m=+3301.477914441"
Aug 04 00:57:08.153806 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.153758    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" podStartSLOduration=2.822466817 podStartE2EDuration="3.153743307s" totalImagesPullingTime="331.27649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:57:08.152041261 +0000 UTC m=+3301.492077130" watchObservedRunningTime="2026-08-04 00:57:08.153743307 +0000 UTC m=+3301.493779180"
Aug 04 00:57:08.175655 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:08.175600    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk" podStartSLOduration=2.175581472 podStartE2EDuration="2.175581472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:57:08.172250429 +0000 UTC m=+3301.512286296" watchObservedRunningTime="2026-08-04 00:57:08.175581472 +0000 UTC m=+3301.515617343"
Aug 04 00:57:14.134763 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:14.134737    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 00:57:19.131492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:19.131462    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 00:57:19.131978 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:19.131592    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 00:57:36.625187 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:36.625157    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-wh2dm_cf06cf76-5156-41c5-b637-e206b34005c0/payload-processing/0.log"
Aug 04 00:57:36.740873 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:57:36.740830    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk_0e325c61-f2a5-45fe-a60e-ca4f6947c85c/payload-processing/0.log"
Aug 04 00:58:31.671198 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:31.671161    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq_cb3bdbf6-110f-40b5-98c3-6a76c60d2836/payload-processing/0.log"
Aug 04 00:58:31.794380 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:31.794358    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-wh2dm_cf06cf76-5156-41c5-b637-e206b34005c0/payload-processing/0.log"
Aug 04 00:58:31.911339 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:31.911319    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk_0e325c61-f2a5-45fe-a60e-ca4f6947c85c/payload-processing/0.log"
Aug 04 00:58:37.601253 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.601219    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"]
Aug 04 00:58:37.604906 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.604881    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.607341 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.607321    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-974a1b-dockercfg-c462b\""
Aug 04 00:58:37.607536 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.607518    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-974a1b\""
Aug 04 00:58:37.614205 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.614182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"]
Aug 04 00:58:37.616375 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.616351    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"]
Aug 04 00:58:37.620216 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.620200    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.631602 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.631570    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"]
Aug 04 00:58:37.717749 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.717715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xlz\" (UniqueName: \"kubernetes.io/projected/40b56319-debe-4d0b-8f61-5bedfbf80488-kube-api-access-p6xlz\") pod \"payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.717957 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.717831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d504a137-68dc-438c-92c5-4d074e2bb9d0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.717957 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.717935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8lxs\" (UniqueName: \"kubernetes.io/projected/d504a137-68dc-438c-92c5-4d074e2bb9d0-kube-api-access-g8lxs\") pod \"payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.718080 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.717972    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40b56319-debe-4d0b-8f61-5bedfbf80488-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.819389 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.819359    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8lxs\" (UniqueName: \"kubernetes.io/projected/d504a137-68dc-438c-92c5-4d074e2bb9d0-kube-api-access-g8lxs\") pod \"payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.819389 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.819391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40b56319-debe-4d0b-8f61-5bedfbf80488-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.819606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.819416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xlz\" (UniqueName: \"kubernetes.io/projected/40b56319-debe-4d0b-8f61-5bedfbf80488-kube-api-access-p6xlz\") pod \"payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.819606 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.819475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d504a137-68dc-438c-92c5-4d074e2bb9d0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.820139 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.820119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40b56319-debe-4d0b-8f61-5bedfbf80488-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.820197 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.820123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d504a137-68dc-438c-92c5-4d074e2bb9d0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.827344 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.827319    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xlz\" (UniqueName: \"kubernetes.io/projected/40b56319-debe-4d0b-8f61-5bedfbf80488-kube-api-access-p6xlz\") pod \"payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.827492 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.827473    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8lxs\" (UniqueName: \"kubernetes.io/projected/d504a137-68dc-438c-92c5-4d074e2bb9d0-kube-api-access-g8lxs\") pod \"payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:37.916885 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.916854    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:37.932172 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:37.932147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:38.070242 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.070209    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"]
Aug 04 00:58:38.071450 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:58:38.071418    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b56319_debe_4d0b_8f61_5bedfbf80488.slice/crio-564777e7d7af45fdd5106cc61828ff64eb8bc8f0cadd1772c1c7679f024375df WatchSource:0}: Error finding container 564777e7d7af45fdd5106cc61828ff64eb8bc8f0cadd1772c1c7679f024375df: Status 404 returned error can't find the container with id 564777e7d7af45fdd5106cc61828ff64eb8bc8f0cadd1772c1c7679f024375df
Aug 04 00:58:38.101265 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.101242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"]
Aug 04 00:58:38.104622 ip-10-0-142-136 kubenswrapper[2571]: W0804 00:58:38.104597    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd504a137_68dc_438c_92c5_4d074e2bb9d0.slice/crio-8fac5693019d09b216518efd454b03465ec79cb61e44a4382627936e1dedb9d9 WatchSource:0}: Error finding container 8fac5693019d09b216518efd454b03465ec79cb61e44a4382627936e1dedb9d9: Status 404 returned error can't find the container with id 8fac5693019d09b216518efd454b03465ec79cb61e44a4382627936e1dedb9d9
Aug 04 00:58:38.568508 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.568470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp" event={"ID":"d504a137-68dc-438c-92c5-4d074e2bb9d0","Type":"ContainerStarted","Data":"edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367"}
Aug 04 00:58:38.568732 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.568533    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:38.568732 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.568558    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp" event={"ID":"d504a137-68dc-438c-92c5-4d074e2bb9d0","Type":"ContainerStarted","Data":"8fac5693019d09b216518efd454b03465ec79cb61e44a4382627936e1dedb9d9"}
Aug 04 00:58:38.570116 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.570092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd" event={"ID":"40b56319-debe-4d0b-8f61-5bedfbf80488","Type":"ContainerStarted","Data":"083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c"}
Aug 04 00:58:38.570228 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.570130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd" event={"ID":"40b56319-debe-4d0b-8f61-5bedfbf80488","Type":"ContainerStarted","Data":"564777e7d7af45fdd5106cc61828ff64eb8bc8f0cadd1772c1c7679f024375df"}
Aug 04 00:58:38.570228 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.570203    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:58:38.583471 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.583427    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp" podStartSLOduration=1.583410169 podStartE2EDuration="1.583410169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:58:38.582562774 +0000 UTC m=+3391.922598639" watchObservedRunningTime="2026-08-04 00:58:38.583410169 +0000 UTC m=+3391.923446035"
Aug 04 00:58:38.598242 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:38.598208    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd" podStartSLOduration=1.598191916 podStartE2EDuration="1.598191916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:58:38.597271382 +0000 UTC m=+3391.937307249" watchObservedRunningTime="2026-08-04 00:58:38.598191916 +0000 UTC m=+3391.938227783"
Aug 04 00:58:49.576858 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:49.576824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:58:49.577445 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:58:49.577138    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:59:07.612591 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.612554    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"]
Aug 04 00:59:07.613086 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.612816    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp" podUID="d504a137-68dc-438c-92c5-4d074e2bb9d0" containerName="payload-processing" containerID="cri-o://edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367" gracePeriod=30
Aug 04 00:59:07.621800 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.621773    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"]
Aug 04 00:59:07.622352 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.622316    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd" podUID="40b56319-debe-4d0b-8f61-5bedfbf80488" containerName="payload-pre-processing" containerID="cri-o://083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c" gracePeriod=30
Aug 04 00:59:07.878792 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.878764    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:59:07.881676 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.881643    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d504a137-68dc-438c-92c5-4d074e2bb9d0-plugins-config-volume\") pod \"d504a137-68dc-438c-92c5-4d074e2bb9d0\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") "
Aug 04 00:59:07.881771 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.881735    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8lxs\" (UniqueName: \"kubernetes.io/projected/d504a137-68dc-438c-92c5-4d074e2bb9d0-kube-api-access-g8lxs\") pod \"d504a137-68dc-438c-92c5-4d074e2bb9d0\" (UID: \"d504a137-68dc-438c-92c5-4d074e2bb9d0\") "
Aug 04 00:59:07.882000 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.881977    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d504a137-68dc-438c-92c5-4d074e2bb9d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d504a137-68dc-438c-92c5-4d074e2bb9d0" (UID: "d504a137-68dc-438c-92c5-4d074e2bb9d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:07.882055 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.882041    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d504a137-68dc-438c-92c5-4d074e2bb9d0-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:07.884096 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.884070    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d504a137-68dc-438c-92c5-4d074e2bb9d0-kube-api-access-g8lxs" (OuterVolumeSpecName: "kube-api-access-g8lxs") pod "d504a137-68dc-438c-92c5-4d074e2bb9d0" (UID: "d504a137-68dc-438c-92c5-4d074e2bb9d0"). InnerVolumeSpecName "kube-api-access-g8lxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:59:07.905298 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.905275    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:59:07.982825 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.982790    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6xlz\" (UniqueName: \"kubernetes.io/projected/40b56319-debe-4d0b-8f61-5bedfbf80488-kube-api-access-p6xlz\") pod \"40b56319-debe-4d0b-8f61-5bedfbf80488\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") "
Aug 04 00:59:07.982825 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.982825    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40b56319-debe-4d0b-8f61-5bedfbf80488-plugins-config-volume\") pod \"40b56319-debe-4d0b-8f61-5bedfbf80488\" (UID: \"40b56319-debe-4d0b-8f61-5bedfbf80488\") "
Aug 04 00:59:07.983076 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.983059    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8lxs\" (UniqueName: \"kubernetes.io/projected/d504a137-68dc-438c-92c5-4d074e2bb9d0-kube-api-access-g8lxs\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:07.983237 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.983215    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40b56319-debe-4d0b-8f61-5bedfbf80488-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40b56319-debe-4d0b-8f61-5bedfbf80488" (UID: "40b56319-debe-4d0b-8f61-5bedfbf80488"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:07.985011 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:07.984985    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b56319-debe-4d0b-8f61-5bedfbf80488-kube-api-access-p6xlz" (OuterVolumeSpecName: "kube-api-access-p6xlz") pod "40b56319-debe-4d0b-8f61-5bedfbf80488" (UID: "40b56319-debe-4d0b-8f61-5bedfbf80488"). InnerVolumeSpecName "kube-api-access-p6xlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:59:08.083982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.083948    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6xlz\" (UniqueName: \"kubernetes.io/projected/40b56319-debe-4d0b-8f61-5bedfbf80488-kube-api-access-p6xlz\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:08.083982 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.083978    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40b56319-debe-4d0b-8f61-5bedfbf80488-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:08.725230 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.725197    2571 generic.go:356] "Generic (PLEG): container finished" podID="d504a137-68dc-438c-92c5-4d074e2bb9d0" containerID="edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367" exitCode=0
Aug 04 00:59:08.725666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.725251    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"
Aug 04 00:59:08.725666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.725282    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp" event={"ID":"d504a137-68dc-438c-92c5-4d074e2bb9d0","Type":"ContainerDied","Data":"edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367"}
Aug 04 00:59:08.725666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.725358    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp" event={"ID":"d504a137-68dc-438c-92c5-4d074e2bb9d0","Type":"ContainerDied","Data":"8fac5693019d09b216518efd454b03465ec79cb61e44a4382627936e1dedb9d9"}
Aug 04 00:59:08.725666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.725387    2571 scope.go:117] "RemoveContainer" containerID="edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367"
Aug 04 00:59:08.726714 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.726636    2571 generic.go:356] "Generic (PLEG): container finished" podID="40b56319-debe-4d0b-8f61-5bedfbf80488" containerID="083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c" exitCode=0
Aug 04 00:59:08.726714 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.726667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd" event={"ID":"40b56319-debe-4d0b-8f61-5bedfbf80488","Type":"ContainerDied","Data":"083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c"}
Aug 04 00:59:08.726822 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.726720    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"
Aug 04 00:59:08.726822 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.726738    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd" event={"ID":"40b56319-debe-4d0b-8f61-5bedfbf80488","Type":"ContainerDied","Data":"564777e7d7af45fdd5106cc61828ff64eb8bc8f0cadd1772c1c7679f024375df"}
Aug 04 00:59:08.735347 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.735330    2571 scope.go:117] "RemoveContainer" containerID="edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367"
Aug 04 00:59:08.735633 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:59:08.735614    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367\": container with ID starting with edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367 not found: ID does not exist" containerID="edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367"
Aug 04 00:59:08.735743 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.735641    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367"} err="failed to get container status \"edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367\": rpc error: code = NotFound desc = could not find container \"edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367\": container with ID starting with edde6fe66fe4f871cfde8a3cc4d8ad60639bde14938424851d19d3c127313367 not found: ID does not exist"
Aug 04 00:59:08.735743 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.735659    2571 scope.go:117] "RemoveContainer" containerID="083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c"
Aug 04 00:59:08.743547 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.743531    2571 scope.go:117] "RemoveContainer" containerID="083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c"
Aug 04 00:59:08.743866 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:59:08.743845    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c\": container with ID starting with 083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c not found: ID does not exist" containerID="083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c"
Aug 04 00:59:08.743931 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.743877    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c"} err="failed to get container status \"083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c\": rpc error: code = NotFound desc = could not find container \"083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c\": container with ID starting with 083501749a93337945b62c5ea83c3faafc78fa008b62a68e37eca80fffabe43c not found: ID does not exist"
Aug 04 00:59:08.750439 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.750414    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"]
Aug 04 00:59:08.756020 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.756001    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-974a1b-77f665c9fb-dbxdp"]
Aug 04 00:59:08.768173 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.768151    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"]
Aug 04 00:59:08.773104 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:08.773081    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-974a1b-7565769bb4-pcktd"]
Aug 04 00:59:09.145645 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:09.145615    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b56319-debe-4d0b-8f61-5bedfbf80488" path="/var/lib/kubelet/pods/40b56319-debe-4d0b-8f61-5bedfbf80488/volumes"
Aug 04 00:59:09.146002 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:09.145988    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d504a137-68dc-438c-92c5-4d074e2bb9d0" path="/var/lib/kubelet/pods/d504a137-68dc-438c-92c5-4d074e2bb9d0/volumes"
Aug 04 00:59:33.023319 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.023281    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"]
Aug 04 00:59:33.023948 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.023559    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" podUID="cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" containerName="maas-api" containerID="cri-o://b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55" gracePeriod=30
Aug 04 00:59:33.071582 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.071554    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"]
Aug 04 00:59:33.071835 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.071803    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq" podUID="cb3bdbf6-110f-40b5-98c3-6a76c60d2836" containerName="payload-processing" containerID="cri-o://4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e" gracePeriod=30
Aug 04 00:59:33.080293 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.080271    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"]
Aug 04 00:59:33.080626 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.080577    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9" podUID="19737ea1-3af7-494f-8b8e-8e21c499fe1e" containerName="payload-pre-processing" containerID="cri-o://e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213" gracePeriod=30
Aug 04 00:59:33.359542 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.359515    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:59:33.378662 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.378624    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:59:33.387332 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.387310    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:59:33.495472 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495445    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls\") pod \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") "
Aug 04 00:59:33.495472 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495476    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19737ea1-3af7-494f-8b8e-8e21c499fe1e-plugins-config-volume\") pod \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") "
Aug 04 00:59:33.495776 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495502    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppgsw\" (UniqueName: \"kubernetes.io/projected/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-kube-api-access-ppgsw\") pod \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") "
Aug 04 00:59:33.495776 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495532    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66flv\" (UniqueName: \"kubernetes.io/projected/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-kube-api-access-66flv\") pod \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") "
Aug 04 00:59:33.495776 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495597    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-plugins-config-volume\") pod \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\" (UID: \"cb3bdbf6-110f-40b5-98c3-6a76c60d2836\") "
Aug 04 00:59:33.495776 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495626    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-openshift-service-ca\") pod \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\" (UID: \"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316\") "
Aug 04 00:59:33.495776 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.495679    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqgwb\" (UniqueName: \"kubernetes.io/projected/19737ea1-3af7-494f-8b8e-8e21c499fe1e-kube-api-access-hqgwb\") pod \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\" (UID: \"19737ea1-3af7-494f-8b8e-8e21c499fe1e\") "
Aug 04 00:59:33.496050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.496006    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19737ea1-3af7-494f-8b8e-8e21c499fe1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19737ea1-3af7-494f-8b8e-8e21c499fe1e" (UID: "19737ea1-3af7-494f-8b8e-8e21c499fe1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:33.496050 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.496007    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb3bdbf6-110f-40b5-98c3-6a76c60d2836" (UID: "cb3bdbf6-110f-40b5-98c3-6a76c60d2836"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:33.496157 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.496057    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" (UID: "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:33.497783 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.497749    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" (UID: "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:59:33.497783 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.497752    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-kube-api-access-66flv" (OuterVolumeSpecName: "kube-api-access-66flv") pod "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" (UID: "cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316"). InnerVolumeSpecName "kube-api-access-66flv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:59:33.497930 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.497809    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19737ea1-3af7-494f-8b8e-8e21c499fe1e-kube-api-access-hqgwb" (OuterVolumeSpecName: "kube-api-access-hqgwb") pod "19737ea1-3af7-494f-8b8e-8e21c499fe1e" (UID: "19737ea1-3af7-494f-8b8e-8e21c499fe1e"). InnerVolumeSpecName "kube-api-access-hqgwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:59:33.497930 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.497822    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-kube-api-access-ppgsw" (OuterVolumeSpecName: "kube-api-access-ppgsw") pod "cb3bdbf6-110f-40b5-98c3-6a76c60d2836" (UID: "cb3bdbf6-110f-40b5-98c3-6a76c60d2836"). InnerVolumeSpecName "kube-api-access-ppgsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597108    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqgwb\" (UniqueName: \"kubernetes.io/projected/19737ea1-3af7-494f-8b8e-8e21c499fe1e-kube-api-access-hqgwb\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597133    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597145    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19737ea1-3af7-494f-8b8e-8e21c499fe1e-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597155    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppgsw\" (UniqueName: \"kubernetes.io/projected/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-kube-api-access-ppgsw\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597164    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66flv\" (UniqueName: \"kubernetes.io/projected/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-kube-api-access-66flv\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597172    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb3bdbf6-110f-40b5-98c3-6a76c60d2836-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.597178 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.597180    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 00:59:33.850593 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.850508    2571 generic.go:356] "Generic (PLEG): container finished" podID="19737ea1-3af7-494f-8b8e-8e21c499fe1e" containerID="e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213" exitCode=0
Aug 04 00:59:33.850593 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.850552    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"
Aug 04 00:59:33.850853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.850599    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9" event={"ID":"19737ea1-3af7-494f-8b8e-8e21c499fe1e","Type":"ContainerDied","Data":"e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213"}
Aug 04 00:59:33.850853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.850656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9" event={"ID":"19737ea1-3af7-494f-8b8e-8e21c499fe1e","Type":"ContainerDied","Data":"d73c8bc1ccf667797b9a6074283bbbf67662e0493eb2ddc1d1c41eb9a559624e"}
Aug 04 00:59:33.850853 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.850684    2571 scope.go:117] "RemoveContainer" containerID="e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213"
Aug 04 00:59:33.852009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.851963    2571 generic.go:356] "Generic (PLEG): container finished" podID="cb3bdbf6-110f-40b5-98c3-6a76c60d2836" containerID="4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e" exitCode=0
Aug 04 00:59:33.852009 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.852000    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"
Aug 04 00:59:33.852213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.852046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq" event={"ID":"cb3bdbf6-110f-40b5-98c3-6a76c60d2836","Type":"ContainerDied","Data":"4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e"}
Aug 04 00:59:33.852213 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.852088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq" event={"ID":"cb3bdbf6-110f-40b5-98c3-6a76c60d2836","Type":"ContainerDied","Data":"47db5de292e831f7bae99ff9d4e9d4af8bdd0733ab1e7f6132e567b1cb3d7486"}
Aug 04 00:59:33.853447 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.853423    2571 generic.go:356] "Generic (PLEG): container finished" podID="cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" containerID="b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55" exitCode=0
Aug 04 00:59:33.853572 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.853466    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"
Aug 04 00:59:33.853572 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.853467    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" event={"ID":"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316","Type":"ContainerDied","Data":"b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55"}
Aug 04 00:59:33.853572 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.853507    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn" event={"ID":"cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316","Type":"ContainerDied","Data":"06f0cb49a2f7b037696d0cbc420cadacfc7c14e51d011b211dd7cf62de9358e1"}
Aug 04 00:59:33.861339 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.861318    2571 scope.go:117] "RemoveContainer" containerID="e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213"
Aug 04 00:59:33.861600 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:59:33.861582    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213\": container with ID starting with e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213 not found: ID does not exist" containerID="e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213"
Aug 04 00:59:33.861720 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.861610    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213"} err="failed to get container status \"e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213\": rpc error: code = NotFound desc = could not find container \"e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213\": container with ID starting with e7372ca538e6b441636871d167cb20a7f8fcf41d728ab36d54c6b8cb705b9213 not found: ID does not exist"
Aug 04 00:59:33.861720 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.861631    2571 scope.go:117] "RemoveContainer" containerID="4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e"
Aug 04 00:59:33.869640 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.869625    2571 scope.go:117] "RemoveContainer" containerID="4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e"
Aug 04 00:59:33.869895 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:59:33.869877    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e\": container with ID starting with 4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e not found: ID does not exist" containerID="4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e"
Aug 04 00:59:33.869958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.869902    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e"} err="failed to get container status \"4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e\": rpc error: code = NotFound desc = could not find container \"4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e\": container with ID starting with 4b32242a5dd4442f8368525e867cbf52b3a76e3a4ea22d2195183d2a9f80dc0e not found: ID does not exist"
Aug 04 00:59:33.869958 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.869917    2571 scope.go:117] "RemoveContainer" containerID="b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55"
Aug 04 00:59:33.874176 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.874154    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"]
Aug 04 00:59:33.877905 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.877890    2571 scope.go:117] "RemoveContainer" containerID="b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55"
Aug 04 00:59:33.877979 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.877902    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-579628-59fb865496-fl7w9"]
Aug 04 00:59:33.878169 ip-10-0-142-136 kubenswrapper[2571]: E0804 00:59:33.878149    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55\": container with ID starting with b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55 not found: ID does not exist" containerID="b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55"
Aug 04 00:59:33.878217 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.878174    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55"} err="failed to get container status \"b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55\": rpc error: code = NotFound desc = could not find container \"b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55\": container with ID starting with b59a386dc174fb42c175bd67adc6e380f13bf21f011f930fbc2604af03168b55 not found: ID does not exist"
Aug 04 00:59:33.888657 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.888639    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"]
Aug 04 00:59:33.892562 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.892543    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-579628-5b9f65d474-vb6jn"]
Aug 04 00:59:33.902187 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.902170    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"]
Aug 04 00:59:33.908260 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:33.908244    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-579628-7f548887b-mcvnq"]
Aug 04 00:59:35.146005 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:35.145976    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19737ea1-3af7-494f-8b8e-8e21c499fe1e" path="/var/lib/kubelet/pods/19737ea1-3af7-494f-8b8e-8e21c499fe1e/volumes"
Aug 04 00:59:35.146363 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:35.146315    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3bdbf6-110f-40b5-98c3-6a76c60d2836" path="/var/lib/kubelet/pods/cb3bdbf6-110f-40b5-98c3-6a76c60d2836/volumes"
Aug 04 00:59:35.146666 ip-10-0-142-136 kubenswrapper[2571]: I0804 00:59:35.146652    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" path="/var/lib/kubelet/pods/cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316/volumes"
Aug 04 01:00:00.167538 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167505    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"]
Aug 04 01:00:00.167974 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167937    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19737ea1-3af7-494f-8b8e-8e21c499fe1e" containerName="payload-pre-processing"
Aug 04 01:00:00.167974 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167950    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="19737ea1-3af7-494f-8b8e-8e21c499fe1e" containerName="payload-pre-processing"
Aug 04 01:00:00.167974 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167962    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d504a137-68dc-438c-92c5-4d074e2bb9d0" containerName="payload-processing"
Aug 04 01:00:00.167974 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167968    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d504a137-68dc-438c-92c5-4d074e2bb9d0" containerName="payload-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167978    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b56319-debe-4d0b-8f61-5bedfbf80488" containerName="payload-pre-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.167989    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b56319-debe-4d0b-8f61-5bedfbf80488" containerName="payload-pre-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168002    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3bdbf6-110f-40b5-98c3-6a76c60d2836" containerName="payload-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168008    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3bdbf6-110f-40b5-98c3-6a76c60d2836" containerName="payload-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168015    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" containerName="maas-api"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168020    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" containerName="maas-api"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168084    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d504a137-68dc-438c-92c5-4d074e2bb9d0" containerName="payload-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168092    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="19737ea1-3af7-494f-8b8e-8e21c499fe1e" containerName="payload-pre-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168105    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b56319-debe-4d0b-8f61-5bedfbf80488" containerName="payload-pre-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168115    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3bdbf6-110f-40b5-98c3-6a76c60d2836" containerName="payload-processing"
Aug 04 01:00:00.168149 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.168121    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfbaf2d-77ba-4f20-a5e6-5bc1b64a7316" containerName="maas-api"
Aug 04 01:00:00.171200 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.171184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"
Aug 04 01:00:00.175848 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.175829    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 01:00:00.180969 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.180946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"
Aug 04 01:00:00.181894 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.181874    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"]
Aug 04 01:00:00.185429 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.185372    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"]
Aug 04 01:00:00.186252 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.185511    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"
Aug 04 01:00:00.189913 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.189887    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"]
Aug 04 01:00:00.190029 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.189986    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"
Aug 04 01:00:00.208884 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.208588    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"]
Aug 04 01:00:00.214295 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.214050    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"]
Aug 04 01:00:00.219382 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.219361    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"
Aug 04 01:00:00.225817 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.225797    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"
Aug 04 01:00:00.373273 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.373242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"]
Aug 04 01:00:00.374786 ip-10-0-142-136 kubenswrapper[2571]: W0804 01:00:00.374752    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744f5c02_4d5d_49d1_8625_f527062e778a.slice/crio-376835176fd3a67734432de82b6e12d88f1bab7c149f503b4455dd14500b265e WatchSource:0}: Error finding container 376835176fd3a67734432de82b6e12d88f1bab7c149f503b4455dd14500b265e: Status 404 returned error can't find the container with id 376835176fd3a67734432de82b6e12d88f1bab7c149f503b4455dd14500b265e
Aug 04 01:00:00.421358 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.421301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"]
Aug 04 01:00:00.424015 ip-10-0-142-136 kubenswrapper[2571]: W0804 01:00:00.423993    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f964df_2804_403d_b231_fb4948787ede.slice/crio-637f1e0f91cd02f10c5a9140626cee909b17b909f6006d99b65fef140497c4eb WatchSource:0}: Error finding container 637f1e0f91cd02f10c5a9140626cee909b17b909f6006d99b65fef140497c4eb: Status 404 returned error can't find the container with id 637f1e0f91cd02f10c5a9140626cee909b17b909f6006d99b65fef140497c4eb
Aug 04 01:00:00.602703 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.602664    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"]
Aug 04 01:00:00.604544 ip-10-0-142-136 kubenswrapper[2571]: W0804 01:00:00.604510    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e20b40_ec90_4bf2_952f_eb8bb9b37282.slice/crio-16a76866d0c6cafb429049daea47b612b14db8d0c630f42045451e72d711c6bd WatchSource:0}: Error finding container 16a76866d0c6cafb429049daea47b612b14db8d0c630f42045451e72d711c6bd: Status 404 returned error can't find the container with id 16a76866d0c6cafb429049daea47b612b14db8d0c630f42045451e72d711c6bd
Aug 04 01:00:00.988609 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.988537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc" event={"ID":"11f964df-2804-403d-b231-fb4948787ede","Type":"ContainerStarted","Data":"f10acd19861c76817c69c9a1325b0d539d07d1a289cdd3a8c36ea241b669b9bc"}
Aug 04 01:00:00.988609 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.988586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc" event={"ID":"11f964df-2804-403d-b231-fb4948787ede","Type":"ContainerStarted","Data":"637f1e0f91cd02f10c5a9140626cee909b17b909f6006d99b65fef140497c4eb"}
Aug 04 01:00:00.990016 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.989986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq" event={"ID":"f5e20b40-ec90-4bf2-952f-eb8bb9b37282","Type":"ContainerStarted","Data":"3a16f6edca71a60a7941160a817d3d13d58ec1284d280b3864b114c8fd499703"}
Aug 04 01:00:00.990121 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.990043    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq" event={"ID":"f5e20b40-ec90-4bf2-952f-eb8bb9b37282","Type":"ContainerStarted","Data":"16a76866d0c6cafb429049daea47b612b14db8d0c630f42045451e72d711c6bd"}
Aug 04 01:00:00.991493 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.991467    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6" event={"ID":"744f5c02-4d5d-49d1-8625-f527062e778a","Type":"ContainerStarted","Data":"6a1ac35d3e45e4bf57ca6c56497da9ddd7adb7a4274fc0478c151aba998249e0"}
Aug 04 01:00:00.991571 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:00.991514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6" event={"ID":"744f5c02-4d5d-49d1-8625-f527062e778a","Type":"ContainerStarted","Data":"376835176fd3a67734432de82b6e12d88f1bab7c149f503b4455dd14500b265e"}
Aug 04 01:00:01.004262 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.004221    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc" podStartSLOduration=1.004207874 podStartE2EDuration="1.004207874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:00:01.002056012 +0000 UTC m=+3474.342091877" watchObservedRunningTime="2026-08-04 01:00:01.004207874 +0000 UTC m=+3474.344243738"
Aug 04 01:00:01.017292 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.017252    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6" podStartSLOduration=1.01723982 podStartE2EDuration="1.01723982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:00:01.015827748 +0000 UTC m=+3474.355863612" watchObservedRunningTime="2026-08-04 01:00:01.01723982 +0000 UTC m=+3474.357275685"
Aug 04 01:00:01.030617 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.030577    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq" podStartSLOduration=1.030566333 podStartE2EDuration="1.030566333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:00:01.02955958 +0000 UTC m=+3474.369595445" watchObservedRunningTime="2026-08-04 01:00:01.030566333 +0000 UTC m=+3474.370602213"
Aug 04 01:00:01.997213 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.997181    2571 generic.go:356] "Generic (PLEG): container finished" podID="11f964df-2804-403d-b231-fb4948787ede" containerID="f10acd19861c76817c69c9a1325b0d539d07d1a289cdd3a8c36ea241b669b9bc" exitCode=0
Aug 04 01:00:01.997590 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.997268    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc" event={"ID":"11f964df-2804-403d-b231-fb4948787ede","Type":"ContainerDied","Data":"f10acd19861c76817c69c9a1325b0d539d07d1a289cdd3a8c36ea241b669b9bc"}
Aug 04 01:00:01.998803 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.998781    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5e20b40-ec90-4bf2-952f-eb8bb9b37282" containerID="3a16f6edca71a60a7941160a817d3d13d58ec1284d280b3864b114c8fd499703" exitCode=0
Aug 04 01:00:01.998931 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:01.998847    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq" event={"ID":"f5e20b40-ec90-4bf2-952f-eb8bb9b37282","Type":"ContainerDied","Data":"3a16f6edca71a60a7941160a817d3d13d58ec1284d280b3864b114c8fd499703"}
Aug 04 01:00:02.000327 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:02.000303    2571 generic.go:356] "Generic (PLEG): container finished" podID="744f5c02-4d5d-49d1-8625-f527062e778a" containerID="6a1ac35d3e45e4bf57ca6c56497da9ddd7adb7a4274fc0478c151aba998249e0" exitCode=0
Aug 04 01:00:02.000417 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:02.000325    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6" event={"ID":"744f5c02-4d5d-49d1-8625-f527062e778a","Type":"ContainerDied","Data":"6a1ac35d3e45e4bf57ca6c56497da9ddd7adb7a4274fc0478c151aba998249e0"}
Aug 04 01:00:03.151554 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:03.151529    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"
Aug 04 01:00:03.219462 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:03.219436    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"
Aug 04 01:00:03.222496 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:03.222476    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"
Aug 04 01:00:04.011017 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.010988    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"
Aug 04 01:00:04.011017 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.010999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc" event={"ID":"11f964df-2804-403d-b231-fb4948787ede","Type":"ContainerDied","Data":"637f1e0f91cd02f10c5a9140626cee909b17b909f6006d99b65fef140497c4eb"}
Aug 04 01:00:04.011354 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.011048    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="637f1e0f91cd02f10c5a9140626cee909b17b909f6006d99b65fef140497c4eb"
Aug 04 01:00:04.012383 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.012358    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq"
Aug 04 01:00:04.012537 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.012357    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763420-s54pq" event={"ID":"f5e20b40-ec90-4bf2-952f-eb8bb9b37282","Type":"ContainerDied","Data":"16a76866d0c6cafb429049daea47b612b14db8d0c630f42045451e72d711c6bd"}
Aug 04 01:00:04.012537 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.012482    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16a76866d0c6cafb429049daea47b612b14db8d0c630f42045451e72d711c6bd"
Aug 04 01:00:04.013841 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.013824    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"
Aug 04 01:00:04.013955 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.013861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6" event={"ID":"744f5c02-4d5d-49d1-8625-f527062e778a","Type":"ContainerDied","Data":"376835176fd3a67734432de82b6e12d88f1bab7c149f503b4455dd14500b265e"}
Aug 04 01:00:04.013955 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:04.013898    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="376835176fd3a67734432de82b6e12d88f1bab7c149f503b4455dd14500b265e"
Aug 04 01:00:27.541117 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541081    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"]
Aug 04 01:00:27.541644 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541625    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="744f5c02-4d5d-49d1-8625-f527062e778a" containerName="cleanup"
Aug 04 01:00:27.541744 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541646    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="744f5c02-4d5d-49d1-8625-f527062e778a" containerName="cleanup"
Aug 04 01:00:27.541744 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541662    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e20b40-ec90-4bf2-952f-eb8bb9b37282" containerName="cleanup"
Aug 04 01:00:27.541744 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541670    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e20b40-ec90-4bf2-952f-eb8bb9b37282" containerName="cleanup"
Aug 04 01:00:27.541744 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541683    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f964df-2804-403d-b231-fb4948787ede" containerName="cleanup"
Aug 04 01:00:27.541744 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541707    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f964df-2804-403d-b231-fb4948787ede" containerName="cleanup"
Aug 04 01:00:27.541998 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541819    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e20b40-ec90-4bf2-952f-eb8bb9b37282" containerName="cleanup"
Aug 04 01:00:27.541998 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541836    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f964df-2804-403d-b231-fb4948787ede" containerName="cleanup"
Aug 04 01:00:27.541998 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.541848    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="744f5c02-4d5d-49d1-8625-f527062e778a" containerName="cleanup"
Aug 04 01:00:27.545178 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.545155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:27.547614 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.547597    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 01:00:27.553089 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.552846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"]
Aug 04 01:00:27.644383 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.644351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps\" (UID: \"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:27.745225 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.745191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps\" (UID: \"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:27.745815 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.745797    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps\" (UID: \"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:27.858583 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.858508    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:27.993992 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:27.993959    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"]
Aug 04 01:00:27.995144 ip-10-0-142-136 kubenswrapper[2571]: W0804 01:00:27.995112    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a4723f_2099_4c1b_a27d_0bee92b8fcf7.slice/crio-7a428e69ddb9e8c3c8b0e589887c5d7585051165ec4c8de4856ed6faaf3a1363 WatchSource:0}: Error finding container 7a428e69ddb9e8c3c8b0e589887c5d7585051165ec4c8de4856ed6faaf3a1363: Status 404 returned error can't find the container with id 7a428e69ddb9e8c3c8b0e589887c5d7585051165ec4c8de4856ed6faaf3a1363
Aug 04 01:00:28.126183 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:28.126151    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps" event={"ID":"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7","Type":"ContainerStarted","Data":"7a428e69ddb9e8c3c8b0e589887c5d7585051165ec4c8de4856ed6faaf3a1363"}
Aug 04 01:00:29.132771 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:29.132730    2571 generic.go:356] "Generic (PLEG): container finished" podID="a1a4723f-2099-4c1b-a27d-0bee92b8fcf7" containerID="4209500d36305e957869832a8c7c63064380da9f4bd98714c703d85d1d6d96b9" exitCode=0
Aug 04 01:00:29.133252 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:29.132817    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps" event={"ID":"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7","Type":"ContainerDied","Data":"4209500d36305e957869832a8c7c63064380da9f4bd98714c703d85d1d6d96b9"}
Aug 04 01:00:30.273064 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:30.273037    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:30.368503 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:30.368476    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7-maas-api-service-ca\") pod \"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7\" (UID: \"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7\") "
Aug 04 01:00:30.368852 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:30.368831    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1a4723f-2099-4c1b-a27d-0bee92b8fcf7" (UID: "a1a4723f-2099-4c1b-a27d-0bee92b8fcf7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:30.469536 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:30.469442    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7-maas-api-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:31.143921 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:31.143894    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"
Aug 04 01:00:31.145075 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:31.145046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps" event={"ID":"a1a4723f-2099-4c1b-a27d-0bee92b8fcf7","Type":"ContainerDied","Data":"7a428e69ddb9e8c3c8b0e589887c5d7585051165ec4c8de4856ed6faaf3a1363"}
Aug 04 01:00:31.145215 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:31.145087    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a428e69ddb9e8c3c8b0e589887c5d7585051165ec4c8de4856ed6faaf3a1363"
Aug 04 01:00:38.147197 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.147161    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"]
Aug 04 01:00:38.147788 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.147399    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" podUID="4b7c518e-7e6d-407e-9666-7d090828b30b" containerName="maas-api" containerID="cri-o://110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a" gracePeriod=30
Aug 04 01:00:38.176422 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.176372    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"]
Aug 04 01:00:38.178879 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.178856    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f277ac-29763420-wdjfc"]
Aug 04 01:00:38.209046 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.209016    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"]
Aug 04 01:00:38.209273 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.209229    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk" podUID="0e325c61-f2a5-45fe-a60e-ca4f6947c85c" containerName="payload-processing" containerID="cri-o://096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6" gracePeriod=30
Aug 04 01:00:38.216640 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.216609    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"]
Aug 04 01:00:38.216852 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.216815    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc" podUID="2691d22d-b562-4ba5-91a5-b1e311dab77a" containerName="payload-pre-processing" containerID="cri-o://8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33" gracePeriod=30
Aug 04 01:00:38.374500 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.374305    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"]
Aug 04 01:00:38.377727 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.377230    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f277ac-r56ps"]
Aug 04 01:00:38.486837 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.486805    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 01:00:38.529152 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.529127    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 01:00:38.532879 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.532856    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 01:00:38.643224 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643171    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls\") pod \"4b7c518e-7e6d-407e-9666-7d090828b30b\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") "
Aug 04 01:00:38.643224 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2691d22d-b562-4ba5-91a5-b1e311dab77a-plugins-config-volume\") pod \"2691d22d-b562-4ba5-91a5-b1e311dab77a\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") "
Aug 04 01:00:38.643224 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643238    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-plugins-config-volume\") pod \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") "
Aug 04 01:00:38.643554 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643255    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6b7j\" (UniqueName: \"kubernetes.io/projected/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-kube-api-access-f6b7j\") pod \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\" (UID: \"0e325c61-f2a5-45fe-a60e-ca4f6947c85c\") "
Aug 04 01:00:38.643554 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7fj8\" (UniqueName: \"kubernetes.io/projected/4b7c518e-7e6d-407e-9666-7d090828b30b-kube-api-access-h7fj8\") pod \"4b7c518e-7e6d-407e-9666-7d090828b30b\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") "
Aug 04 01:00:38.643554 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643478    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b2dl\" (UniqueName: \"kubernetes.io/projected/2691d22d-b562-4ba5-91a5-b1e311dab77a-kube-api-access-6b2dl\") pod \"2691d22d-b562-4ba5-91a5-b1e311dab77a\" (UID: \"2691d22d-b562-4ba5-91a5-b1e311dab77a\") "
Aug 04 01:00:38.643762 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643659    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2691d22d-b562-4ba5-91a5-b1e311dab77a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2691d22d-b562-4ba5-91a5-b1e311dab77a" (UID: "2691d22d-b562-4ba5-91a5-b1e311dab77a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:38.643762 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643737    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e325c61-f2a5-45fe-a60e-ca4f6947c85c" (UID: "0e325c61-f2a5-45fe-a60e-ca4f6947c85c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:38.643883 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.643831    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7c518e-7e6d-407e-9666-7d090828b30b-openshift-service-ca\") pod \"4b7c518e-7e6d-407e-9666-7d090828b30b\" (UID: \"4b7c518e-7e6d-407e-9666-7d090828b30b\") "
Aug 04 01:00:38.644320 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.644300    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2691d22d-b562-4ba5-91a5-b1e311dab77a-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:38.644407 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.644327    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:38.644407 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.644351    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b7c518e-7e6d-407e-9666-7d090828b30b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b7c518e-7e6d-407e-9666-7d090828b30b" (UID: "4b7c518e-7e6d-407e-9666-7d090828b30b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:38.645677 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.645646    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2691d22d-b562-4ba5-91a5-b1e311dab77a-kube-api-access-6b2dl" (OuterVolumeSpecName: "kube-api-access-6b2dl") pod "2691d22d-b562-4ba5-91a5-b1e311dab77a" (UID: "2691d22d-b562-4ba5-91a5-b1e311dab77a"). InnerVolumeSpecName "kube-api-access-6b2dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:38.645677 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.645673    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b7c518e-7e6d-407e-9666-7d090828b30b-kube-api-access-h7fj8" (OuterVolumeSpecName: "kube-api-access-h7fj8") pod "4b7c518e-7e6d-407e-9666-7d090828b30b" (UID: "4b7c518e-7e6d-407e-9666-7d090828b30b"). InnerVolumeSpecName "kube-api-access-h7fj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:38.645927 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.645870    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b7c518e-7e6d-407e-9666-7d090828b30b" (UID: "4b7c518e-7e6d-407e-9666-7d090828b30b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 01:00:38.645984 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.645965    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-kube-api-access-f6b7j" (OuterVolumeSpecName: "kube-api-access-f6b7j") pod "0e325c61-f2a5-45fe-a60e-ca4f6947c85c" (UID: "0e325c61-f2a5-45fe-a60e-ca4f6947c85c"). InnerVolumeSpecName "kube-api-access-f6b7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:38.745202 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.745120    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7c518e-7e6d-407e-9666-7d090828b30b-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:38.745202 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.745149    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6b7j\" (UniqueName: \"kubernetes.io/projected/0e325c61-f2a5-45fe-a60e-ca4f6947c85c-kube-api-access-f6b7j\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:38.745202 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.745159    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7fj8\" (UniqueName: \"kubernetes.io/projected/4b7c518e-7e6d-407e-9666-7d090828b30b-kube-api-access-h7fj8\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:38.745202 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.745169    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b2dl\" (UniqueName: \"kubernetes.io/projected/2691d22d-b562-4ba5-91a5-b1e311dab77a-kube-api-access-6b2dl\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:38.745202 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:38.745177    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7c518e-7e6d-407e-9666-7d090828b30b-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:39.146235 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.146203    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f964df-2804-403d-b231-fb4948787ede" path="/var/lib/kubelet/pods/11f964df-2804-403d-b231-fb4948787ede/volumes"
Aug 04 01:00:39.146537 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.146523    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a4723f-2099-4c1b-a27d-0bee92b8fcf7" path="/var/lib/kubelet/pods/a1a4723f-2099-4c1b-a27d-0bee92b8fcf7/volumes"
Aug 04 01:00:39.184563 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.184536    2571 generic.go:356] "Generic (PLEG): container finished" podID="4b7c518e-7e6d-407e-9666-7d090828b30b" containerID="110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a" exitCode=0
Aug 04 01:00:39.184969 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.184581    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"
Aug 04 01:00:39.184969 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.184614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" event={"ID":"4b7c518e-7e6d-407e-9666-7d090828b30b","Type":"ContainerDied","Data":"110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a"}
Aug 04 01:00:39.184969 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.184669    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb" event={"ID":"4b7c518e-7e6d-407e-9666-7d090828b30b","Type":"ContainerDied","Data":"63f12757f0e5593d9321022b9adc7491f1f106a19dccb4f1d87b691a9b006a31"}
Aug 04 01:00:39.184969 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.184721    2571 scope.go:117] "RemoveContainer" containerID="110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a"
Aug 04 01:00:39.186108 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.186086    2571 generic.go:356] "Generic (PLEG): container finished" podID="2691d22d-b562-4ba5-91a5-b1e311dab77a" containerID="8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33" exitCode=0
Aug 04 01:00:39.186205 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.186141    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"
Aug 04 01:00:39.186205 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.186180    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc" event={"ID":"2691d22d-b562-4ba5-91a5-b1e311dab77a","Type":"ContainerDied","Data":"8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33"}
Aug 04 01:00:39.186336 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.186218    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc" event={"ID":"2691d22d-b562-4ba5-91a5-b1e311dab77a","Type":"ContainerDied","Data":"7e81ceda8bf8c68b173f4ad26d5a6d10d346fba4375040c7983a3c3d92641094"}
Aug 04 01:00:39.187647 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.187621    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e325c61-f2a5-45fe-a60e-ca4f6947c85c" containerID="096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6" exitCode=0
Aug 04 01:00:39.187780 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.187655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk" event={"ID":"0e325c61-f2a5-45fe-a60e-ca4f6947c85c","Type":"ContainerDied","Data":"096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6"}
Aug 04 01:00:39.187780 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.187671    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"
Aug 04 01:00:39.187780 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.187684    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk" event={"ID":"0e325c61-f2a5-45fe-a60e-ca4f6947c85c","Type":"ContainerDied","Data":"9104e61c0fb0e6b83837503e60ac3c5cea53f30af07bdc5c931a47a7a280a8ae"}
Aug 04 01:00:39.194958 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.194943    2571 scope.go:117] "RemoveContainer" containerID="110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a"
Aug 04 01:00:39.195198 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:00:39.195182    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a\": container with ID starting with 110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a not found: ID does not exist" containerID="110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a"
Aug 04 01:00:39.195249 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.195205    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a"} err="failed to get container status \"110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a\": rpc error: code = NotFound desc = could not find container \"110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a\": container with ID starting with 110a649bca883b6f466ffe2ddcb6f01d44b619f91daf0ae9e288c2fea2b4018a not found: ID does not exist"
Aug 04 01:00:39.195249 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.195220    2571 scope.go:117] "RemoveContainer" containerID="8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33"
Aug 04 01:00:39.202493 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.202474    2571 scope.go:117] "RemoveContainer" containerID="8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33"
Aug 04 01:00:39.202767 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:00:39.202741    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33\": container with ID starting with 8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33 not found: ID does not exist" containerID="8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33"
Aug 04 01:00:39.202849 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.202765    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33"} err="failed to get container status \"8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33\": rpc error: code = NotFound desc = could not find container \"8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33\": container with ID starting with 8d2f9d53fe3fa4ab03c86e109c34945c90d16cb8387aa910f5034ec6491c4f33 not found: ID does not exist"
Aug 04 01:00:39.202849 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.202781    2571 scope.go:117] "RemoveContainer" containerID="096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6"
Aug 04 01:00:39.206135 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.206114    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"]
Aug 04 01:00:39.210221 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.210194    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f277ac-6b54b8488b-dpxtb"]
Aug 04 01:00:39.210984 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.210968    2571 scope.go:117] "RemoveContainer" containerID="096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6"
Aug 04 01:00:39.211252 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:00:39.211234    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6\": container with ID starting with 096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6 not found: ID does not exist" containerID="096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6"
Aug 04 01:00:39.211320 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.211257    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6"} err="failed to get container status \"096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6\": rpc error: code = NotFound desc = could not find container \"096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6\": container with ID starting with 096cff5be0b76474fd0bbb82fd83da564b3e9907cceef44d91a350f302e6b4a6 not found: ID does not exist"
Aug 04 01:00:39.220139 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.220120    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"]
Aug 04 01:00:39.224200 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.224181    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f277ac-5555d94448-hf7qc"]
Aug 04 01:00:39.235766 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.235739    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"]
Aug 04 01:00:39.237455 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:39.237436    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f277ac-6759cc7d76-pkfdk"]
Aug 04 01:00:41.146503 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:41.146470    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e325c61-f2a5-45fe-a60e-ca4f6947c85c" path="/var/lib/kubelet/pods/0e325c61-f2a5-45fe-a60e-ca4f6947c85c/volumes"
Aug 04 01:00:41.146881 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:41.146817    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2691d22d-b562-4ba5-91a5-b1e311dab77a" path="/var/lib/kubelet/pods/2691d22d-b562-4ba5-91a5-b1e311dab77a/volumes"
Aug 04 01:00:41.147152 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:41.147139    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b7c518e-7e6d-407e-9666-7d090828b30b" path="/var/lib/kubelet/pods/4b7c518e-7e6d-407e-9666-7d090828b30b/volumes"
Aug 04 01:00:45.377827 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.377792    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"]
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378140    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a4723f-2099-4c1b-a27d-0bee92b8fcf7" containerName="revoke-keys"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378151    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a4723f-2099-4c1b-a27d-0bee92b8fcf7" containerName="revoke-keys"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378167    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2691d22d-b562-4ba5-91a5-b1e311dab77a" containerName="payload-pre-processing"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378173    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2691d22d-b562-4ba5-91a5-b1e311dab77a" containerName="payload-pre-processing"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378186    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e325c61-f2a5-45fe-a60e-ca4f6947c85c" containerName="payload-processing"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378192    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e325c61-f2a5-45fe-a60e-ca4f6947c85c" containerName="payload-processing"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378203    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b7c518e-7e6d-407e-9666-7d090828b30b" containerName="maas-api"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378208    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b7c518e-7e6d-407e-9666-7d090828b30b" containerName="maas-api"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378268    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e325c61-f2a5-45fe-a60e-ca4f6947c85c" containerName="payload-processing"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378277    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2691d22d-b562-4ba5-91a5-b1e311dab77a" containerName="payload-pre-processing"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378284    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a4723f-2099-4c1b-a27d-0bee92b8fcf7" containerName="revoke-keys"
Aug 04 01:00:45.378330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.378290    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b7c518e-7e6d-407e-9666-7d090828b30b" containerName="maas-api"
Aug 04 01:00:45.382943 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.382920    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:45.385457 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.385434    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 01:00:45.391393 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.391365    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"]
Aug 04 01:00:45.505056 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.505022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270493bc-b5f0-4925-a7f5-913b2c1412f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c\" (UID: \"270493bc-b5f0-4925-a7f5-913b2c1412f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:45.605560 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.605525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270493bc-b5f0-4925-a7f5-913b2c1412f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c\" (UID: \"270493bc-b5f0-4925-a7f5-913b2c1412f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:45.606183 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.606160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270493bc-b5f0-4925-a7f5-913b2c1412f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c\" (UID: \"270493bc-b5f0-4925-a7f5-913b2c1412f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:45.695163 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.695079    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:45.832715 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:45.832669    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"]
Aug 04 01:00:45.833568 ip-10-0-142-136 kubenswrapper[2571]: W0804 01:00:45.833543    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270493bc_b5f0_4925_a7f5_913b2c1412f6.slice/crio-91a598e95e6a9fd6930ce7820ce0d32b2d13d37018ec6fd2141207cb11fd5735 WatchSource:0}: Error finding container 91a598e95e6a9fd6930ce7820ce0d32b2d13d37018ec6fd2141207cb11fd5735: Status 404 returned error can't find the container with id 91a598e95e6a9fd6930ce7820ce0d32b2d13d37018ec6fd2141207cb11fd5735
Aug 04 01:00:46.233409 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:46.233372    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c" event={"ID":"270493bc-b5f0-4925-a7f5-913b2c1412f6","Type":"ContainerStarted","Data":"631b7181248bda88db89497873202250ed530c22103d308696e044f59ab0401e"}
Aug 04 01:00:46.233594 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:46.233465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c" event={"ID":"270493bc-b5f0-4925-a7f5-913b2c1412f6","Type":"ContainerStarted","Data":"91a598e95e6a9fd6930ce7820ce0d32b2d13d37018ec6fd2141207cb11fd5735"}
Aug 04 01:00:46.248884 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:46.248839    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c" podStartSLOduration=1.248825037 podStartE2EDuration="1.248825037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:00:46.247620739 +0000 UTC m=+3519.587656606" watchObservedRunningTime="2026-08-04 01:00:46.248825037 +0000 UTC m=+3519.588860901"
Aug 04 01:00:47.239854 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:47.239810    2571 generic.go:356] "Generic (PLEG): container finished" podID="270493bc-b5f0-4925-a7f5-913b2c1412f6" containerID="631b7181248bda88db89497873202250ed530c22103d308696e044f59ab0401e" exitCode=0
Aug 04 01:00:47.240245 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:47.239888    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c" event={"ID":"270493bc-b5f0-4925-a7f5-913b2c1412f6","Type":"ContainerDied","Data":"631b7181248bda88db89497873202250ed530c22103d308696e044f59ab0401e"}
Aug 04 01:00:48.380340 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:48.380313    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:48.535569 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:48.535480    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270493bc-b5f0-4925-a7f5-913b2c1412f6-maas-api-service-ca\") pod \"270493bc-b5f0-4925-a7f5-913b2c1412f6\" (UID: \"270493bc-b5f0-4925-a7f5-913b2c1412f6\") "
Aug 04 01:00:48.535858 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:48.535836    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/270493bc-b5f0-4925-a7f5-913b2c1412f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "270493bc-b5f0-4925-a7f5-913b2c1412f6" (UID: "270493bc-b5f0-4925-a7f5-913b2c1412f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:48.636996 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:48.636960    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270493bc-b5f0-4925-a7f5-913b2c1412f6-maas-api-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:49.251464 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:49.251440    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"
Aug 04 01:00:49.251464 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:49.251454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c" event={"ID":"270493bc-b5f0-4925-a7f5-913b2c1412f6","Type":"ContainerDied","Data":"91a598e95e6a9fd6930ce7820ce0d32b2d13d37018ec6fd2141207cb11fd5735"}
Aug 04 01:00:49.251657 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:49.251503    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91a598e95e6a9fd6930ce7820ce0d32b2d13d37018ec6fd2141207cb11fd5735"
Aug 04 01:00:55.795616 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:55.795582    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"]
Aug 04 01:00:55.796113 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:55.795925    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" podUID="d4ed26a4-5c35-4f17-9de7-fb80392bb636" containerName="maas-api" containerID="cri-o://fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a" gracePeriod=30
Aug 04 01:00:55.856128 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:55.856100    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"]
Aug 04 01:00:55.856318 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:55.856292    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt" podUID="26ded846-b065-4088-9bfc-7ada6f09100e" containerName="payload-processing" containerID="cri-o://d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447" gracePeriod=30
Aug 04 01:00:55.863242 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:55.863061    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"]
Aug 04 01:00:55.863383 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:55.863259    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf" podUID="3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" containerName="payload-pre-processing" containerID="cri-o://367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63" gracePeriod=30
Aug 04 01:00:56.004437 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.004390    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"]
Aug 04 01:00:56.007051 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.007015    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a5b2e0-lmj9c"]
Aug 04 01:00:56.168452 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.168430    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 01:00:56.171532 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.171512    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 01:00:56.177450 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.177435    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 01:00:56.203338 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26ded846-b065-4088-9bfc-7ada6f09100e-plugins-config-volume\") pod \"26ded846-b065-4088-9bfc-7ada6f09100e\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") "
Aug 04 01:00:56.203486 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203352    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ed26a4-5c35-4f17-9de7-fb80392bb636-openshift-service-ca\") pod \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") "
Aug 04 01:00:56.203486 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203390    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls\") pod \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") "
Aug 04 01:00:56.203486 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fjnm\" (UniqueName: \"kubernetes.io/projected/d4ed26a4-5c35-4f17-9de7-fb80392bb636-kube-api-access-5fjnm\") pod \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\" (UID: \"d4ed26a4-5c35-4f17-9de7-fb80392bb636\") "
Aug 04 01:00:56.203486 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203460    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vp6f\" (UniqueName: \"kubernetes.io/projected/26ded846-b065-4088-9bfc-7ada6f09100e-kube-api-access-5vp6f\") pod \"26ded846-b065-4088-9bfc-7ada6f09100e\" (UID: \"26ded846-b065-4088-9bfc-7ada6f09100e\") "
Aug 04 01:00:56.203758 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203524    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpc2w\" (UniqueName: \"kubernetes.io/projected/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-kube-api-access-hpc2w\") pod \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") "
Aug 04 01:00:56.203758 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-plugins-config-volume\") pod \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\" (UID: \"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775\") "
Aug 04 01:00:56.203873 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.203772    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ded846-b065-4088-9bfc-7ada6f09100e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26ded846-b065-4088-9bfc-7ada6f09100e" (UID: "26ded846-b065-4088-9bfc-7ada6f09100e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:56.204433 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.204410    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26ded846-b065-4088-9bfc-7ada6f09100e-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.204433 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.204420    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ed26a4-5c35-4f17-9de7-fb80392bb636-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4ed26a4-5c35-4f17-9de7-fb80392bb636" (UID: "d4ed26a4-5c35-4f17-9de7-fb80392bb636"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:56.205110 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.204956    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" (UID: "3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:56.206664 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.206631    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4ed26a4-5c35-4f17-9de7-fb80392bb636" (UID: "d4ed26a4-5c35-4f17-9de7-fb80392bb636"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 01:00:56.206910 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.206893    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ed26a4-5c35-4f17-9de7-fb80392bb636-kube-api-access-5fjnm" (OuterVolumeSpecName: "kube-api-access-5fjnm") pod "d4ed26a4-5c35-4f17-9de7-fb80392bb636" (UID: "d4ed26a4-5c35-4f17-9de7-fb80392bb636"). InnerVolumeSpecName "kube-api-access-5fjnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:56.207008 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.206994    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-kube-api-access-hpc2w" (OuterVolumeSpecName: "kube-api-access-hpc2w") pod "3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" (UID: "3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775"). InnerVolumeSpecName "kube-api-access-hpc2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:56.207202 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.207184    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ded846-b065-4088-9bfc-7ada6f09100e-kube-api-access-5vp6f" (OuterVolumeSpecName: "kube-api-access-5vp6f") pod "26ded846-b065-4088-9bfc-7ada6f09100e" (UID: "26ded846-b065-4088-9bfc-7ada6f09100e"). InnerVolumeSpecName "kube-api-access-5vp6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:56.286642 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.286612    2571 generic.go:356] "Generic (PLEG): container finished" podID="d4ed26a4-5c35-4f17-9de7-fb80392bb636" containerID="fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a" exitCode=0
Aug 04 01:00:56.286806 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.286656    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"
Aug 04 01:00:56.286806 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.286653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" event={"ID":"d4ed26a4-5c35-4f17-9de7-fb80392bb636","Type":"ContainerDied","Data":"fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a"}
Aug 04 01:00:56.286806 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.286734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj" event={"ID":"d4ed26a4-5c35-4f17-9de7-fb80392bb636","Type":"ContainerDied","Data":"38e695422ae779843bcf7879c90b5f1038b89b245d120c228227fdcedccbaafe"}
Aug 04 01:00:56.286806 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.286767    2571 scope.go:117] "RemoveContainer" containerID="fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a"
Aug 04 01:00:56.288020 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.287998    2571 generic.go:356] "Generic (PLEG): container finished" podID="3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" containerID="367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63" exitCode=0
Aug 04 01:00:56.288148 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.288026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf" event={"ID":"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775","Type":"ContainerDied","Data":"367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63"}
Aug 04 01:00:56.288148 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.288071    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"
Aug 04 01:00:56.288148 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.288090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf" event={"ID":"3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775","Type":"ContainerDied","Data":"5a9d328bc4bd2c2787f87cc79cfc403e5b26981f775ca57674697d6c59025424"}
Aug 04 01:00:56.289416 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.289396    2571 generic.go:356] "Generic (PLEG): container finished" podID="26ded846-b065-4088-9bfc-7ada6f09100e" containerID="d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447" exitCode=0
Aug 04 01:00:56.289512 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.289426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt" event={"ID":"26ded846-b065-4088-9bfc-7ada6f09100e","Type":"ContainerDied","Data":"d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447"}
Aug 04 01:00:56.289512 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.289448    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"
Aug 04 01:00:56.289512 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.289487    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt" event={"ID":"26ded846-b065-4088-9bfc-7ada6f09100e","Type":"ContainerDied","Data":"16156d1e0516bb947a28fed8e7e351ccf3c5ce75c9717402f74366b1dd9617b1"}
Aug 04 01:00:56.296812 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.296654    2571 scope.go:117] "RemoveContainer" containerID="fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a"
Aug 04 01:00:56.297094 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:00:56.297047    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a\": container with ID starting with fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a not found: ID does not exist" containerID="fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a"
Aug 04 01:00:56.297199 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.297091    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a"} err="failed to get container status \"fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a\": rpc error: code = NotFound desc = could not find container \"fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a\": container with ID starting with fed4061d15577522e10808d60ed71591b22b600beddf09270cd9257e3fa4241a not found: ID does not exist"
Aug 04 01:00:56.297199 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.297114    2571 scope.go:117] "RemoveContainer" containerID="367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63"
Aug 04 01:00:56.305201 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305162    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vp6f\" (UniqueName: \"kubernetes.io/projected/26ded846-b065-4088-9bfc-7ada6f09100e-kube-api-access-5vp6f\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.305201 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305179    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpc2w\" (UniqueName: \"kubernetes.io/projected/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-kube-api-access-hpc2w\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.305201 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305188    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.305201 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305198    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ed26a4-5c35-4f17-9de7-fb80392bb636-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.305342 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305210    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4ed26a4-5c35-4f17-9de7-fb80392bb636-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.305342 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305220    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fjnm\" (UniqueName: \"kubernetes.io/projected/d4ed26a4-5c35-4f17-9de7-fb80392bb636-kube-api-access-5fjnm\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:00:56.305342 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305231    2571 scope.go:117] "RemoveContainer" containerID="367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63"
Aug 04 01:00:56.305472 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:00:56.305453    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63\": container with ID starting with 367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63 not found: ID does not exist" containerID="367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63"
Aug 04 01:00:56.305511 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305480    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63"} err="failed to get container status \"367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63\": rpc error: code = NotFound desc = could not find container \"367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63\": container with ID starting with 367ad5050b04cb095870eb9eafa91850412f51879fedd73d735d3aaa2a177a63 not found: ID does not exist"
Aug 04 01:00:56.305511 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.305497    2571 scope.go:117] "RemoveContainer" containerID="d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447"
Aug 04 01:00:56.312414 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.312393    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"]
Aug 04 01:00:56.313163 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.313146    2571 scope.go:117] "RemoveContainer" containerID="d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447"
Aug 04 01:00:56.313411 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:00:56.313394    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447\": container with ID starting with d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447 not found: ID does not exist" containerID="d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447"
Aug 04 01:00:56.313467 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.313415    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447"} err="failed to get container status \"d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447\": rpc error: code = NotFound desc = could not find container \"d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447\": container with ID starting with d6bc89bd2bd9087ca881f578f59136a24594759ea0273de9f8cdf3bf51b45447 not found: ID does not exist"
Aug 04 01:00:56.316158 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.316141    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a5b2e0-6858b58d9b-z6fjj"]
Aug 04 01:00:56.327469 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.327418    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"]
Aug 04 01:00:56.331977 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.331947    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a5b2e0-bbbdb86fd-5m8rt"]
Aug 04 01:00:56.342231 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.342211    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"]
Aug 04 01:00:56.348427 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:56.348406    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a5b2e0-5dcc75f788-5wcjf"]
Aug 04 01:00:57.147187 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:57.147156    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ded846-b065-4088-9bfc-7ada6f09100e" path="/var/lib/kubelet/pods/26ded846-b065-4088-9bfc-7ada6f09100e/volumes"
Aug 04 01:00:57.147646 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:57.147591    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270493bc-b5f0-4925-a7f5-913b2c1412f6" path="/var/lib/kubelet/pods/270493bc-b5f0-4925-a7f5-913b2c1412f6/volumes"
Aug 04 01:00:57.148009 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:57.147989    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" path="/var/lib/kubelet/pods/3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775/volumes"
Aug 04 01:00:57.148386 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:00:57.148368    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ed26a4-5c35-4f17-9de7-fb80392bb636" path="/var/lib/kubelet/pods/d4ed26a4-5c35-4f17-9de7-fb80392bb636/volumes"
Aug 04 01:01:13.553760 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.553728    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"]
Aug 04 01:01:13.554362 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.553923    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54" podUID="aeb5145a-158e-4ffb-a977-ed3bf142cda2" containerName="maas-api" containerID="cri-o://1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce" gracePeriod=30
Aug 04 01:01:13.587723 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.587679    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"]
Aug 04 01:01:13.590117 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.590098    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5396f3-29763420-p8pb6"]
Aug 04 01:01:13.616115 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.616094    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"]
Aug 04 01:01:13.616330 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.616305    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x" podUID="4fd969e4-9ca9-41e9-9a17-4820df36811b" containerName="payload-processing" containerID="cri-o://e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84" gracePeriod=30
Aug 04 01:01:13.627571 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.627546    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"]
Aug 04 01:01:13.627782 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.627757    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" podUID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" containerName="payload-pre-processing" containerID="cri-o://ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2" gracePeriod=30
Aug 04 01:01:13.901886 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.901860    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 01:01:13.916395 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.916377    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 01:01:13.930271 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.930244    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 01:01:13.935511 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.935490    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxkwm\" (UniqueName: \"kubernetes.io/projected/aeb5145a-158e-4ffb-a977-ed3bf142cda2-kube-api-access-lxkwm\") pod \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") "
Aug 04 01:01:13.935618 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.935530    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb5145a-158e-4ffb-a977-ed3bf142cda2-maas-api-tls\") pod \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") "
Aug 04 01:01:13.935618 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.935575    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb5145a-158e-4ffb-a977-ed3bf142cda2-openshift-service-ca\") pod \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\" (UID: \"aeb5145a-158e-4ffb-a977-ed3bf142cda2\") "
Aug 04 01:01:13.936003 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.935973    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb5145a-158e-4ffb-a977-ed3bf142cda2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aeb5145a-158e-4ffb-a977-ed3bf142cda2" (UID: "aeb5145a-158e-4ffb-a977-ed3bf142cda2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:01:13.937511 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.937491    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb5145a-158e-4ffb-a977-ed3bf142cda2-kube-api-access-lxkwm" (OuterVolumeSpecName: "kube-api-access-lxkwm") pod "aeb5145a-158e-4ffb-a977-ed3bf142cda2" (UID: "aeb5145a-158e-4ffb-a977-ed3bf142cda2"). InnerVolumeSpecName "kube-api-access-lxkwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:01:13.937618 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:13.937535    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb5145a-158e-4ffb-a977-ed3bf142cda2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aeb5145a-158e-4ffb-a977-ed3bf142cda2" (UID: "aeb5145a-158e-4ffb-a977-ed3bf142cda2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 01:01:14.036685 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.036659    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47ca6cc-0298-4d0b-afe1-17ffebeea937-plugins-config-volume\") pod \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") "
Aug 04 01:01:14.036841 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.036724    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd969e4-9ca9-41e9-9a17-4820df36811b-plugins-config-volume\") pod \"4fd969e4-9ca9-41e9-9a17-4820df36811b\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") "
Aug 04 01:01:14.036841 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.036814    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6whz\" (UniqueName: \"kubernetes.io/projected/4fd969e4-9ca9-41e9-9a17-4820df36811b-kube-api-access-s6whz\") pod \"4fd969e4-9ca9-41e9-9a17-4820df36811b\" (UID: \"4fd969e4-9ca9-41e9-9a17-4820df36811b\") "
Aug 04 01:01:14.036937 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.036881    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf6pg\" (UniqueName: \"kubernetes.io/projected/d47ca6cc-0298-4d0b-afe1-17ffebeea937-kube-api-access-zf6pg\") pod \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\" (UID: \"d47ca6cc-0298-4d0b-afe1-17ffebeea937\") "
Aug 04 01:01:14.037004 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.036982    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d47ca6cc-0298-4d0b-afe1-17ffebeea937-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d47ca6cc-0298-4d0b-afe1-17ffebeea937" (UID: "d47ca6cc-0298-4d0b-afe1-17ffebeea937"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:01:14.037064 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.037046    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd969e4-9ca9-41e9-9a17-4820df36811b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4fd969e4-9ca9-41e9-9a17-4820df36811b" (UID: "4fd969e4-9ca9-41e9-9a17-4820df36811b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:01:14.037134 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.037116    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47ca6cc-0298-4d0b-afe1-17ffebeea937-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.037198 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.037138    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd969e4-9ca9-41e9-9a17-4820df36811b-plugins-config-volume\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.037198 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.037148    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxkwm\" (UniqueName: \"kubernetes.io/projected/aeb5145a-158e-4ffb-a977-ed3bf142cda2-kube-api-access-lxkwm\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.037198 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.037156    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb5145a-158e-4ffb-a977-ed3bf142cda2-maas-api-tls\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.037198 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.037165    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb5145a-158e-4ffb-a977-ed3bf142cda2-openshift-service-ca\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.038758 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.038737    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd969e4-9ca9-41e9-9a17-4820df36811b-kube-api-access-s6whz" (OuterVolumeSpecName: "kube-api-access-s6whz") pod "4fd969e4-9ca9-41e9-9a17-4820df36811b" (UID: "4fd969e4-9ca9-41e9-9a17-4820df36811b"). InnerVolumeSpecName "kube-api-access-s6whz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:01:14.038945 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.038925    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47ca6cc-0298-4d0b-afe1-17ffebeea937-kube-api-access-zf6pg" (OuterVolumeSpecName: "kube-api-access-zf6pg") pod "d47ca6cc-0298-4d0b-afe1-17ffebeea937" (UID: "d47ca6cc-0298-4d0b-afe1-17ffebeea937"). InnerVolumeSpecName "kube-api-access-zf6pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:01:14.138113 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.138090    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf6pg\" (UniqueName: \"kubernetes.io/projected/d47ca6cc-0298-4d0b-afe1-17ffebeea937-kube-api-access-zf6pg\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.138113 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.138112    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6whz\" (UniqueName: \"kubernetes.io/projected/4fd969e4-9ca9-41e9-9a17-4820df36811b-kube-api-access-s6whz\") on node \"ip-10-0-142-136.ec2.internal\" DevicePath \"\""
Aug 04 01:01:14.387981 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.387950    2571 generic.go:356] "Generic (PLEG): container finished" podID="aeb5145a-158e-4ffb-a977-ed3bf142cda2" containerID="1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce" exitCode=0
Aug 04 01:01:14.388176 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.388010    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"
Aug 04 01:01:14.388176 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.388035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54" event={"ID":"aeb5145a-158e-4ffb-a977-ed3bf142cda2","Type":"ContainerDied","Data":"1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce"}
Aug 04 01:01:14.388176 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.388086    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54" event={"ID":"aeb5145a-158e-4ffb-a977-ed3bf142cda2","Type":"ContainerDied","Data":"3a0ac1439369664d2538208049fe2d340b2dbc45460f750eab4e6dc083cbf724"}
Aug 04 01:01:14.388176 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.388114    2571 scope.go:117] "RemoveContainer" containerID="1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce"
Aug 04 01:01:14.389306 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.389284    2571 generic.go:356] "Generic (PLEG): container finished" podID="4fd969e4-9ca9-41e9-9a17-4820df36811b" containerID="e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84" exitCode=0
Aug 04 01:01:14.389423 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.389359    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"
Aug 04 01:01:14.389423 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.389379    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x" event={"ID":"4fd969e4-9ca9-41e9-9a17-4820df36811b","Type":"ContainerDied","Data":"e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84"}
Aug 04 01:01:14.389550 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.389434    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x" event={"ID":"4fd969e4-9ca9-41e9-9a17-4820df36811b","Type":"ContainerDied","Data":"6d77e17b071b0cbd60a8c334510336ae84a6eb7faffbe762cf7c6da1f675ddce"}
Aug 04 01:01:14.390736 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.390711    2571 generic.go:356] "Generic (PLEG): container finished" podID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" containerID="ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2" exitCode=0
Aug 04 01:01:14.390841 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.390746    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"
Aug 04 01:01:14.390841 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.390756    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" event={"ID":"d47ca6cc-0298-4d0b-afe1-17ffebeea937","Type":"ContainerDied","Data":"ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2"}
Aug 04 01:01:14.390841 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.390796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8" event={"ID":"d47ca6cc-0298-4d0b-afe1-17ffebeea937","Type":"ContainerDied","Data":"f71d974130589ea69029acf0ba15224b4c1077d1472e4d7c928395bc31638697"}
Aug 04 01:01:14.396593 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.396575    2571 scope.go:117] "RemoveContainer" containerID="1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce"
Aug 04 01:01:14.396872 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:01:14.396851    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce\": container with ID starting with 1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce not found: ID does not exist" containerID="1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce"
Aug 04 01:01:14.396960 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.396881    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce"} err="failed to get container status \"1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce\": rpc error: code = NotFound desc = could not find container \"1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce\": container with ID starting with 1a9e9588f62668a464d0d1d3a347d425aeee97c048e6b95b912231ab6c1b86ce not found: ID does not exist"
Aug 04 01:01:14.396960 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.396904    2571 scope.go:117] "RemoveContainer" containerID="e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84"
Aug 04 01:01:14.406205 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.406190    2571 scope.go:117] "RemoveContainer" containerID="e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84"
Aug 04 01:01:14.406450 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:01:14.406432    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84\": container with ID starting with e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84 not found: ID does not exist" containerID="e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84"
Aug 04 01:01:14.406498 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.406457    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84"} err="failed to get container status \"e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84\": rpc error: code = NotFound desc = could not find container \"e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84\": container with ID starting with e2d429d1c82e63e8f46dd2dfd84a5447bd0f7435be61092ee73d1ea982652f84 not found: ID does not exist"
Aug 04 01:01:14.406498 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.406473    2571 scope.go:117] "RemoveContainer" containerID="ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2"
Aug 04 01:01:14.413591 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.413576    2571 scope.go:117] "RemoveContainer" containerID="ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2"
Aug 04 01:01:14.413866 ip-10-0-142-136 kubenswrapper[2571]: E0804 01:01:14.413846    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2\": container with ID starting with ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2 not found: ID does not exist" containerID="ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2"
Aug 04 01:01:14.413937 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.413876    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2"} err="failed to get container status \"ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2\": rpc error: code = NotFound desc = could not find container \"ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2\": container with ID starting with ba1892fee085e21a5f20a626c236759c3eefa4887d314fc045e90e639c8c3bc2 not found: ID does not exist"
Aug 04 01:01:14.425994 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.425971    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"]
Aug 04 01:01:14.429374 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.429355    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5396f3-56c994797b-kjtj8"]
Aug 04 01:01:14.440086 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.440067    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"]
Aug 04 01:01:14.448630 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.448612    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5396f3-cbbc4568-w6r54"]
Aug 04 01:01:14.458896 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.458873    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"]
Aug 04 01:01:14.461473 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:14.461454    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-5396f3-7657d4cbfd-85c5x"]
Aug 04 01:01:15.145557 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:15.145528    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd969e4-9ca9-41e9-9a17-4820df36811b" path="/var/lib/kubelet/pods/4fd969e4-9ca9-41e9-9a17-4820df36811b/volumes"
Aug 04 01:01:15.146014 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:15.145833    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="744f5c02-4d5d-49d1-8625-f527062e778a" path="/var/lib/kubelet/pods/744f5c02-4d5d-49d1-8625-f527062e778a/volumes"
Aug 04 01:01:15.146136 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:15.146123    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb5145a-158e-4ffb-a977-ed3bf142cda2" path="/var/lib/kubelet/pods/aeb5145a-158e-4ffb-a977-ed3bf142cda2/volumes"
Aug 04 01:01:15.146433 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:15.146421    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" path="/var/lib/kubelet/pods/d47ca6cc-0298-4d0b-afe1-17ffebeea937/volumes"
Aug 04 01:01:26.482445 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:26.482407    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-89565659c-sbthq_33541d06-f2ef-4937-80f5-125f6cca7025/manager/0.log"
Aug 04 01:01:26.932098 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:26.932073    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-pzjfv_02700f58-1424-4511-8f9f-5ba5830e1829/copy-manifests/0.log"
Aug 04 01:01:26.944565 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:26.944535    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-pzjfv_02700f58-1424-4511-8f9f-5ba5830e1829/manager/0.log"
Aug 04 01:01:27.722142 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:27.722113    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29763420-s54pq_f5e20b40-ec90-4bf2-952f-eb8bb9b37282/cleanup/0.log"
Aug 04 01:01:29.691786 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:29.691755    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8zngn_73d75a71-c693-4405-94ed-acc82cd98d93/discovery/0.log"
Aug 04 01:01:30.131723 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:30.131681    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ncqq5_db6a73b9-fcd9-4c35-8a92-46b333b1b879/payload-pre-processing/0.log"
Aug 04 01:01:30.240975 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:30.240946    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-wh2dm_cf06cf76-5156-41c5-b637-e206b34005c0/payload-processing/0.log"
Aug 04 01:01:30.349831 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:30.349802    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-678c5cc8f6-hxqbl_8eec624e-ae11-4621-b2ca-fecd3c42cc50/router/0.log"
Aug 04 01:01:30.778994 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:30.778953    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-z479r_c2967a26-cc24-48de-b52f-de96b18760a8/main/0.log"
Aug 04 01:01:38.952851 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:38.952824    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ddcl4_87f93f9e-4024-453f-b593-7bd09fe5ea55/global-pull-secret-syncer/0.log"
Aug 04 01:01:39.129834 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:39.129803    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lsq9x_bf8a8e2c-c735-45f9-887e-2ff2d93e1312/konnectivity-agent/0.log"
Aug 04 01:01:39.179883 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:39.179855    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-136.ec2.internal_4e4cea72394bd0b0963f00a98984e037/haproxy/0.log"
Aug 04 01:01:46.461064 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:46.461033    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-f9x5w_77a6b7e1-4933-44e3-8ae6-7c18e7d81ee7/cluster-monitoring-operator/0.log"
Aug 04 01:01:46.626094 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:46.626068    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hb6c_0c60b60f-666e-4613-803b-527881ddd20e/node-exporter/0.log"
Aug 04 01:01:46.648103 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:46.648075    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hb6c_0c60b60f-666e-4613-803b-527881ddd20e/kube-rbac-proxy/0.log"
Aug 04 01:01:46.679439 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:46.679416    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hb6c_0c60b60f-666e-4613-803b-527881ddd20e/init-textfile/0.log"
Aug 04 01:01:49.245674 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.245644    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/1.log"
Aug 04 01:01:49.249894 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.249873    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-87nm2_96010a8d-bd91-4415-a612-df983492481b/console-operator/2.log"
Aug 04 01:01:49.524365 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524282    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"]
Aug 04 01:01:49.524585 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524572    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ded846-b065-4088-9bfc-7ada6f09100e" containerName="payload-processing"
Aug 04 01:01:49.524629 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524588    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ded846-b065-4088-9bfc-7ada6f09100e" containerName="payload-processing"
Aug 04 01:01:49.524629 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524600    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb5145a-158e-4ffb-a977-ed3bf142cda2" containerName="maas-api"
Aug 04 01:01:49.524629 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524605    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb5145a-158e-4ffb-a977-ed3bf142cda2" containerName="maas-api"
Aug 04 01:01:49.524629 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524618    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270493bc-b5f0-4925-a7f5-913b2c1412f6" containerName="revoke-keys"
Aug 04 01:01:49.524629 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524623    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="270493bc-b5f0-4925-a7f5-913b2c1412f6" containerName="revoke-keys"
Aug 04 01:01:49.524629 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524631    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd969e4-9ca9-41e9-9a17-4820df36811b" containerName="payload-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524637    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd969e4-9ca9-41e9-9a17-4820df36811b" containerName="payload-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524648    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" containerName="payload-pre-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524653    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" containerName="payload-pre-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524659    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ed26a4-5c35-4f17-9de7-fb80392bb636" containerName="maas-api"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524664    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ed26a4-5c35-4f17-9de7-fb80392bb636" containerName="maas-api"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524674    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" containerName="payload-pre-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524678    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" containerName="payload-pre-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524747    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47ca6cc-0298-4d0b-afe1-17ffebeea937" containerName="payload-pre-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524756    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb5145a-158e-4ffb-a977-ed3bf142cda2" containerName="maas-api"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524762    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ded846-b065-4088-9bfc-7ada6f09100e" containerName="payload-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524768    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd969e4-9ca9-41e9-9a17-4820df36811b" containerName="payload-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524774    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="270493bc-b5f0-4925-a7f5-913b2c1412f6" containerName="revoke-keys"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524779    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2e83c5-cf2c-45bf-89ef-f2d64c2cd775" containerName="payload-pre-processing"
Aug 04 01:01:49.524845 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.524784    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ed26a4-5c35-4f17-9de7-fb80392bb636" containerName="maas-api"
Aug 04 01:01:49.527756 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.527742    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.530284 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.530264    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jcsw\"/\"openshift-service-ca.crt\""
Aug 04 01:01:49.530284 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.530280    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6jcsw\"/\"default-dockercfg-jksch\""
Aug 04 01:01:49.531358 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.531339    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jcsw\"/\"kube-root-ca.crt\""
Aug 04 01:01:49.531475 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.531453    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-sys\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.531577 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.531562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-lib-modules\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.531626 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.531598    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-podres\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.531662 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.531636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb697\" (UniqueName: \"kubernetes.io/projected/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-kube-api-access-gb697\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.531662 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.531654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-proc\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.539679 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.539656    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"]
Aug 04 01:01:49.632398 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-sys\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632506 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-lib-modules\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632506 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-podres\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632506 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb697\" (UniqueName: \"kubernetes.io/projected/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-kube-api-access-gb697\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632506 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-proc\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632745 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-sys\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632745 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-lib-modules\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632745 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-podres\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.632745 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.632636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-proc\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.641837 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.641811    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb697\" (UniqueName: \"kubernetes.io/projected/283afcab-3f9d-47e4-8a8e-9be16f3ae8c5-kube-api-access-gb697\") pod \"perf-node-gather-daemonset-bbf2h\" (UID: \"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.837489 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.837417    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:49.972500 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:49.972479    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"]
Aug 04 01:01:49.974849 ip-10-0-142-136 kubenswrapper[2571]: W0804 01:01:49.974820    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod283afcab_3f9d_47e4_8a8e_9be16f3ae8c5.slice/crio-f98a46992a3ba3461b152768a629d671763722c5766dcd33d16f8d56ae045b6e WatchSource:0}: Error finding container f98a46992a3ba3461b152768a629d671763722c5766dcd33d16f8d56ae045b6e: Status 404 returned error can't find the container with id f98a46992a3ba3461b152768a629d671763722c5766dcd33d16f8d56ae045b6e
Aug 04 01:01:50.569750 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:50.569717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h" event={"ID":"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5","Type":"ContainerStarted","Data":"306843badfd1020728503020318188075da21ccb7face5773efb4ba0a6382ddb"}
Aug 04 01:01:50.570133 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:50.569767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h" event={"ID":"283afcab-3f9d-47e4-8a8e-9be16f3ae8c5","Type":"ContainerStarted","Data":"f98a46992a3ba3461b152768a629d671763722c5766dcd33d16f8d56ae045b6e"}
Aug 04 01:01:50.570133 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:50.569795    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:50.586052 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:50.586011    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h" podStartSLOduration=1.585998017 podStartE2EDuration="1.585998017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 01:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:01:50.584826084 +0000 UTC m=+3583.924861973" watchObservedRunningTime="2026-08-04 01:01:50.585998017 +0000 UTC m=+3583.926033883"
Aug 04 01:01:50.667591 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:50.667569    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-zcvzc_bc13c545-4bca-4a9e-9241-02dc9753a1e4/volume-data-source-validator/0.log"
Aug 04 01:01:51.794518 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:51.794487    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rj2t_f9162229-a6ac-41ae-b0c7-54854b0620b8/dns/0.log"
Aug 04 01:01:51.816161 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:51.816143    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rj2t_f9162229-a6ac-41ae-b0c7-54854b0620b8/kube-rbac-proxy/0.log"
Aug 04 01:01:51.919587 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:51.919570    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dc68r_06864f10-06e5-4538-aeea-6d7312ba87d5/dns-node-resolver/0.log"
Aug 04 01:01:52.454402 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:52.454378    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29763360-cqlc9_a3b7e8e6-a07f-438c-b420-28e3e4993e56/image-pruner/0.log"
Aug 04 01:01:52.548708 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:52.548675    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tdlsb_727b67a9-8e1d-47e7-9e39-9ad7a66b7e06/node-ca/0.log"
Aug 04 01:01:53.697857 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:53.697829    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8zngn_73d75a71-c693-4405-94ed-acc82cd98d93/discovery/0.log"
Aug 04 01:01:53.807148 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:53.807120    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ncqq5_db6a73b9-fcd9-4c35-8a92-46b333b1b879/payload-pre-processing/0.log"
Aug 04 01:01:53.837624 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:53.837600    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-wh2dm_cf06cf76-5156-41c5-b637-e206b34005c0/payload-processing/0.log"
Aug 04 01:01:53.859717 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:53.859684    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-678c5cc8f6-hxqbl_8eec624e-ae11-4621-b2ca-fecd3c42cc50/router/0.log"
Aug 04 01:01:54.730468 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:54.730442    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m657x_ec60b111-db5a-422c-852f-109e8d2d033a/serve-healthcheck-canary/0.log"
Aug 04 01:01:55.205346 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:55.205321    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-l9f49_3a1f7b92-4ff8-4881-a729-172f26200589/insights-operator/0.log"
Aug 04 01:01:55.205775 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:55.205760    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-l9f49_3a1f7b92-4ff8-4881-a729-172f26200589/insights-operator/1.log"
Aug 04 01:01:55.227852 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:55.227832    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72wgq_c5fb4362-c944-4804-a9fd-55a657c0332b/kube-rbac-proxy/0.log"
Aug 04 01:01:55.250134 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:55.250114    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72wgq_c5fb4362-c944-4804-a9fd-55a657c0332b/exporter/0.log"
Aug 04 01:01:55.274126 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:55.274110    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72wgq_c5fb4362-c944-4804-a9fd-55a657c0332b/extractor/0.log"
Aug 04 01:01:56.584924 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:56.584897    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-bbf2h"
Aug 04 01:01:58.056015 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:58.055983    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-89565659c-sbthq_33541d06-f2ef-4937-80f5-125f6cca7025/manager/0.log"
Aug 04 01:01:58.299955 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:58.299928    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-pzjfv_02700f58-1424-4511-8f9f-5ba5830e1829/manager/0.log"
Aug 04 01:01:58.319065 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:58.319008    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-pzjfv_02700f58-1424-4511-8f9f-5ba5830e1829/copy-manifests/0.log"
Aug 04 01:01:59.771471 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:59.771444    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8zngn_73d75a71-c693-4405-94ed-acc82cd98d93/discovery/0.log"
Aug 04 01:01:59.804563 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:59.804539    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b745d77d5-246jw_0f19d786-c0bd-41cb-a6fe-e5ccb6911187/manager/0.log"
Aug 04 01:01:59.841704 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:59.841673    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ncqq5_db6a73b9-fcd9-4c35-8a92-46b333b1b879/payload-pre-processing/0.log"
Aug 04 01:01:59.861685 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:59.861664    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-wh2dm_cf06cf76-5156-41c5-b637-e206b34005c0/payload-processing/0.log"
Aug 04 01:01:59.874331 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:01:59.874272    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-678c5cc8f6-hxqbl_8eec624e-ae11-4621-b2ca-fecd3c42cc50/router/0.log"
Aug 04 01:02:01.457338 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:01.457308    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8zngn_73d75a71-c693-4405-94ed-acc82cd98d93/discovery/0.log"
Aug 04 01:02:01.548785 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:01.548761    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ncqq5_db6a73b9-fcd9-4c35-8a92-46b333b1b879/payload-pre-processing/0.log"
Aug 04 01:02:01.575789 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:01.575765    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-wh2dm_cf06cf76-5156-41c5-b637-e206b34005c0/payload-processing/0.log"
Aug 04 01:02:01.592301 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:01.592279    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-678c5cc8f6-hxqbl_8eec624e-ae11-4621-b2ca-fecd3c42cc50/router/0.log"
Aug 04 01:02:05.395307 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:05.395280    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-p5pjd_b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e/kube-storage-version-migrator-operator/1.log"
Aug 04 01:02:05.396252 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:05.396231    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-p5pjd_b70bc0c1-0d8a-4c61-ad4e-949b6bd5c87e/kube-storage-version-migrator-operator/0.log"
Aug 04 01:02:06.465070 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.465035    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-684qb_6b872291-f419-4f30-b3f3-b3726dfa8f4d/kube-multus/0.log"
Aug 04 01:02:06.490503 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.490479    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/kube-multus-additional-cni-plugins/0.log"
Aug 04 01:02:06.514965 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.514947    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/egress-router-binary-copy/0.log"
Aug 04 01:02:06.543285 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.543263    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/cni-plugins/0.log"
Aug 04 01:02:06.564609 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.564591    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/bond-cni-plugin/0.log"
Aug 04 01:02:06.584885 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.584867    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/routeoverride-cni/0.log"
Aug 04 01:02:06.605347 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.605328    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/whereabouts-cni-bincopy/0.log"
Aug 04 01:02:06.626092 ip-10-0-142-136 kubenswrapper[2571]: I0804 01:02:06.626076    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56p8m_f08bc5f7-cacb-4e54-99ca-adafff1941ca/whereabouts-cni/0.log"