Jul 29 19:12:58.604967 ip-10-0-130-131 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 19:12:58.604979 ip-10-0-130-131 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 19:12:58.604987 ip-10-0-130-131 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 19:12:58.605248 ip-10-0-130-131 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 19:13:08.810747 ip-10-0-130-131 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 19:13:08.810767 ip-10-0-130-131 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c437dceaf1d24780b699ac3c0901f6c5 --
Jul 29 19:15:05.968584 ip-10-0-130-131 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 19:15:06.359877 ip-10-0-130-131 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:15:06.359877 ip-10-0-130-131 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 19:15:06.359877 ip-10-0-130-131 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:15:06.359877 ip-10-0-130-131 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 19:15:06.359877 ip-10-0-130-131 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:15:06.360503 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.359947    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 19:15:06.366014 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366000    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.366014 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366014    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366030    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366035    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366038    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366042    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366044    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366047    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366050    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366052    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366055    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366058    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366060    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366063    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366066    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366068    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366071    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366075    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366079    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366083    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.366089 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366086    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366089    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366094    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366096    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366099    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366102    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366106    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366108    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366111    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366114    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366117    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366120    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366122    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366126    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366130    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366133    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366135    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366138    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366141    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.366583 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366143    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366146    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366149    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366151    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366154    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366156    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366160    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366163    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366166    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366170    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366172    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366182    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366188    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366191    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366193    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366198    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366201    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366204    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366207    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.367053 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366209    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366213    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366215    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366218    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366220    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366223    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366226    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366229    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366231    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366234    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366237    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366240    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366242    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366245    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366248    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366251    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366253    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366256    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366258    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366261    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.367508 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366263    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366266    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366269    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366271    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366274    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366276    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366279    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366282    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366285    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366288    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366290    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366293    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366295    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366298    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366301    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366303    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366306    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366308    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366311    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366313    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.367978 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.366316    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367001    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367007    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367009    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367015    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367032    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367037    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367040    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367043    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367046    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367049    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367052    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367054    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367057    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367060    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367063    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367065    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367068    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367071    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.368464 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367074    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367077    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367079    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367082    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367085    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367088    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367090    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367093    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367095    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367098    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367101    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367104    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367106    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367109    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367111    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367114    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367117    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367120    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367122    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.368929 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367125    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367128    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367131    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367134    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367138    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367142    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367144    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367147    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367150    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367152    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367155    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367157    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367160    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367163    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367167    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367169    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367172    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367175    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367177    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367180    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.369413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367182    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367185    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367188    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367191    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367193    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367196    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367199    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367201    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367204    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367207    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367210    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367213    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367215    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367218    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367220    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367223    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367226    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367229    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367232    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.369898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367236    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367239    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367242    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367245    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367248    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367251    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367254    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367257    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367259    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367262    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367265    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367267    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367270    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367273    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367275    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367278    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367280    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367283    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367286    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367288    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.370393 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367290    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367293    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367296    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367640    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367645    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367648    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367651    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367654    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367657    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367665    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367668    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367671    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367673    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367676    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367679    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367682    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367685    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367688    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367690    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367693    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.370903 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367696    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367698    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367701    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367704    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367706    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367709    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367712    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367714    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367717    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367720    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367722    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367725    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367728    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367730    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367733    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367735    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367738    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367740    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367743    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.371405 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367745    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367748    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367752    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367755    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367757    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367760    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367763    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367765    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367768    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367771    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367775    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367779    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367782    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367785    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367788    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367793    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367796    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367799    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367802    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.371881 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367804    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367807    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367809    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367812    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367815    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367817    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367820    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367822    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367825    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367827    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367830    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367833    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367835    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367838    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367840    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367844    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367847    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367849    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367852    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367855    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.372364 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367859    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367861    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367864    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367867    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367869    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367872    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367875    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367877    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367880    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367883    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367885    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367887    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367890    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367893    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367895    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367898    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367900    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367903    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367905    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367908    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.372868 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367910    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367913    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367917    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.367920    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.367985    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.367992    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.367998    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368002    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368007    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368010    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368014    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368033    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368041    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368046    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368052    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368056    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368059    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368062    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368064    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368068    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368071    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368074    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368078    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 29 19:15:06.373413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368081    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368084    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368087    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368091    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368095    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368098    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368101    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368104    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368107    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368110    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368113    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368116    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368119    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368123    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368126    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368129    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368132    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368135    2576 flags.go:64] FLAG: --enable-server="true"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368138    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368142    2576 flags.go:64] FLAG: --event-burst="100"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368146    2576 flags.go:64] FLAG: --event-qps="50"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368150    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368153    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368156    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 29 19:15:06.373969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368159    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368162    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368165    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368168    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368171    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368174    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368177    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368180    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368183    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368186    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368189    2576 flags.go:64] FLAG: --feature-gates=""
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368192    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368195    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368198    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368201    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368204    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368208    2576 flags.go:64] FLAG: --help="false"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368210    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368214    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368217    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368220    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368223    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368227    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368229    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 19:15:06.374577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368232    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368235    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368238    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368241    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368244    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368248    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368251    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368254    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368257    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368260    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368263    2576 flags.go:64] FLAG: --lock-file=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368265    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368268    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368272    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368277    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368280    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368283    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368286    2576 flags.go:64] FLAG: --logging-format="text"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368289    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368292    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368295    2576 flags.go:64] FLAG: --manifest-url=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368297    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368301    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368304    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368308    2576 flags.go:64] FLAG: --max-pods="110"
Jul 29 19:15:06.375230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368311    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368314    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368317    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368320    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368323    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368327    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368330    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368336    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368340    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368343    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368346    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368349    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368354    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368358    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368362    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368365    2576 flags.go:64] FLAG: --port="10250"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368368    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368371    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01979993263952523"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368374    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368377    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368380    2576 flags.go:64] FLAG: --register-node="true"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368383    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368386    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368389    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 29 19:15:06.375818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368392    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368394    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368398    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368401    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368404    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368407    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368409    2576 flags.go:64] FLAG: --runonce="false"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368412    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368415    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368418    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368421    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368424    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368427    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368431    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368434    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368437    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368440    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368443    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368446    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368449    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368452    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368456    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368462    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368465    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368468    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 19:15:06.376436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368472    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368475    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368478    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368481    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368484    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368487    2576 flags.go:64] FLAG: --v="2"
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368490    2576 flags.go:64] FLAG: --version="false"
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368494    2576 flags.go:64] FLAG: --vmodule=""
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368497    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.368500    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368615    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368619    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368622    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368626    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368629    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368631    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368634    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368637    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368640    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368642    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368647    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368650    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.377128 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368653    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368655    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368659    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368662    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368666    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368668    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368673    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368676    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368678    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368682    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368686    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368689    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368692    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368695    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368698    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368701    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368704    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368707    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368709    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.377660 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368712    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368715    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368717    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368720    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368722    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368725    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368727    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368730    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368732    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368735    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368738    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368741    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368744    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368747    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368749    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368752    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368754    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368757    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368759    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.378142 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368763    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368766    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368769    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368771    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368774    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368777    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368779    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368782    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368785    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368787    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368790    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368792    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368795    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368797    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368800    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368803    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368805    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368808    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368811    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.378616 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368813    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368816    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368819    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368821    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368824    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368827    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368830    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368833    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368835    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368838    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368840    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368843    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368845    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368849    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368851    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368855    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368859    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368862    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368865    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368868    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.379085 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368871    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368873    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368876    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368878    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368881    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368883    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368886    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368889    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368891    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.368894    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.369729    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376117    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376130    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376146    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376152    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 19:15:06.379593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376205    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376212    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376216    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376219    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376222    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376225    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376228    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376231    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376233    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376236    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376239    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376242    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376246    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376249    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376251    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376254    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376257    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376260    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376262    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376265    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.379965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376268    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376270    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376273    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376276    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376278    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376281    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376284    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376286    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376289    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376292    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376295    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376298    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376300    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376303    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376305    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376308    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376311    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376313    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376316    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376319    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.380480 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376323    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376327    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376330    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376332    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376335    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376343    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376346    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376349    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376351    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376354    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376356    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376359    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376362    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376365    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376367    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376370    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376372    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376375    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376378    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376381    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.380964 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376383    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376387    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376391    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376394    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376396    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376399    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376401    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376404    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376407    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376410    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376412    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376415    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376417    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376420    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376422    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376425    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376427    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376430    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376433    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.381517 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376436    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376438    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376441    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376444    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376447    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376450    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376453    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376455    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376458    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376461    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376463    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376466    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376469    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376471    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376474    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376476    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376479    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376481    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376483    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.381971 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376486    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376491    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376621    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376626    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376629    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376632    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376634    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376637    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376640    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376643    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376646    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376648    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376650    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376654    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.382478 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376656    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376659    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376662    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376665    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376667    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376670    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376673    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376676    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376678    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376681    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376683    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376686    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376689    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376692    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376694    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376697    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376699    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376702    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376704    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376707    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376710    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.382854 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376712    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376714    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376717    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376720    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376722    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376725    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376727    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376730    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376732    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376735    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376737    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376740    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376743    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376746    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376748    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376751    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376753    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376756    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376758    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.383374 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376762    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376766    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376768    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376771    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376774    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376776    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376778    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376781    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376783    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376786    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376789    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376792    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376794    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376797    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376799    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376802    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376804    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376807    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376809    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.383826 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376812    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376814    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376817    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376819    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376822    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376824    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376827    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376830    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376837    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376839    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376842    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376845    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376848    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376852    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376855    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376857    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376860    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376863    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376865    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.384551 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376868    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376872    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376876    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376878    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376881    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376883    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376886    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376888    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:06.376891    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376895    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.376993    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.379010    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.380352    2576 server.go:1019] "Starting client certificate rotation"
Jul 29 19:15:06.385078 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.380449    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:15:06.385397 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.380486    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:15:06.385397 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.382606    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:15:06.386789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.386768    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:15:06.396546 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.396527    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 29 19:15:06.398808 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.398793    2576 log.go:25] "Validated CRI v1 image API"
Jul 29 19:15:06.400309 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.400293    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 19:15:06.402454 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.402428    2576 fs.go:135] Filesystem UUIDs: map[3e0b6657-2d4d-4792-87c9-6c4165a710b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b9c1c82d-0e50-4f6a-8b4d-151fedc1aec2:/dev/nvme0n1p4]
Jul 29 19:15:06.402522 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.402453    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 19:15:06.407846 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.407746    2576 manager.go:216] Machine: {Timestamp:2026-07-29 19:15:06.406464992 +0000 UTC m=+0.323414572 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100371 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20882c3f85f0f704d56be100cb7623 SystemUUID:ec20882c-3f85-f0f7-04d5-6be100cb7623 BootID:c437dcea-f1d2-4780-b699-ac3c0901f6c5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:84:f1:c5:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:84:f1:c5:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:56:79:d6:ab:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 19:15:06.407846 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.407840    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 19:15:06.407940 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.407906    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 19:15:06.408555 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.408540    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:15:06.410594 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.410567    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 19:15:06.410719 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.410598    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-131.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 19:15:06.411290 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.411280    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 19:15:06.411321 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.411292    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 19:15:06.411321 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.411300    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:15:06.411842 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.411833    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:15:06.412971 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.412961    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 19:15:06.415626 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415614    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:15:06.415743 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415733    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 19:15:06.415773 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415762    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 19:15:06.415800 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415775    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 19:15:06.415826 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415798    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 19:15:06.415826 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415811    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 29 19:15:06.415826 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.415820    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 19:15:06.416160 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.416148    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:15:06.416202 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.416166    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:15:06.418312 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.418296    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 19:15:06.419959 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.419945    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 19:15:06.420035 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.419975    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 19:15:06.421343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421332    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 19:15:06.421388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421348    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 19:15:06.421388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421354    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 19:15:06.421388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421359    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 19:15:06.421388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421368    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 19:15:06.421388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421376    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 19:15:06.421388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421387    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 19:15:06.421540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421392    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 19:15:06.421540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421405    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 19:15:06.421540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421413    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 19:15:06.421540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421433    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 19:15:06.421540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.421441    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 19:15:06.422634 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.422563    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 19:15:06.422731 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.422717    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 19:15:06.426254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.426236    2576 server.go:1268] "Started kubelet"
Jul 29 19:15:06.426536 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.426482    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 19:15:06.426617 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.426563    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 19:15:06.426888 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.426863    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 19:15:06.427151 ip-10-0-130-131 systemd[1]: Started Kubernetes Kubelet.
Jul 29 19:15:06.427715 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.427684    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 19:15:06.431265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.431244    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-131.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 19:15:06.431556 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.431542    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 19:15:06.431957 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.431937    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 19:15:06.433552 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.433535    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 19:15:06.436760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.436744    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 19:15:06.436760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.436757    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 19:15:06.437045 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.436981    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:06.437235 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.437219    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 19:15:06.437305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.437220    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 19:15:06.437305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.437247    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 19:15:06.437407 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.437352    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 19:15:06.437407 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.437362    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 19:15:06.439469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439337    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 19:15:06.439469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439350    2576 factory.go:55] Registering systemd factory
Jul 29 19:15:06.439469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439360    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 29 19:15:06.439962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439633    2576 factory.go:153] Registering CRI-O factory
Jul 29 19:15:06.439962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439646    2576 factory.go:223] Registration of the crio container factory successfully
Jul 29 19:15:06.439962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439667    2576 factory.go:103] Registering Raw factory
Jul 29 19:15:06.439962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.439681    2576 manager.go:1196] Started watching for new ooms in manager
Jul 29 19:15:06.440163 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.440150    2576 manager.go:349] Starting recovery of all containers
Jul 29 19:15:06.441140 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.441112    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 19:15:06.441224 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.441187    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 19:15:06.441596 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.441573    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 19:15:06.442272 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.441278    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a538632392  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.426205074 +0000 UTC m=+0.343154653,LastTimestamp:2026-07-29 19:15:06.426205074 +0000 UTC m=+0.343154653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.451431 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.451409    2576 manager.go:354] Recovery completed
Jul 29 19:15:06.456107 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.456093    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.458273 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458247    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.458332 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458278    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.458332 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458292    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.458750 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458738    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 19:15:06.458750 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458749    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 19:15:06.458832 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458762    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:15:06.458832 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.458806    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.459465 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.459450    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.459542 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.459477    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.459542 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.459487    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.460290 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.460278    2576 policy_none.go:49] "None policy: Start"
Jul 29 19:15:06.460334 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.460297    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 19:15:06.460334 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.460248    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53a4c5122  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-131.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.458263842 +0000 UTC m=+0.375213423,LastTimestamp:2026-07-29 19:15:06.458263842 +0000 UTC m=+0.375213423,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.460395 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.460311    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 19:15:06.461276 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.461265    2576 policy_none.go:47] "Start"
Jul 29 19:15:06.469349 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.469269    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53a4ca3c7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-131.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.458284999 +0000 UTC m=+0.375234581,LastTimestamp:2026-07-29 19:15:06.458284999 +0000 UTC m=+0.375234581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.477405 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.477251    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53a4cce94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-131.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.458295956 +0000 UTC m=+0.375245538,LastTimestamp:2026-07-29 19:15:06.458295956 +0000 UTC m=+0.375245538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.488397 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.488334    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-131.ec2.internal.18c6d8a53a4c5122\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53a4c5122  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-131.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.458263842 +0000 UTC m=+0.375213423,LastTimestamp:2026-07-29 19:15:06.459464376 +0000 UTC m=+0.376413955,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.499044 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499029    2576 manager.go:337] "Starting Device Plugin manager"
Jul 29 19:15:06.499154 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.499059    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 19:15:06.499154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499069    2576 server.go:87] "Starting device plugin registration server"
Jul 29 19:15:06.499326 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499313    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 19:15:06.499363 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499329    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 19:15:06.499445 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499426    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 19:15:06.499524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499506    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 19:15:06.499524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.499523    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 19:15:06.500042 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.500011    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 19:15:06.500123 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.500081    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:06.501613 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.501518    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-131.ec2.internal.18c6d8a53a4ca3c7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53a4ca3c7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-131.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.458284999 +0000 UTC m=+0.375234581,LastTimestamp:2026-07-29 19:15:06.459481591 +0000 UTC m=+0.376431170,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.509725 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.509666    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-131.ec2.internal.18c6d8a53a4cce94\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53a4cce94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-131.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.458295956 +0000 UTC m=+0.375245538,LastTimestamp:2026-07-29 19:15:06.459491351 +0000 UTC m=+0.376440930,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.520076 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.519994    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18c6d8a53ce139a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.501577123 +0000 UTC m=+0.418526690,LastTimestamp:2026-07-29 19:15:06.501577123 +0000 UTC m=+0.418526690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 29 19:15:06.531624 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.531606    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2zr4"
Jul 29 19:15:06.542188 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.542170    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2zr4"
Jul 29 19:15:06.599993 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.599975    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.602300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.600784    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.602300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.600815    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.602300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.600826    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.602300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.600851    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.626138 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.626076    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.626138 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.626117    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-131.ec2.internal\": node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:06.649090 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.649072    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:06.664386 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.664363    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 19:15:06.665669 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.665646    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 19:15:06.665763 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.665683    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 19:15:06.665763 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.665702    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 19:15:06.665763 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.665736    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 19:15:06.669538 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.669511    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:06.749551 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.749521    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:06.766960 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.766934    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"]
Jul 29 19:15:06.767053 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.767003    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.768741 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.768725    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.768819 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.768753    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.768819 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.768764    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.771213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.771200    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.771341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.771323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.771396 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.771355    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.771976 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.771959    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.772044 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.771989    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.772044 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.772001    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.772044 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.771961    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.772195 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.772061    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.772195 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.772076    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.774437 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.774418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.774504 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.774456    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.775182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.775166    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.775182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.775191    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.775304 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.775202    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.792651 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.792632    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-131.ec2.internal\" not found" node="ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.796096 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.796080    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-131.ec2.internal\" not found" node="ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.840203 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.840180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9cd9ebd8f4382549a6bbabe657589c93-config\") pod \"kube-apiserver-proxy-ip-10-0-130-131.ec2.internal\" (UID: \"9cd9ebd8f4382549a6bbabe657589c93\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.840288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.840204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b77cb8b9028c365bc371df9e0ae1b12a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"b77cb8b9028c365bc371df9e0ae1b12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.840288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.840223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b77cb8b9028c365bc371df9e0ae1b12a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"b77cb8b9028c365bc371df9e0ae1b12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.850705 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.850685    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:06.940545 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.940494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9cd9ebd8f4382549a6bbabe657589c93-config\") pod \"kube-apiserver-proxy-ip-10-0-130-131.ec2.internal\" (UID: \"9cd9ebd8f4382549a6bbabe657589c93\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.940545 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.940517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b77cb8b9028c365bc371df9e0ae1b12a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"b77cb8b9028c365bc371df9e0ae1b12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.940545 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.940537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b77cb8b9028c365bc371df9e0ae1b12a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"b77cb8b9028c365bc371df9e0ae1b12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.940683 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.940573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b77cb8b9028c365bc371df9e0ae1b12a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"b77cb8b9028c365bc371df9e0ae1b12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.940683 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.940609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9cd9ebd8f4382549a6bbabe657589c93-config\") pod \"kube-apiserver-proxy-ip-10-0-130-131.ec2.internal\" (UID: \"9cd9ebd8f4382549a6bbabe657589c93\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.940683 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:06.940615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b77cb8b9028c365bc371df9e0ae1b12a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"b77cb8b9028c365bc371df9e0ae1b12a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:06.951270 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:06.951245    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.051373 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.051337    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.096542 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.096519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:07.100301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.100270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:07.152416 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.152390    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.253116 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.253048    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.353643 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.353619    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.380081 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.380058    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 19:15:07.380471 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.380238    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 19:15:07.454676 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.454654    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.479215 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.479193    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:07.480434 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.480420    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:07.480508 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.480452    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:07.480508 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.480463    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:07.516823 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.516771    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:07.546756 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.546726    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 19:10:07 +0000 UTC" deadline="2028-01-16 21:28:21.202326553 +0000 UTC"
Jul 29 19:15:07.546756 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.546748    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12866h13m13.655580903s"
Jul 29 19:15:07.555548 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.555516    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.656459 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.656437    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.757563 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:07.757526    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 29 19:15:07.793764 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:07.793731    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77cb8b9028c365bc371df9e0ae1b12a.slice/crio-6f57020db929375d1660bf06e9afba71b5f32eedf6fc31c64dbd3b05a6bc6b5e WatchSource:0}: Error finding container 6f57020db929375d1660bf06e9afba71b5f32eedf6fc31c64dbd3b05a6bc6b5e: Status 404 returned error can't find the container with id 6f57020db929375d1660bf06e9afba71b5f32eedf6fc31c64dbd3b05a6bc6b5e
Jul 29 19:15:07.794016 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:07.793988    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd9ebd8f4382549a6bbabe657589c93.slice/crio-7dcddee9f368cd58ef9ddad9ff0bdf576b457cce0f00cd400d7d463f2337ca64 WatchSource:0}: Error finding container 7dcddee9f368cd58ef9ddad9ff0bdf576b457cce0f00cd400d7d463f2337ca64: Status 404 returned error can't find the container with id 7dcddee9f368cd58ef9ddad9ff0bdf576b457cce0f00cd400d7d463f2337ca64
Jul 29 19:15:07.800279 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.800258    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:15:07.811634 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.811614    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:07.830001 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.829977    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:07.837516 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.837498    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:07.850287 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.850271    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:15:07.851150 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.851137    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 29 19:15:07.865048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:07.865028    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:15:08.418342 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.418309    2576 apiserver.go:52] "Watching apiserver"
Jul 29 19:15:08.425154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.425124    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 19:15:08.425752 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.425725    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-4m82q","kube-system/global-pull-secret-syncer-nhrvq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal","openshift-multus/multus-additional-cni-plugins-bswqg","openshift-multus/multus-mx8hx","openshift-multus/network-metrics-daemon-wmxfh","openshift-network-operator/iptables-alerter-hgxbt","kube-system/konnectivity-agent-msxs5","kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x","openshift-cluster-node-tuning-operator/tuned-2h2nf","openshift-dns/node-resolver-hgw2d","openshift-image-registry/node-ca-mtr52","openshift-network-diagnostics/network-check-target-6wscz"]
Jul 29 19:15:08.429223 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.428498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.432236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.433293    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.433531    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jrqxl\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.433739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.433971    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.437272    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.437963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8l258\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.438224    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.438420    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.438649    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.438695    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.438784    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.438802    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.439350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.439074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.444009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.441173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:08.444009 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.441257    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:08.444009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.442447    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54ppz\""
Jul 29 19:15:08.444009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.442967    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 19:15:08.444009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.443824    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 19:15:08.444425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.444281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.446285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.444954    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 19:15:08.446285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.445207    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 19:15:08.446285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.445615    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.446285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.445654    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.446552 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.446413    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c5rtv\""
Jul 29 19:15:08.446552 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.446463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p96wx\""
Jul 29 19:15:08.447447 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.447427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.448605 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.448315    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 19:15:08.448605 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.448521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 19:15:08.449515 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.449492    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gd8v8\""
Jul 29 19:15:08.449609 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.449594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 19:15:08.449905 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.449700    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.451769 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.449971    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 19:15:08.451769 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.450989    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.451769 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451487    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 19:15:08.451769 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451675    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.451769 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.451728    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-etc-kubernetes\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppd4m\" (UniqueName: \"kubernetes.io/projected/2ab01574-27ef-40de-be60-93321c57efb3-kube-api-access-ppd4m\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/78bffe42-dcde-4971-a13a-0722d22ac989-agent-certs\") pod \"konnectivity-agent-msxs5\" (UID: \"78bffe42-dcde-4971-a13a-0722d22ac989\") " pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-host\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-daemon-config\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphkb\" (UniqueName: \"kubernetes.io/projected/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-kube-api-access-hphkb\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cnibin\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.451997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ed84254-bf53-411d-81cb-4632cee44b0c-cni-binary-copy\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-socket-dir-parent\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452157    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-os-release\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-system-cni-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-cni-bin\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-conf-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/78bffe42-dcde-4971-a13a-0722d22ac989-konnectivity-ca\") pod \"konnectivity-agent-msxs5\" (UID: \"78bffe42-dcde-4971-a13a-0722d22ac989\") " pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqcpz\" (UniqueName: \"kubernetes.io/projected/980df7b3-9ea3-4c59-ab60-ad2bb522a660-kube-api-access-xqcpz\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-cni-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-cni-multus\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ab01574-27ef-40de-be60-93321c57efb3-iptables-alerter-script\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x5t8\" (UniqueName: \"kubernetes.io/projected/12532a07-8df9-42e1-af19-188c65123cd6-kube-api-access-6x5t8\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-k8s-cni-cncf-io\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-netns\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbfjh\" (UniqueName: \"kubernetes.io/projected/9ed84254-bf53-411d-81cb-4632cee44b0c-kube-api-access-cbfjh\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.452746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ab01574-27ef-40de-be60-93321c57efb3-host-slash\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-serviceca\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-system-cni-dir\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cni-binary-copy\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-cnibin\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-kubelet\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.452956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-hostroot\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.453001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.453024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-os-release\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.453069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-multus-certs\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.453701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.453439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.456419 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.456269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.457810 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.457435    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2krxk\""
Jul 29 19:15:08.457810 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.457473    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.457810 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.457594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 19:15:08.458266 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.458229    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.458802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.458591    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gckgz\""
Jul 29 19:15:08.458802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.458645    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.458802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.458758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.459034 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.459011    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.462007 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.461831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d26nr\""
Jul 29 19:15:08.462007 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.461965    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.462306 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.462287    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.515405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.515381    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:15:08.535532 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.535379    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:08.538975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.538841    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ab01574-27ef-40de-be60-93321c57efb3-iptables-alerter-script\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x5t8\" (UniqueName: \"kubernetes.io/projected/12532a07-8df9-42e1-af19-188c65123cd6-kube-api-access-6x5t8\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-netns\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-slash\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-ovn\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e8d45ae-6a24-4c53-a66d-efa1e334b553-hosts-file\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-systemd-units\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-systemd\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysconfig\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-cnibin\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-kubelet\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-hostroot\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-run-ovn-kubernetes\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-cni-bin\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.554553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovnkube-script-lib\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-multus-certs\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-etc-kubernetes\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bea0ce2-dc8f-4078-a868-854de8cd5778-tmp\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpw8v\" (UniqueName: \"kubernetes.io/projected/6bea0ce2-dc8f-4078-a868-854de8cd5778-kube-api-access-bpw8v\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppd4m\" (UniqueName: \"kubernetes.io/projected/2ab01574-27ef-40de-be60-93321c57efb3-kube-api-access-ppd4m\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-host\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.553999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovn-node-metrics-cert\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5nv\" (UniqueName: \"kubernetes.io/projected/250b2bfc-1db7-469d-8c63-07b3befd256a-kube-api-access-6c5nv\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-run\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-host\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphkb\" (UniqueName: \"kubernetes.io/projected/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-kube-api-access-hphkb\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cnibin\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ed84254-bf53-411d-81cb-4632cee44b0c-cni-binary-copy\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-socket-dir-parent\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-var-lib-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.555559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed232216-d9a1-4512-9f78-339059c5dcec-kubelet-config\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed232216-d9a1-4512-9f78-339059c5dcec-dbus\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-tuned\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-cni-bin\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-log-socket\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-env-overrides\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/78bffe42-dcde-4971-a13a-0722d22ac989-konnectivity-ca\") pod \"konnectivity-agent-msxs5\" (UID: \"78bffe42-dcde-4971-a13a-0722d22ac989\") " pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqcpz\" (UniqueName: \"kubernetes.io/projected/980df7b3-9ea3-4c59-ab60-ad2bb522a660-kube-api-access-xqcpz\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-lib-modules\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-k8s-cni-cncf-io\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbfjh\" (UniqueName: \"kubernetes.io/projected/9ed84254-bf53-411d-81cb-4632cee44b0c-kube-api-access-cbfjh\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-multus-certs\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-cnibin\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-netns\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.556341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-etc-kubernetes\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-hostroot\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-kubelet\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.554811    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.554969    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:09.054948383 +0000 UTC m=+2.971897956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.554988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-device-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cnibin\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-host\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-run-k8s-cni-cncf-io\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-sys-fs\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ab01574-27ef-40de-be60-93321c57efb3-host-slash\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-serviceca\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-socket-dir-parent\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-cni-bin\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-run-netns\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-registration-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.557210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-system-cni-dir\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-system-cni-dir\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ab01574-27ef-40de-be60-93321c57efb3-host-slash\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/78bffe42-dcde-4971-a13a-0722d22ac989-konnectivity-ca\") pod \"konnectivity-agent-msxs5\" (UID: \"78bffe42-dcde-4971-a13a-0722d22ac989\") " pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ed84254-bf53-411d-81cb-4632cee44b0c-cni-binary-copy\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555900    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-serviceca\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cni-binary-copy\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.555975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-os-release\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-kubelet\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-kubernetes\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ab01574-27ef-40de-be60-93321c57efb3-iptables-alerter-script\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-sys\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/78bffe42-dcde-4971-a13a-0722d22ac989-agent-certs\") pod \"konnectivity-agent-msxs5\" (UID: \"78bffe42-dcde-4971-a13a-0722d22ac989\") " pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-os-release\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-daemon-config\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556502    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 19:15:08.558038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-daemon-config\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-etc-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovnkube-config\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xrl\" (UniqueName: \"kubernetes.io/projected/a0c26413-67c1-4f58-b274-a1ec445c0dba-kube-api-access-k9xrl\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-socket-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-var-lib-kubelet\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.556976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5pl\" (UniqueName: \"kubernetes.io/projected/4e8d45ae-6a24-4c53-a66d-efa1e334b553-kube-api-access-ls5pl\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-os-release\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-system-cni-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-conf-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/980df7b3-9ea3-4c59-ab60-ad2bb522a660-os-release\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-node-log\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-cni-netd\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557182    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-system-cni-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysctl-d\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-systemd\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.558947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-conf-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-cni-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-cni-multus\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-modprobe-d\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysctl-conf\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8d45ae-6a24-4c53-a66d-efa1e334b553-tmp-dir\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557520    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-host-var-lib-cni-multus\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-cni-binary-copy\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ed84254-bf53-411d-81cb-4632cee44b0c-multus-cni-dir\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.559806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.557996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980df7b3-9ea3-4c59-ab60-ad2bb522a660-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.561245 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.561219    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vz9d"
Jul 29 19:15:08.562847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.562815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/78bffe42-dcde-4971-a13a-0722d22ac989-agent-certs\") pod \"konnectivity-agent-msxs5\" (UID: \"78bffe42-dcde-4971-a13a-0722d22ac989\") " pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.570388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.570011    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vz9d"
Jul 29 19:15:08.570388 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.570064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppd4m\" (UniqueName: \"kubernetes.io/projected/2ab01574-27ef-40de-be60-93321c57efb3-kube-api-access-ppd4m\") pod \"iptables-alerter-hgxbt\" (UID: \"2ab01574-27ef-40de-be60-93321c57efb3\") " pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.574378 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.574357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphkb\" (UniqueName: \"kubernetes.io/projected/ba366e20-e4a8-4067-9bbf-dd341a39cf4b-kube-api-access-hphkb\") pod \"node-ca-mtr52\" (UID: \"ba366e20-e4a8-4067-9bbf-dd341a39cf4b\") " pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.577297 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.577276    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:08.577297 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.577305    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:08.577484 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.577321    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:08.577484 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.577402    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:09.077381621 +0000 UTC m=+2.994331212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:08.578917 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.578887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x5t8\" (UniqueName: \"kubernetes.io/projected/12532a07-8df9-42e1-af19-188c65123cd6-kube-api-access-6x5t8\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:08.579704 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.579657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbfjh\" (UniqueName: \"kubernetes.io/projected/9ed84254-bf53-411d-81cb-4632cee44b0c-kube-api-access-cbfjh\") pod \"multus-mx8hx\" (UID: \"9ed84254-bf53-411d-81cb-4632cee44b0c\") " pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.580565 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.580535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqcpz\" (UniqueName: \"kubernetes.io/projected/980df7b3-9ea3-4c59-ab60-ad2bb522a660-kube-api-access-xqcpz\") pod \"multus-additional-cni-plugins-bswqg\" (UID: \"980df7b3-9ea3-4c59-ab60-ad2bb522a660\") " pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.657782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-modprobe-d\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.657925 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysctl-conf\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.657925 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8d45ae-6a24-4c53-a66d-efa1e334b553-tmp-dir\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.657925 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-slash\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.657925 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.657925 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-ovn\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e8d45ae-6a24-4c53-a66d-efa1e334b553-hosts-file\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-systemd-units\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.657983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-systemd\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysconfig\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-run-ovn-kubernetes\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-cni-bin\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovnkube-script-lib\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bea0ce2-dc8f-4078-a868-854de8cd5778-tmp\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpw8v\" (UniqueName: \"kubernetes.io/projected/6bea0ce2-dc8f-4078-a868-854de8cd5778-kube-api-access-bpw8v\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovn-node-metrics-cert\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5nv\" (UniqueName: \"kubernetes.io/projected/250b2bfc-1db7-469d-8c63-07b3befd256a-kube-api-access-6c5nv\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-run\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-host\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-var-lib-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed232216-d9a1-4512-9f78-339059c5dcec-kubelet-config\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-modprobe-d\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed232216-d9a1-4512-9f78-339059c5dcec-dbus\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-tuned\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-ovn\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-log-socket\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysctl-conf\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-env-overrides\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-systemd-units\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.658672 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-lib-modules\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-systemd\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-device-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-run-ovn-kubernetes\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-sys-fs\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-run-netns\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8d45ae-6a24-4c53-a66d-efa1e334b553-tmp-dir\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-registration-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-log-socket\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-kubelet\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-kubernetes\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-run\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-sys\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-etc-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovnkube-config\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xrl\" (UniqueName: \"kubernetes.io/projected/a0c26413-67c1-4f58-b274-a1ec445c0dba-kube-api-access-k9xrl\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.659535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-device-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-run-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-socket-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-slash\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-var-lib-kubelet\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5pl\" (UniqueName: \"kubernetes.io/projected/4e8d45ae-6a24-4c53-a66d-efa1e334b553-kube-api-access-ls5pl\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-socket-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysconfig\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-node-log\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-cni-netd\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-sys-fs\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659294    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-run-netns\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysctl-d\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovnkube-script-lib\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-systemd\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.660316 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-kubelet\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-kubernetes\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-sys\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-registration-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-cni-netd\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e8d45ae-6a24-4c53-a66d-efa1e334b553-hosts-file\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.659608    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-etc-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:08.659669    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:15:09.15965379 +0000 UTC m=+3.076603368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-var-lib-openvswitch\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-lib-modules\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-host-cni-bin\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-host\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.658995    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed232216-d9a1-4512-9f78-339059c5dcec-kubelet-config\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-sysctl-d\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.659960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/250b2bfc-1db7-469d-8c63-07b3befd256a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.661182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.660020    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed232216-d9a1-4512-9f78-339059c5dcec-dbus\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:08.662059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.660017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovnkube-config\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.662059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.660152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-systemd\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.662059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.660201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bea0ce2-dc8f-4078-a868-854de8cd5778-var-lib-kubelet\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.662059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.660245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0c26413-67c1-4f58-b274-a1ec445c0dba-node-log\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.662059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.660507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0c26413-67c1-4f58-b274-a1ec445c0dba-env-overrides\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.662337 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.662308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6bea0ce2-dc8f-4078-a868-854de8cd5778-etc-tuned\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.663657 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.663628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bea0ce2-dc8f-4078-a868-854de8cd5778-tmp\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.664213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.664168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0c26413-67c1-4f58-b274-a1ec445c0dba-ovn-node-metrics-cert\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.673541 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.673455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal" event={"ID":"9cd9ebd8f4382549a6bbabe657589c93","Type":"ContainerStarted","Data":"7dcddee9f368cd58ef9ddad9ff0bdf576b457cce0f00cd400d7d463f2337ca64"}
Jul 29 19:15:08.675692 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.675640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5nv\" (UniqueName: \"kubernetes.io/projected/250b2bfc-1db7-469d-8c63-07b3befd256a-kube-api-access-6c5nv\") pod \"aws-ebs-csi-driver-node-2wr7x\" (UID: \"250b2bfc-1db7-469d-8c63-07b3befd256a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.676149 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.675985    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpw8v\" (UniqueName: \"kubernetes.io/projected/6bea0ce2-dc8f-4078-a868-854de8cd5778-kube-api-access-bpw8v\") pod \"tuned-2h2nf\" (UID: \"6bea0ce2-dc8f-4078-a868-854de8cd5778\") " pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.676149 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.676081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"b77cb8b9028c365bc371df9e0ae1b12a","Type":"ContainerStarted","Data":"6f57020db929375d1660bf06e9afba71b5f32eedf6fc31c64dbd3b05a6bc6b5e"}
Jul 29 19:15:08.684170 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.684145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xrl\" (UniqueName: \"kubernetes.io/projected/a0c26413-67c1-4f58-b274-a1ec445c0dba-kube-api-access-k9xrl\") pod \"ovnkube-node-4m82q\" (UID: \"a0c26413-67c1-4f58-b274-a1ec445c0dba\") " pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.684667 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.684646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5pl\" (UniqueName: \"kubernetes.io/projected/4e8d45ae-6a24-4c53-a66d-efa1e334b553-kube-api-access-ls5pl\") pod \"node-resolver-hgw2d\" (UID: \"4e8d45ae-6a24-4c53-a66d-efa1e334b553\") " pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:08.757375 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.757344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgxbt"
Jul 29 19:15:08.766060 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.766021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtr52"
Jul 29 19:15:08.768335 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:08.768304    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab01574_27ef_40de_be60_93321c57efb3.slice/crio-04f13456041f8561837b5401b7f3d9cc55c790a2594be3ba3b31967a78f58d85 WatchSource:0}: Error finding container 04f13456041f8561837b5401b7f3d9cc55c790a2594be3ba3b31967a78f58d85: Status 404 returned error can't find the container with id 04f13456041f8561837b5401b7f3d9cc55c790a2594be3ba3b31967a78f58d85
Jul 29 19:15:08.778363 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.778340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mx8hx"
Jul 29 19:15:08.785439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.785416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bswqg"
Jul 29 19:15:08.796428 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.796387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:08.806540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.806516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:08.814524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.814490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x"
Jul 29 19:15:08.823677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.823653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2h2nf"
Jul 29 19:15:08.829958 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:08.829940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hgw2d"
Jul 29 19:15:09.062995 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.062900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:09.063183 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.063069    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:09.063183 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.063146    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:10.063124263 +0000 UTC m=+3.980073831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:09.117477 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.117445    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba366e20_e4a8_4067_9bbf_dd341a39cf4b.slice/crio-3b936e15e73b0a1aa67e4b4dd6aa18913d2ab5673214ffc029ba706cdeefdb22 WatchSource:0}: Error finding container 3b936e15e73b0a1aa67e4b4dd6aa18913d2ab5673214ffc029ba706cdeefdb22: Status 404 returned error can't find the container with id 3b936e15e73b0a1aa67e4b4dd6aa18913d2ab5673214ffc029ba706cdeefdb22
Jul 29 19:15:09.164106 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.164064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:09.164243 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.164114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:09.164243 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.164211    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:09.164342 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.164287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:15:10.164270826 +0000 UTC m=+4.081220393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:09.164342 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.164322    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:09.164446 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.164347    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:09.164446 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.164360    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:09.164446 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.164432    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:10.164418491 +0000 UTC m=+4.081368077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:09.575210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.575161    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:10:09 +0000 UTC" deadline="2028-04-09 07:37:52.099251622 +0000 UTC"
Jul 29 19:15:09.575210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.575204    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14868h22m42.524052825s"
Jul 29 19:15:09.666929 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.666898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:09.667109 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.667011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:09.667109 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.667050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:09.667239 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:09.667186    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:09.678590 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.678561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtr52" event={"ID":"ba366e20-e4a8-4067-9bbf-dd341a39cf4b","Type":"ContainerStarted","Data":"3b936e15e73b0a1aa67e4b4dd6aa18913d2ab5673214ffc029ba706cdeefdb22"}
Jul 29 19:15:09.679641 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:09.679619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgxbt" event={"ID":"2ab01574-27ef-40de-be60-93321c57efb3","Type":"ContainerStarted","Data":"04f13456041f8561837b5401b7f3d9cc55c790a2594be3ba3b31967a78f58d85"}
Jul 29 19:15:09.841850 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.841813    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980df7b3_9ea3_4c59_ab60_ad2bb522a660.slice/crio-3a01d2ecadfa36de0844c4d5d99fc2be61ece3656a99a6c269ad6bcb1cf0ce4f WatchSource:0}: Error finding container 3a01d2ecadfa36de0844c4d5d99fc2be61ece3656a99a6c269ad6bcb1cf0ce4f: Status 404 returned error can't find the container with id 3a01d2ecadfa36de0844c4d5d99fc2be61ece3656a99a6c269ad6bcb1cf0ce4f
Jul 29 19:15:09.843637 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.843559    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c26413_67c1_4f58_b274_a1ec445c0dba.slice/crio-95e2beab44c065ab2667f068c27176fd6f12bd67dc879b740e3b5fedffe1b3d1 WatchSource:0}: Error finding container 95e2beab44c065ab2667f068c27176fd6f12bd67dc879b740e3b5fedffe1b3d1: Status 404 returned error can't find the container with id 95e2beab44c065ab2667f068c27176fd6f12bd67dc879b740e3b5fedffe1b3d1
Jul 29 19:15:09.845178 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.845147    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bea0ce2_dc8f_4078_a868_854de8cd5778.slice/crio-bbb415ee0facea5b2af930d2d068d2e257167d18e4e19013b56e9da042057591 WatchSource:0}: Error finding container bbb415ee0facea5b2af930d2d068d2e257167d18e4e19013b56e9da042057591: Status 404 returned error can't find the container with id bbb415ee0facea5b2af930d2d068d2e257167d18e4e19013b56e9da042057591
Jul 29 19:15:09.846754 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.846732    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250b2bfc_1db7_469d_8c63_07b3befd256a.slice/crio-d6f9b93b5f432b19d3271516b78917d2661d2b1f078604c3a342387d4b2cf0b5 WatchSource:0}: Error finding container d6f9b93b5f432b19d3271516b78917d2661d2b1f078604c3a342387d4b2cf0b5: Status 404 returned error can't find the container with id d6f9b93b5f432b19d3271516b78917d2661d2b1f078604c3a342387d4b2cf0b5
Jul 29 19:15:09.847273 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.847246    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bffe42_dcde_4971_a13a_0722d22ac989.slice/crio-0aedf72300dd825c82b0e7cb092e183bbd1bfc2b08252ba6bb2c8b77ad31cea8 WatchSource:0}: Error finding container 0aedf72300dd825c82b0e7cb092e183bbd1bfc2b08252ba6bb2c8b77ad31cea8: Status 404 returned error can't find the container with id 0aedf72300dd825c82b0e7cb092e183bbd1bfc2b08252ba6bb2c8b77ad31cea8
Jul 29 19:15:09.871426 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.871389    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed84254_bf53_411d_81cb_4632cee44b0c.slice/crio-923c387cb7b6a4feb3dc3f2ebb44be84c7308ea293e9a89141f7ce8d08c313fb WatchSource:0}: Error finding container 923c387cb7b6a4feb3dc3f2ebb44be84c7308ea293e9a89141f7ce8d08c313fb: Status 404 returned error can't find the container with id 923c387cb7b6a4feb3dc3f2ebb44be84c7308ea293e9a89141f7ce8d08c313fb
Jul 29 19:15:09.872356 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:09.872327    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8d45ae_6a24_4c53_a66d_efa1e334b553.slice/crio-91b2341477fc82bce1e4c0bd98c0a3ec3f50b109f86bf4d2d6e3fef5a6396cfd WatchSource:0}: Error finding container 91b2341477fc82bce1e4c0bd98c0a3ec3f50b109f86bf4d2d6e3fef5a6396cfd: Status 404 returned error can't find the container with id 91b2341477fc82bce1e4c0bd98c0a3ec3f50b109f86bf4d2d6e3fef5a6396cfd
Jul 29 19:15:10.072865 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.072586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:10.073048 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.072821    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:10.073048 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.072992    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:12.072970262 +0000 UTC m=+5.989919836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:10.173609 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.173566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:10.173757 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.173619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:10.173856 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.173836    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:10.173936 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.173865    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:10.173936 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.173880    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:10.174060 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.173946    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:12.173922179 +0000 UTC m=+6.090871764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:10.174234 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.174213    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:10.174328 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.174284    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:15:12.17426763 +0000 UTC m=+6.091217198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:10.576247 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.576168    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:10:09 +0000 UTC" deadline="2028-03-29 09:55:43.379035249 +0000 UTC"
Jul 29 19:15:10.576247 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.576208    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14606h40m32.802832104s"
Jul 29 19:15:10.669277 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.669081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:10.669277 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:10.669235    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:10.687077 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.686809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"95e2beab44c065ab2667f068c27176fd6f12bd67dc879b740e3b5fedffe1b3d1"}
Jul 29 19:15:10.698436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.698395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x" event={"ID":"250b2bfc-1db7-469d-8c63-07b3befd256a","Type":"ContainerStarted","Data":"d6f9b93b5f432b19d3271516b78917d2661d2b1f078604c3a342387d4b2cf0b5"}
Jul 29 19:15:10.700767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.700611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2h2nf" event={"ID":"6bea0ce2-dc8f-4078-a868-854de8cd5778","Type":"ContainerStarted","Data":"bbb415ee0facea5b2af930d2d068d2e257167d18e4e19013b56e9da042057591"}
Jul 29 19:15:10.708384 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.708288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerStarted","Data":"3a01d2ecadfa36de0844c4d5d99fc2be61ece3656a99a6c269ad6bcb1cf0ce4f"}
Jul 29 19:15:10.714155 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.713224    2576 generic.go:356] "Generic (PLEG): container finished" podID="b77cb8b9028c365bc371df9e0ae1b12a" containerID="7c279505bd8aa6cdbe02b7a2a00648e483ad57190b24bfe147558630e0552ea4" exitCode=0
Jul 29 19:15:10.714155 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.713308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"b77cb8b9028c365bc371df9e0ae1b12a","Type":"ContainerDied","Data":"7c279505bd8aa6cdbe02b7a2a00648e483ad57190b24bfe147558630e0552ea4"}
Jul 29 19:15:10.721371 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.721341    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hgw2d" event={"ID":"4e8d45ae-6a24-4c53-a66d-efa1e334b553","Type":"ContainerStarted","Data":"91b2341477fc82bce1e4c0bd98c0a3ec3f50b109f86bf4d2d6e3fef5a6396cfd"}
Jul 29 19:15:10.728252 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.728220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mx8hx" event={"ID":"9ed84254-bf53-411d-81cb-4632cee44b0c","Type":"ContainerStarted","Data":"923c387cb7b6a4feb3dc3f2ebb44be84c7308ea293e9a89141f7ce8d08c313fb"}
Jul 29 19:15:10.754811 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.754769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal" event={"ID":"9cd9ebd8f4382549a6bbabe657589c93","Type":"ContainerStarted","Data":"72795e784519aa48a0bced46e48baeff46e5a17839c66c6189373071e9732007"}
Jul 29 19:15:10.763299 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:10.763269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-msxs5" event={"ID":"78bffe42-dcde-4971-a13a-0722d22ac989","Type":"ContainerStarted","Data":"0aedf72300dd825c82b0e7cb092e183bbd1bfc2b08252ba6bb2c8b77ad31cea8"}
Jul 29 19:15:11.666986 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:11.666953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:11.667496 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:11.667102    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:11.667650 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:11.667628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:11.667773 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:11.667751    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:11.769872 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:11.769730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"b77cb8b9028c365bc371df9e0ae1b12a","Type":"ContainerStarted","Data":"3d87bdff71f3858baaa848d4019a0f722e66d9c323d3442444efc498357a7b8d"}
Jul 29 19:15:11.788263 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:11.787604    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal" podStartSLOduration=3.7875814759999997 podStartE2EDuration="3.787581476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:10.772356903 +0000 UTC m=+4.689306497" watchObservedRunningTime="2026-07-29 19:15:11.787581476 +0000 UTC m=+5.704531071"
Jul 29 19:15:12.093938 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:12.093898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:12.094329 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.094150    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:12.094329 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.094229    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:16.09420732 +0000 UTC m=+10.011156894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:12.195012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:12.195079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.195236    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.195260    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.195273    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.195333    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:16.19531622 +0000 UTC m=+10.112265792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.195748    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:12.195850 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.195805    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:15:16.195787832 +0000 UTC m=+10.112737404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:12.666561 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:12.666524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:12.666780 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:12.666670    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:13.667543 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:13.666842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:13.667543 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:13.666984    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:13.667543 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:13.667072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:13.667543 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:13.667172    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:14.672194 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:14.671671    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:14.672194 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:14.671807    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:15.666734 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:15.666641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:15.666908 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:15.666777    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:15.666908 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:15.666826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:15.667004 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:15.666954    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:16.130871 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:16.130829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:16.131385 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.131000    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:16.131385 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.131089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:24.131068326 +0000 UTC m=+18.048017897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:16.231631 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:16.231584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:16.231825 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:16.231654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:16.231825 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.231755    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:16.231938 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.231820    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:16.231938 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.231836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:15:24.231817144 +0000 UTC m=+18.148766715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:16.231938 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.231843    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:16.231938 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.231856    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:16.231938 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.231907    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:24.231890718 +0000 UTC m=+18.148840304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:16.670457 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:16.670428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:16.670632 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:16.670536    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:17.666449 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:17.666195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:17.666449 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:17.666388    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:17.666974 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:17.666813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:17.666974 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:17.666934    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:18.666847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:18.666320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:18.666847 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:18.666467    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:19.666303 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:19.666268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:19.666487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:19.666268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:19.666487 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:19.666376    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:19.666576 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:19.666490    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:20.666054 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:20.666004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:20.666511 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:20.666148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:21.665928 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:21.665892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:21.666125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:21.665906    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:21.666125 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:21.666045    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:21.666504 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:21.666122    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:22.666951 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:22.666915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:22.667391 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:22.667071    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:23.666381 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:23.666347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:23.666604 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:23.666356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:23.666604 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:23.666469    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:23.666604 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:23.666559    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:24.193070 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:24.193037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:24.193414 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.193159    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:24.193414 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.193215    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:40.193200738 +0000 UTC m=+34.110150305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:24.293615 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:24.293572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:24.293615 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:24.293617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:24.293842 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.293737    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:24.293842 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.293819    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:15:40.29379722 +0000 UTC m=+34.210746790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:24.293842 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.293750    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:24.294004 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.293855    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:24.294004 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.293869    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:24.294004 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.293943    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:40.293929575 +0000 UTC m=+34.210879160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:24.666175 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:24.666137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:24.666345 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:24.666276    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:25.665936 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:25.665898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:25.666373 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:25.665941    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:25.666373 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:25.666063    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:25.666373 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:25.666130    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:26.670123 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:26.670093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:26.670523 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:26.670188    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:27.666273 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:27.666243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:27.666452 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:27.666356    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:27.666452 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:27.666403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:27.666539 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:27.666505    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:28.666553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.666465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:28.666819 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:28.666605    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:28.807450 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.807211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtr52" event={"ID":"ba366e20-e4a8-4067-9bbf-dd341a39cf4b","Type":"ContainerStarted","Data":"742d7079f62fac3def3b2ec98c599c5a1d561d7f5e81c84c40d167343d29ee15"}
Jul 29 19:15:28.808703 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.808675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hgw2d" event={"ID":"4e8d45ae-6a24-4c53-a66d-efa1e334b553","Type":"ContainerStarted","Data":"e33a3a114f36bb3f41307a87e8a986f4d03fb4cf832b3ade6ebc187bd6419714"}
Jul 29 19:15:28.810160 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.810136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mx8hx" event={"ID":"9ed84254-bf53-411d-81cb-4632cee44b0c","Type":"ContainerStarted","Data":"ccd79d14ec3ee073f1558efdf134e98cf7855835be4e013f34c94dea9349a645"}
Jul 29 19:15:28.811540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.811520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-msxs5" event={"ID":"78bffe42-dcde-4971-a13a-0722d22ac989","Type":"ContainerStarted","Data":"fc07284d2d8c23e11b64ff137f7952b05ece59a0ec394ccf7a737f2e897f5502"}
Jul 29 19:15:28.812889 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.812868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x" event={"ID":"250b2bfc-1db7-469d-8c63-07b3befd256a","Type":"ContainerStarted","Data":"884e717d389b64e4cc94009762a37191085cdf91b974649ac280544275772ba3"}
Jul 29 19:15:28.817301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.816698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2h2nf" event={"ID":"6bea0ce2-dc8f-4078-a868-854de8cd5778","Type":"ContainerStarted","Data":"0acf48301bc428a044526b81d0571303ea17a64c55408a71819e87498b6a1401"}
Jul 29 19:15:28.818712 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.818692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerStarted","Data":"0c6a810406a2fdc23eaa0a8236af5ff14a70359bb2125e3334f4af1856891c38"}
Jul 29 19:15:28.826876 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.826832    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mtr52" podStartSLOduration=2.796122061 podStartE2EDuration="21.826821166s" totalImagesPullingTime="19.030699105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.82675943 +0000 UTC m=+22.743709040" watchObservedRunningTime="2026-07-29 19:15:28.826821166 +0000 UTC m=+22.743770754"
Jul 29 19:15:28.827103 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.827081    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" podStartSLOduration=20.827075554 podStartE2EDuration="20.827075554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:11.788204534 +0000 UTC m=+5.705154127" watchObservedRunningTime="2026-07-29 19:15:28.827075554 +0000 UTC m=+22.744025141"
Jul 29 19:15:28.846252 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.846206    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-msxs5" podStartSLOduration=3.234926058 podStartE2EDuration="21.846186528s" totalImagesPullingTime="18.61126047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.846064365 +0000 UTC m=+22.763013953" watchObservedRunningTime="2026-07-29 19:15:28.846186528 +0000 UTC m=+22.763136118"
Jul 29 19:15:28.867575 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.867534    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2h2nf" podStartSLOduration=3.20114772 podStartE2EDuration="21.867517484s" totalImagesPullingTime="18.666369764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.867503475 +0000 UTC m=+22.784453062" watchObservedRunningTime="2026-07-29 19:15:28.867517484 +0000 UTC m=+22.784467072"
Jul 29 19:15:28.886207 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.886165    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hgw2d" podStartSLOduration=3.6108848890000003 podStartE2EDuration="21.886149607s" totalImagesPullingTime="18.275264718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.88559674 +0000 UTC m=+22.802546327" watchObservedRunningTime="2026-07-29 19:15:28.886149607 +0000 UTC m=+22.803099195"
Jul 29 19:15:28.898696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.898670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hgw2d_4e8d45ae-6a24-4c53-a66d-efa1e334b553/dns-node-resolver/0.log"
Jul 29 19:15:28.918838 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:28.918775    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mx8hx" podStartSLOduration=3.278302712 podStartE2EDuration="21.918753151s" totalImagesPullingTime="18.640450439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.917917628 +0000 UTC m=+22.834867220" watchObservedRunningTime="2026-07-29 19:15:28.918753151 +0000 UTC m=+22.835702740"
Jul 29 19:15:29.666306 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.666118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:29.666535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.666180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:29.666535 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:29.666389    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:29.666535 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:29.666484    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:29.822435 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.822397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgxbt" event={"ID":"2ab01574-27ef-40de-be60-93321c57efb3","Type":"ContainerStarted","Data":"071dddf67b4d82e572aa8fd5d0af18f8757001763371957b420fa2cfd299026c"}
Jul 29 19:15:29.824778 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.824757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:15:29.825128 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.825107    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0c26413-67c1-4f58-b274-a1ec445c0dba" containerID="53db45dd61349910b3a8796da5ef21508c5d6275fe1cb2fb39dd635f12ff2acd" exitCode=1
Jul 29 19:15:29.825194 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.825176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"dc7be0e5101becbc1f1409a82323835d2b823353b55f8c432654aed5196faeae"}
Jul 29 19:15:29.825243 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.825236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"b7f3f7f250de5ede577387d150e0e8a147f154cc8ab7e64e7547893d0558da17"}
Jul 29 19:15:29.825289 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.825265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"0b86889661835dd80f952045c0b1212c42f52781e1cc5253f70a43efd9f0f04c"}
Jul 29 19:15:29.825323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.825292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerDied","Data":"53db45dd61349910b3a8796da5ef21508c5d6275fe1cb2fb39dd635f12ff2acd"}
Jul 29 19:15:29.825323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.825321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"0eb3498b3e04efba1d8000d6d6b555fc2efe0aef1713017d0e9f0a49e3db5f1f"}
Jul 29 19:15:29.826444 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.826425    2576 generic.go:356] "Generic (PLEG): container finished" podID="980df7b3-9ea3-4c59-ab60-ad2bb522a660" containerID="0c6a810406a2fdc23eaa0a8236af5ff14a70359bb2125e3334f4af1856891c38" exitCode=0
Jul 29 19:15:29.826579 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.826551    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerDied","Data":"0c6a810406a2fdc23eaa0a8236af5ff14a70359bb2125e3334f4af1856891c38"}
Jul 29 19:15:29.839567 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.839519    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgxbt" podStartSLOduration=3.4599895800000002 podStartE2EDuration="22.839504148s" totalImagesPullingTime="19.379514568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:29.838324111 +0000 UTC m=+23.755273698" watchObservedRunningTime="2026-07-29 19:15:29.839504148 +0000 UTC m=+23.756453737"
Jul 29 19:15:29.875332 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:29.875307    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtr52_ba366e20-e4a8-4067-9bbf-dd341a39cf4b/node-ca/0.log"
Jul 29 19:15:30.061098 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.061069    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:30.061918 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.061901    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:30.128997 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.128970    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 19:15:30.513850 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.513753    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:15:30.128986821Z","UUID":"251affeb-3bfe-4f7c-b474-aec686f90200","Handler":null,"Name":"","Endpoint":""}
Jul 29 19:15:30.515218 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.515198    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 19:15:30.515315 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.515233    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 19:15:30.666684 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.666650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:30.667190 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:30.666787    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:30.833221 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.833195    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:15:30.833718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.833687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"30855c847cc127c75fd87baa9102477282f250a35860b6b5d94959b1f561f16a"}
Jul 29 19:15:30.835695 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.835667    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x" event={"ID":"250b2bfc-1db7-469d-8c63-07b3befd256a","Type":"ContainerStarted","Data":"e047380f93eda6ec3aaaa15f39958705d078ee2e843f4dce80ec8d9ba866dc73"}
Jul 29 19:15:30.835903 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.835882    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:30.836541 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:30.836524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-msxs5"
Jul 29 19:15:31.666900 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:31.666721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:31.667358 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:31.666721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:31.667358 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:31.666997    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:31.667358 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:31.667114    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:31.840035 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:31.839978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x" event={"ID":"250b2bfc-1db7-469d-8c63-07b3befd256a","Type":"ContainerStarted","Data":"31954dc2bfb4d86f1ccade6c288674f7509e6f1bfb3ef193b84dbc594e17a85d"}
Jul 29 19:15:31.877729 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:31.877668    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wr7x" podStartSLOduration=3.614322173 podStartE2EDuration="24.877646348s" totalImagesPullingTime="21.263324175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:31.866760947 +0000 UTC m=+25.783710536" watchObservedRunningTime="2026-07-29 19:15:31.877646348 +0000 UTC m=+25.794595937"
Jul 29 19:15:32.669898 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:32.669873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:32.670413 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:32.669988    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:32.847286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:32.847253    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:15:32.847812 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:32.847769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"40cd41fdd7936f13db92c190262df40603e1df7b4ca84d3be33d78e3c7b6187d"}
Jul 29 19:15:33.666407 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:33.666378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:33.666560 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:33.666347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:33.666560 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:33.666500    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:33.666682 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:33.666569    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:34.667017 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.666794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:34.667596 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:34.667066    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:34.855070 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.855044    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:15:34.855413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.855391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"2233ba84c9e4b61ffb7dcbfc9762da2ef17260315c964da4b6c6d5f3c9030626"}
Jul 29 19:15:34.855682 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.855664    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:34.855786 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.855727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:34.855877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.855858    2576 scope.go:117] "RemoveContainer" containerID="53db45dd61349910b3a8796da5ef21508c5d6275fe1cb2fb39dd635f12ff2acd"
Jul 29 19:15:34.857417 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.857396    2576 generic.go:356] "Generic (PLEG): container finished" podID="980df7b3-9ea3-4c59-ab60-ad2bb522a660" containerID="410725c3c746049c8134646db95b4bebbb69dcba0fbd40524900b21c5ca9465a" exitCode=0
Jul 29 19:15:34.857526 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.857428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerDied","Data":"410725c3c746049c8134646db95b4bebbb69dcba0fbd40524900b21c5ca9465a"}
Jul 29 19:15:34.871818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:34.871801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:35.666632 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.666602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:35.666799 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.666640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:35.666799 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:35.666747    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:35.666908 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:35.666841    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:35.861431 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.861397    2576 generic.go:356] "Generic (PLEG): container finished" podID="980df7b3-9ea3-4c59-ab60-ad2bb522a660" containerID="0f1789926650f1e3158a19d61451d96d91f83515b6bac0073d0356395ee87ba9" exitCode=0
Jul 29 19:15:35.861867 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.861450    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerDied","Data":"0f1789926650f1e3158a19d61451d96d91f83515b6bac0073d0356395ee87ba9"}
Jul 29 19:15:35.865329 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.865311    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:15:35.865715 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.865694    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" event={"ID":"a0c26413-67c1-4f58-b274-a1ec445c0dba","Type":"ContainerStarted","Data":"92af678670a322a2a85ef6d5ba1c9b46fd855e466723ef3e97b9bf37b0601f75"}
Jul 29 19:15:35.865895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.865878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:35.880723 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.880678    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:15:35.969614 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:35.969555    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q" podStartSLOduration=9.832561889 podStartE2EDuration="28.9695368s" totalImagesPullingTime="19.136974911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:35.969307788 +0000 UTC m=+29.886257376" watchObservedRunningTime="2026-07-29 19:15:35.9695368 +0000 UTC m=+29.886486389"
Jul 29 19:15:36.542635 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:36.542606    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980df7b3_9ea3_4c59_ab60_ad2bb522a660.slice/crio-conmon-ba1dc20006bb8692e67eab616dff65b5df8f455691ff7ac808f901b016d00454.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 19:15:36.667588 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:36.667555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:36.667743 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:36.667636    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:36.870049 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:36.870005    2576 generic.go:356] "Generic (PLEG): container finished" podID="980df7b3-9ea3-4c59-ab60-ad2bb522a660" containerID="ba1dc20006bb8692e67eab616dff65b5df8f455691ff7ac808f901b016d00454" exitCode=0
Jul 29 19:15:36.870416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:36.870092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerDied","Data":"ba1dc20006bb8692e67eab616dff65b5df8f455691ff7ac808f901b016d00454"}
Jul 29 19:15:37.666107 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:37.666072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:37.666107 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:37.666094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:37.666321 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:37.666177    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:37.666321 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:37.666288    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:38.666526 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:38.666492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:38.666974 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:38.666623    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:39.666772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:39.666740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:39.667265 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:39.666877    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:39.667265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:39.666928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:39.667265 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:39.667054    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:40.215088 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:40.215042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:40.215280 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.215202    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:40.215344 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.215280    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs podName:12532a07-8df9-42e1-af19-188c65123cd6 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.215258138 +0000 UTC m=+66.132207707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs") pod "network-metrics-daemon-wmxfh" (UID: "12532a07-8df9-42e1-af19-188c65123cd6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:40.316550 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:40.316505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:40.316550 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:40.316556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:40.316773 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.316713    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:40.316773 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.316739    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:40.316773 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.316752    2576 projected.go:196] Error preparing data for projected volume kube-api-access-brsh5 for pod openshift-network-diagnostics/network-check-target-6wscz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:40.316889 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.316797    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5 podName:271cd5b5-89c1-464c-97d0-c45b214776f9 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.316783743 +0000 UTC m=+66.233733309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsh5" (UniqueName: "kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5") pod "network-check-target-6wscz" (UID: "271cd5b5-89c1-464c-97d0-c45b214776f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:40.316889 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.316712    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:40.316975 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.316890    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret podName:ed232216-d9a1-4512-9f78-339059c5dcec nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.316872443 +0000 UTC m=+66.233822016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret") pod "global-pull-secret-syncer-nhrvq" (UID: "ed232216-d9a1-4512-9f78-339059c5dcec") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:40.669628 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:40.669603    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:40.670113 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:40.669695    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:41.666352 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:41.666318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:41.666352 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:41.666352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:41.666698 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:41.666442    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:41.666698 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:41.666546    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:41.884930 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:41.884889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerStarted","Data":"dc7d96128f451891d9405fb152542c68d9479c1a82e48793c23222c7ce662ce9"}
Jul 29 19:15:42.668860 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:42.668833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:42.669047 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:42.668971    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:42.889947 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:42.889916    2576 generic.go:356] "Generic (PLEG): container finished" podID="980df7b3-9ea3-4c59-ab60-ad2bb522a660" containerID="dc7d96128f451891d9405fb152542c68d9479c1a82e48793c23222c7ce662ce9" exitCode=0
Jul 29 19:15:42.890360 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:42.889965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerDied","Data":"dc7d96128f451891d9405fb152542c68d9479c1a82e48793c23222c7ce662ce9"}
Jul 29 19:15:43.666948 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:43.666768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:43.667134 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:43.666828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:43.667134 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:43.667039    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:43.667134 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:43.667104    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:43.895435 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:43.895397    2576 generic.go:356] "Generic (PLEG): container finished" podID="980df7b3-9ea3-4c59-ab60-ad2bb522a660" containerID="2c02021587f3f94650bf0770b5ee1ca8a38ddbb5748be474785ac49aece54473" exitCode=0
Jul 29 19:15:43.895809 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:43.895454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerDied","Data":"2c02021587f3f94650bf0770b5ee1ca8a38ddbb5748be474785ac49aece54473"}
Jul 29 19:15:44.666530 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:44.666497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:44.666693 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:44.666625    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:44.901328 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:44.901294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bswqg" event={"ID":"980df7b3-9ea3-4c59-ab60-ad2bb522a660","Type":"ContainerStarted","Data":"1a397d917f91275068319c2485619a550ad9997fbf54ca6e24f4a101bf60610d"}
Jul 29 19:15:44.928942 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:44.928856    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bswqg" podStartSLOduration=8.79382731 podStartE2EDuration="37.928842286s" totalImagesPullingTime="29.135014976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:44.928280071 +0000 UTC m=+38.845229659" watchObservedRunningTime="2026-07-29 19:15:44.928842286 +0000 UTC m=+38.845791874"
Jul 29 19:15:45.666662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:45.666635    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:45.666825 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:45.666635    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:45.666825 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:45.666798    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:45.666825 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:45.666720    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:46.667008 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:46.666975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:46.667380 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:46.667076    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:47.666072 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:47.666038    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:47.666290 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:47.666154    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:47.666290 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:47.666209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:47.666398 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:47.666295    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:48.666596 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:48.666562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:48.666955 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:48.666688    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:49.666883 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:49.666850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:49.667271 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:49.666850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:49.667271 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:49.666966    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:49.667271 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:49.667035    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:50.666323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:50.666295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:50.666504 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:50.666388    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:51.666108 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:51.666081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:51.666479 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:51.666081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:51.666479 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:51.666186    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:51.666479 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:51.666252    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:52.666476 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:52.666447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:52.666825 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:52.666552    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:53.360333 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:53.360306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhrvq"]
Jul 29 19:15:53.360498 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:53.360389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:53.360568 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:53.360490    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:53.362393 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:53.362371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wmxfh"]
Jul 29 19:15:53.362486 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:53.362449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:53.362549 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:53.362519    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:53.364811 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:53.364792    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6wscz"]
Jul 29 19:15:53.364883 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:53.364858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:53.364965 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:53.364944    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:55.666619 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:55.666583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:55.667288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:55.666628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:55.667288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:55.666628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:55.667288 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:55.666707    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhrvq" podUID="ed232216-d9a1-4512-9f78-339059c5dcec"
Jul 29 19:15:55.667288 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:55.666779    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxfh" podUID="12532a07-8df9-42e1-af19-188c65123cd6"
Jul 29 19:15:55.667288 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:15:55.666847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wscz" podUID="271cd5b5-89c1-464c-97d0-c45b214776f9"
Jul 29 19:15:57.408913 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.408653    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeReady"
Jul 29 19:15:57.409405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.408957    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 19:15:57.485652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.485620    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pdqw4"]
Jul 29 19:15:57.496440 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.496418    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6mq9v"]
Jul 29 19:15:57.496550 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.496533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.498949 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.498928    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 19:15:57.499056 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.499011    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 19:15:57.499493 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.499475    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 19:15:57.499819 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.499805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 19:15:57.508911 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.508893    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xgrc9"]
Jul 29 19:15:57.509012 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.509002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.510041 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.510002    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7r8x\""
Jul 29 19:15:57.514815 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.514776    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 19:15:57.516970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.516950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 19:15:57.517213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.517198    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 19:15:57.517415 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.517400    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8c742\""
Jul 29 19:15:57.522305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.522288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdqw4"]
Jul 29 19:15:57.522393 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.522377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.524622 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.524605    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 19:15:57.525958 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.525943    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 19:15:57.526970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.526954    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ffrr\""
Jul 29 19:15:57.531528 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.531508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mq9v"]
Jul 29 19:15:57.544651 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-tmp-dir\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.544759 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8142cc10-2852-4db3-9aef-afba0dc36d7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.544759 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-metrics-tls\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.544759 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9kxd\" (UniqueName: \"kubernetes.io/projected/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-kube-api-access-s9kxd\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.544759 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-config-volume\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.544934 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8142cc10-2852-4db3-9aef-afba0dc36d7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.544934 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2503d05-dcf0-44b4-8cb0-5773e946fecd-cert\") pod \"ingress-canary-6mq9v\" (UID: \"d2503d05-dcf0-44b4-8cb0-5773e946fecd\") " pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.544934 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv46b\" (UniqueName: \"kubernetes.io/projected/8142cc10-2852-4db3-9aef-afba0dc36d7c-kube-api-access-xv46b\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.544934 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8142cc10-2852-4db3-9aef-afba0dc36d7c-data-volume\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.545087 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92mck\" (UniqueName: \"kubernetes.io/projected/d2503d05-dcf0-44b4-8cb0-5773e946fecd-kube-api-access-92mck\") pod \"ingress-canary-6mq9v\" (UID: \"d2503d05-dcf0-44b4-8cb0-5773e946fecd\") " pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.545087 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.544977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8142cc10-2852-4db3-9aef-afba0dc36d7c-crio-socket\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.550922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.550903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xgrc9"]
Jul 29 19:15:57.645787 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-tmp-dir\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.645787 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8142cc10-2852-4db3-9aef-afba0dc36d7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-metrics-tls\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.646009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9kxd\" (UniqueName: \"kubernetes.io/projected/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-kube-api-access-s9kxd\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.646009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-config-volume\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.646009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8142cc10-2852-4db3-9aef-afba0dc36d7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.645971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2503d05-dcf0-44b4-8cb0-5773e946fecd-cert\") pod \"ingress-canary-6mq9v\" (UID: \"d2503d05-dcf0-44b4-8cb0-5773e946fecd\") " pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.646009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv46b\" (UniqueName: \"kubernetes.io/projected/8142cc10-2852-4db3-9aef-afba0dc36d7c-kube-api-access-xv46b\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8142cc10-2852-4db3-9aef-afba0dc36d7c-data-volume\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92mck\" (UniqueName: \"kubernetes.io/projected/d2503d05-dcf0-44b4-8cb0-5773e946fecd-kube-api-access-92mck\") pod \"ingress-canary-6mq9v\" (UID: \"d2503d05-dcf0-44b4-8cb0-5773e946fecd\") " pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.646300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8142cc10-2852-4db3-9aef-afba0dc36d7c-crio-socket\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-tmp-dir\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.646504 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8142cc10-2852-4db3-9aef-afba0dc36d7c-crio-socket\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646504 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8142cc10-2852-4db3-9aef-afba0dc36d7c-data-volume\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.646631 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-config-volume\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.646858 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.646841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8142cc10-2852-4db3-9aef-afba0dc36d7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.650006 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.649978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-metrics-tls\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.650138 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.650120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2503d05-dcf0-44b4-8cb0-5773e946fecd-cert\") pod \"ingress-canary-6mq9v\" (UID: \"d2503d05-dcf0-44b4-8cb0-5773e946fecd\") " pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.650138 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.650130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8142cc10-2852-4db3-9aef-afba0dc36d7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.654222 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.654198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv46b\" (UniqueName: \"kubernetes.io/projected/8142cc10-2852-4db3-9aef-afba0dc36d7c-kube-api-access-xv46b\") pod \"insights-runtime-extractor-pdqw4\" (UID: \"8142cc10-2852-4db3-9aef-afba0dc36d7c\") " pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.657160 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.657141    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9kxd\" (UniqueName: \"kubernetes.io/projected/656b7ad0-5439-4b22-aec7-2a9f17ac42e7-kube-api-access-s9kxd\") pod \"dns-default-xgrc9\" (UID: \"656b7ad0-5439-4b22-aec7-2a9f17ac42e7\") " pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:57.659722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.659676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92mck\" (UniqueName: \"kubernetes.io/projected/d2503d05-dcf0-44b4-8cb0-5773e946fecd-kube-api-access-92mck\") pod \"ingress-canary-6mq9v\" (UID: \"d2503d05-dcf0-44b4-8cb0-5773e946fecd\") " pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.666548 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.666529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:15:57.666647 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.666625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:15:57.666708 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.666655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:15:57.668616 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.668596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhwzv\""
Jul 29 19:15:57.668723 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.668654    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:15:57.668723 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.668604    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:15:57.668723 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.668674    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:15:57.668859 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.668751    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8b4l\""
Jul 29 19:15:57.669063 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.669049    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:15:57.805732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.805703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdqw4"
Jul 29 19:15:57.817367 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.817331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mq9v"
Jul 29 19:15:57.830503 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:57.830480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:15:58.026695 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.026665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdqw4"]
Jul 29 19:15:58.028016 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.027987    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mq9v"]
Jul 29 19:15:58.030383 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:58.030361    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8142cc10_2852_4db3_9aef_afba0dc36d7c.slice/crio-f16a1be8e23cb2fcfd84f92c726764cdac1261155a7459016bc8e9006520e4da WatchSource:0}: Error finding container f16a1be8e23cb2fcfd84f92c726764cdac1261155a7459016bc8e9006520e4da: Status 404 returned error can't find the container with id f16a1be8e23cb2fcfd84f92c726764cdac1261155a7459016bc8e9006520e4da
Jul 29 19:15:58.031382 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:58.031363    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2503d05_dcf0_44b4_8cb0_5773e946fecd.slice/crio-4b332b49e05e66fee87485bbb32c46d298aa7fd31bcfb535f1878d3d1e580951 WatchSource:0}: Error finding container 4b332b49e05e66fee87485bbb32c46d298aa7fd31bcfb535f1878d3d1e580951: Status 404 returned error can't find the container with id 4b332b49e05e66fee87485bbb32c46d298aa7fd31bcfb535f1878d3d1e580951
Jul 29 19:15:58.034906 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.034885    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xgrc9"]
Jul 29 19:15:58.039154 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:15:58.039133    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656b7ad0_5439_4b22_aec7_2a9f17ac42e7.slice/crio-d00e9d8e0d3b89e202f91792689bda22d0c564d45036040d232a1d4d25697699 WatchSource:0}: Error finding container d00e9d8e0d3b89e202f91792689bda22d0c564d45036040d232a1d4d25697699: Status 404 returned error can't find the container with id d00e9d8e0d3b89e202f91792689bda22d0c564d45036040d232a1d4d25697699
Jul 29 19:15:58.197487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.197409    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6476d6455c-czv7j"]
Jul 29 19:15:58.229125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.229099    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6476d6455c-czv7j"]
Jul 29 19:15:58.229252 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.229193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.233993 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.233970    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 19:15:58.234135 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.234080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hktpp\""
Jul 29 19:15:58.234254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.234232    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 19:15:58.234460 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.234438    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 19:15:58.234662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.234615    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 19:15:58.234754 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.234714    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 19:15:58.234800 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.234765    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 19:15:58.235108 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.235091    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 19:15:58.242410 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.242395    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 19:15:58.250124 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-oauth-serving-cert\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.250189 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-config\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.250189 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-trusted-ca-bundle\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.250189 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-oauth-config\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.250294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-service-ca\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.250294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-serving-cert\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.250294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.250281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ff98\" (UniqueName: \"kubernetes.io/projected/b86e0007-b074-4c7a-8a8a-6f68c06b1250-kube-api-access-2ff98\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.350969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.350935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-oauth-serving-cert\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.350969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.350969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-config\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351215 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.350986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-trusted-ca-bundle\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351215 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.351137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-oauth-config\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351215 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.351188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-service-ca\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351365 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.351258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-serving-cert\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351365 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.351297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ff98\" (UniqueName: \"kubernetes.io/projected/b86e0007-b074-4c7a-8a8a-6f68c06b1250-kube-api-access-2ff98\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351740 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.351719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-config\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.351822 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.351756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-oauth-serving-cert\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.352108 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.352087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-service-ca\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.352294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.352278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-trusted-ca-bundle\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.353991 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.353971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-serving-cert\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.353991 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.353978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-oauth-config\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.359134 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.359114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ff98\" (UniqueName: \"kubernetes.io/projected/b86e0007-b074-4c7a-8a8a-6f68c06b1250-kube-api-access-2ff98\") pod \"console-6476d6455c-czv7j\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") " pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.537817 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.537739    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:15:58.711114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.711006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6476d6455c-czv7j"]
Jul 29 19:15:58.934692 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.934619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476d6455c-czv7j" event={"ID":"b86e0007-b074-4c7a-8a8a-6f68c06b1250","Type":"ContainerStarted","Data":"65794c177187d99313dbcdc6eb71a7d2c5bd979b5ef104fb1d9cc1006bdbe244"}
Jul 29 19:15:58.938516 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.938423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xgrc9" event={"ID":"656b7ad0-5439-4b22-aec7-2a9f17ac42e7","Type":"ContainerStarted","Data":"d00e9d8e0d3b89e202f91792689bda22d0c564d45036040d232a1d4d25697699"}
Jul 29 19:15:58.941524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.941495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdqw4" event={"ID":"8142cc10-2852-4db3-9aef-afba0dc36d7c","Type":"ContainerStarted","Data":"f16a1be8e23cb2fcfd84f92c726764cdac1261155a7459016bc8e9006520e4da"}
Jul 29 19:15:58.943636 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:15:58.943614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mq9v" event={"ID":"d2503d05-dcf0-44b4-8cb0-5773e946fecd","Type":"ContainerStarted","Data":"4b332b49e05e66fee87485bbb32c46d298aa7fd31bcfb535f1878d3d1e580951"}
Jul 29 19:16:03.924958 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.924622    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"]
Jul 29 19:16:03.929360 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.929249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:03.932113 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.932090    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 19:16:03.932526 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.932505    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 19:16:03.932725 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.932707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 19:16:03.932950 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.932932    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 19:16:03.933228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.933213    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 19:16:03.933489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.933470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4b9rp\""
Jul 29 19:16:03.943314 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.941822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"]
Jul 29 19:16:03.959052 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.959005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mq9v" event={"ID":"d2503d05-dcf0-44b4-8cb0-5773e946fecd","Type":"ContainerStarted","Data":"8271dc4824e9f1e76ab55592dac6459be0268320679f1793ab4c1d9adf7612ae"}
Jul 29 19:16:03.961820 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.961792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xgrc9" event={"ID":"656b7ad0-5439-4b22-aec7-2a9f17ac42e7","Type":"ContainerStarted","Data":"f03da6541fe1fadde3ed9e66ebde4b8687ec683fcd1b5d951fb44a57a50a1fba"}
Jul 29 19:16:03.964232 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.964208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdqw4" event={"ID":"8142cc10-2852-4db3-9aef-afba0dc36d7c","Type":"ContainerStarted","Data":"bd7c7f4c936c59cc332f10ae5ce04c704405bb4c43cef819d1a48ba37b6a6ecb"}
Jul 29 19:16:03.996856 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:03.995891    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6mq9v" podStartSLOduration=1.243081509 podStartE2EDuration="6.995869931s" totalImagesPullingTime="5.752788422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:03.994058265 +0000 UTC m=+57.911007854" watchObservedRunningTime="2026-07-29 19:16:03.995869931 +0000 UTC m=+57.912819522"
Jul 29 19:16:04.003059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.002962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/979c9ee5-6e11-48b1-b699-2fddb60c9299-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.003059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.003047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/979c9ee5-6e11-48b1-b699-2fddb60c9299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.003245 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.003129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/979c9ee5-6e11-48b1-b699-2fddb60c9299-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.003245 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.003178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxl5\" (UniqueName: \"kubernetes.io/projected/979c9ee5-6e11-48b1-b699-2fddb60c9299-kube-api-access-6pxl5\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.103842 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.103803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/979c9ee5-6e11-48b1-b699-2fddb60c9299-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.104053 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.103853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxl5\" (UniqueName: \"kubernetes.io/projected/979c9ee5-6e11-48b1-b699-2fddb60c9299-kube-api-access-6pxl5\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.104053 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.103882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/979c9ee5-6e11-48b1-b699-2fddb60c9299-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.104053 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.103949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/979c9ee5-6e11-48b1-b699-2fddb60c9299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.104601 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.104575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/979c9ee5-6e11-48b1-b699-2fddb60c9299-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.107360 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.107313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/979c9ee5-6e11-48b1-b699-2fddb60c9299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.107470 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.107368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/979c9ee5-6e11-48b1-b699-2fddb60c9299-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.113323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.113303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxl5\" (UniqueName: \"kubernetes.io/projected/979c9ee5-6e11-48b1-b699-2fddb60c9299-kube-api-access-6pxl5\") pod \"prometheus-operator-84d69f794d-rpxcx\" (UID: \"979c9ee5-6e11-48b1-b699-2fddb60c9299\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.244123 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.244087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"
Jul 29 19:16:04.423148 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.423119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-rpxcx"]
Jul 29 19:16:04.426559 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:04.426535    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979c9ee5_6e11_48b1_b699_2fddb60c9299.slice/crio-cb3ebda4496881b3278c251d3a951ccc41f6387fdc01c4022ad28d3a1745d30d WatchSource:0}: Error finding container cb3ebda4496881b3278c251d3a951ccc41f6387fdc01c4022ad28d3a1745d30d: Status 404 returned error can't find the container with id cb3ebda4496881b3278c251d3a951ccc41f6387fdc01c4022ad28d3a1745d30d
Jul 29 19:16:04.969499 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.969464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xgrc9" event={"ID":"656b7ad0-5439-4b22-aec7-2a9f17ac42e7","Type":"ContainerStarted","Data":"7e1fa15931f6f0252de9ddf61056a5bde26c489033ebe87d02e2f975c71c1663"}
Jul 29 19:16:04.969967 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.969556    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:16:04.970906 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:04.970869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx" event={"ID":"979c9ee5-6e11-48b1-b699-2fddb60c9299","Type":"ContainerStarted","Data":"cb3ebda4496881b3278c251d3a951ccc41f6387fdc01c4022ad28d3a1745d30d"}
Jul 29 19:16:05.013454 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:05.013402    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xgrc9" podStartSLOduration=2.265213922 podStartE2EDuration="8.013382581s" totalImagesPullingTime="5.748168659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:05.012999981 +0000 UTC m=+58.929949550" watchObservedRunningTime="2026-07-29 19:16:05.013382581 +0000 UTC m=+58.930332170"
Jul 29 19:16:07.884633 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:07.884558    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4m82q"
Jul 29 19:16:08.985632 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:08.985582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476d6455c-czv7j" event={"ID":"b86e0007-b074-4c7a-8a8a-6f68c06b1250","Type":"ContainerStarted","Data":"03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008"}
Jul 29 19:16:08.987744 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:08.987715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx" event={"ID":"979c9ee5-6e11-48b1-b699-2fddb60c9299","Type":"ContainerStarted","Data":"2fa88ca61c58ddf75439fa3648dc0795ca849501c14eac859e6d66f19f90d51e"}
Jul 29 19:16:08.987868 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:08.987773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx" event={"ID":"979c9ee5-6e11-48b1-b699-2fddb60c9299","Type":"ContainerStarted","Data":"61173be049fccc1aca4136844ffe702f5ec888f24bb97b39e89dd580746fa00d"}
Jul 29 19:16:08.989635 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:08.989610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdqw4" event={"ID":"8142cc10-2852-4db3-9aef-afba0dc36d7c","Type":"ContainerStarted","Data":"66b0b166e294d9206039807c47d16193493d7cb6a0db005f7f773c3306515c96"}
Jul 29 19:16:09.008427 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:09.008380    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6476d6455c-czv7j" podStartSLOduration=1.4918406929999999 podStartE2EDuration="11.008364398s" totalImagesPullingTime="9.516523705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:09.007813308 +0000 UTC m=+62.924762894" watchObservedRunningTime="2026-07-29 19:16:09.008364398 +0000 UTC m=+62.925313984"
Jul 29 19:16:09.026568 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:09.026525    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-rpxcx" podStartSLOduration=1.878596294 podStartE2EDuration="6.026511488s" totalImagesPullingTime="4.147915194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:09.025687477 +0000 UTC m=+62.942637077" watchObservedRunningTime="2026-07-29 19:16:09.026511488 +0000 UTC m=+62.943461055"
Jul 29 19:16:11.331874 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.331824    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"]
Jul 29 19:16:11.350061 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.350001    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q4x8w"]
Jul 29 19:16:11.350230 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.350123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.355691 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.355664    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.356207 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.356187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 19:16:11.356677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.356652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 19:16:11.356805 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.356784    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dfvqm\""
Jul 29 19:16:11.356875 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.356817    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 19:16:11.357545 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.357517    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"]
Jul 29 19:16:11.357657 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.357637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 19:16:11.358781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.358762    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 19:16:11.359009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.358990    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 19:16:11.359168 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.359007    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wq7jd\""
Jul 29 19:16:11.469650 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6ds\" (UniqueName: \"kubernetes.io/projected/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-api-access-pb6ds\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.469817 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.469817 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.469935 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-sys\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.469935 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.469935 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.470045 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xx72\" (UniqueName: \"kubernetes.io/projected/46ead131-d1b7-4efe-a02d-614d3ab56c26-kube-api-access-5xx72\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.470045 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.469994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.470111 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-tls\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.470111 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ead131-d1b7-4efe-a02d-614d3ab56c26-metrics-client-ca\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.470111 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-root\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.470239 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.470239 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-wtmp\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.470239 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.470329 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.470251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-textfile\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.570777 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-sys\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.570962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.570962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.570962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xx72\" (UniqueName: \"kubernetes.io/projected/46ead131-d1b7-4efe-a02d-614d3ab56c26-kube-api-access-5xx72\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.570962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.570962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-sys\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.570962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.570893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-tls\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571286 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:16:11.570985    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 19:16:11.571286 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:16:11.571071    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-tls podName:46ead131-d1b7-4efe-a02d-614d3ab56c26 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.071050937 +0000 UTC m=+65.988000509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-tls") pod "node-exporter-q4x8w" (UID: "46ead131-d1b7-4efe-a02d-614d3ab56c26") : secret "node-exporter-tls" not found
Jul 29 19:16:11.571286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ead131-d1b7-4efe-a02d-614d3ab56c26-metrics-client-ca\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-root\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-wtmp\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-root\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-textfile\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6ds\" (UniqueName: \"kubernetes.io/projected/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-api-access-pb6ds\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571456    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571589 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:16:11.571576    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 29 19:16:11.571962 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:16:11.571622    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-tls podName:3834a7ce-df56-40ad-ba8b-dad5a2b88dfb nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.071611326 +0000 UTC m=+65.988560895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-js2fh" (UID: "3834a7ce-df56-40ad-ba8b-dad5a2b88dfb") : secret "kube-state-metrics-tls" not found
Jul 29 19:16:11.571962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ead131-d1b7-4efe-a02d-614d3ab56c26-metrics-client-ca\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.571962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.571962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.571800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-wtmp\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.572207 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.572057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-textfile\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.572248 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.572225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.574142 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.574121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.574463 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.574441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:11.583652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.583601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xx72\" (UniqueName: \"kubernetes.io/projected/46ead131-d1b7-4efe-a02d-614d3ab56c26-kube-api-access-5xx72\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:11.584187 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:11.584165    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6ds\" (UniqueName: \"kubernetes.io/projected/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-api-access-pb6ds\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:12.075745 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.075717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-tls\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:12.075897 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.075750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:12.077966 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.077938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ead131-d1b7-4efe-a02d-614d3ab56c26-node-exporter-tls\") pod \"node-exporter-q4x8w\" (UID: \"46ead131-d1b7-4efe-a02d-614d3ab56c26\") " pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:12.078113 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.078092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3834a7ce-df56-40ad-ba8b-dad5a2b88dfb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-js2fh\" (UID: \"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:12.264118 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.264085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"
Jul 29 19:16:12.271624 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.271601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q4x8w"
Jul 29 19:16:12.277949 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.277927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:16:12.280083 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.280069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:16:12.290232 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.290212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12532a07-8df9-42e1-af19-188c65123cd6-metrics-certs\") pod \"network-metrics-daemon-wmxfh\" (UID: \"12532a07-8df9-42e1-af19-188c65123cd6\") " pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:16:12.378577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.378502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:16:12.378577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.378557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:16:12.380944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.380924    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:16:12.382122 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.382102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:16:12.387280 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.387260    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8b4l\""
Jul 29 19:16:12.390503 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.390487    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:16:12.391131 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.391114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed232216-d9a1-4512-9f78-339059c5dcec-original-pull-secret\") pod \"global-pull-secret-syncer-nhrvq\" (UID: \"ed232216-d9a1-4512-9f78-339059c5dcec\") " pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:16:12.395916 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.395900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxfh"
Jul 29 19:16:12.402219 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.402203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brsh5\" (UniqueName: \"kubernetes.io/projected/271cd5b5-89c1-464c-97d0-c45b214776f9-kube-api-access-brsh5\") pod \"network-check-target-6wscz\" (UID: \"271cd5b5-89c1-464c-97d0-c45b214776f9\") " pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:16:12.486086 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:12.486059    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ead131_d1b7_4efe_a02d_614d3ab56c26.slice/crio-599767ebcc57397674c120356cfe32be9df424af0d9b1abd87148b8ad0c04e39 WatchSource:0}: Error finding container 599767ebcc57397674c120356cfe32be9df424af0d9b1abd87148b8ad0c04e39: Status 404 returned error can't find the container with id 599767ebcc57397674c120356cfe32be9df424af0d9b1abd87148b8ad0c04e39
Jul 29 19:16:12.501125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.501093    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:16:12.519710 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.519686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.521883 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.521860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 19:16:12.522010 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.521975    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 19:16:12.522693 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.522678    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 19:16:12.522887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.522875    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rsxg\""
Jul 29 19:16:12.522975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.522922    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 19:16:12.523278 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.523255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 19:16:12.523481 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.523467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 19:16:12.523566 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.523486    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 19:16:12.523767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.523745    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 19:16:12.523830 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.523820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 19:16:12.529454 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.529286    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfjn9\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-kube-api-access-bfjn9\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-out\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.581732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-web-config\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.582341 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.581771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.622954 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.622908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh"]
Jul 29 19:16:12.625490 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:12.625462    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3834a7ce_df56_40ad_ba8b_dad5a2b88dfb.slice/crio-33a328f7be94d54cc182dfbc63bdf2a94ce435643ead8f8fdc82a1b50ab8a470 WatchSource:0}: Error finding container 33a328f7be94d54cc182dfbc63bdf2a94ce435643ead8f8fdc82a1b50ab8a470: Status 404 returned error can't find the container with id 33a328f7be94d54cc182dfbc63bdf2a94ce435643ead8f8fdc82a1b50ab8a470
Jul 29 19:16:12.641464 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.641437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wmxfh"]
Jul 29 19:16:12.645132 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:12.645091    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12532a07_8df9_42e1_af19_188c65123cd6.slice/crio-2b06c4f04c9ca102d2e7a1e5bfc501737199f2413c6a496f6cd960a5667bf7c3 WatchSource:0}: Error finding container 2b06c4f04c9ca102d2e7a1e5bfc501737199f2413c6a496f6cd960a5667bf7c3: Status 404 returned error can't find the container with id 2b06c4f04c9ca102d2e7a1e5bfc501737199f2413c6a496f6cd960a5667bf7c3
Jul 29 19:16:12.675828 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.675799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhrvq"
Jul 29 19:16:12.682792 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.682773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-out\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683238 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-web-config\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683335    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhwzv\""
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683777 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfjn9\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-kube-api-access-bfjn9\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.683777 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.683672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.684901 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.684565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.686218 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:16:12.686197    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle podName:b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b nodeName:}" failed. No retries permitted until 2026-07-29 19:16:13.18617396 +0000 UTC m=+67.103123544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b") : configmap references non-existent config key: ca-bundle.crt
Jul 29 19:16:12.686541 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.686522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-out\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.686877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.686821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.686975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.686933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.687141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.687093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.687249 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.687204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.687249 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.687234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.687396 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.687379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-web-config\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.687619 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.687598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.688264 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.688245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.693120 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.692129    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:16:12.697140 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.697111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfjn9\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-kube-api-access-bfjn9\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:12.837749 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.837715    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhrvq"]
Jul 29 19:16:12.840782 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:12.840755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded232216_d9a1_4512_9f78_339059c5dcec.slice/crio-5cf0b2e5cc8029df3b1d1f3e9981bf6bbab5d93106e5f89939f0bc54d57bac3f WatchSource:0}: Error finding container 5cf0b2e5cc8029df3b1d1f3e9981bf6bbab5d93106e5f89939f0bc54d57bac3f: Status 404 returned error can't find the container with id 5cf0b2e5cc8029df3b1d1f3e9981bf6bbab5d93106e5f89939f0bc54d57bac3f
Jul 29 19:16:12.864578 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:12.864554    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6wscz"]
Jul 29 19:16:12.867167 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:12.867142    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271cd5b5_89c1_464c_97d0_c45b214776f9.slice/crio-e2d62707615742695e32bbc42bacf5408a40bbe7fd384fa444e1ce2b1b0bbe3e WatchSource:0}: Error finding container e2d62707615742695e32bbc42bacf5408a40bbe7fd384fa444e1ce2b1b0bbe3e: Status 404 returned error can't find the container with id e2d62707615742695e32bbc42bacf5408a40bbe7fd384fa444e1ce2b1b0bbe3e
Jul 29 19:16:13.008350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.008266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdqw4" event={"ID":"8142cc10-2852-4db3-9aef-afba0dc36d7c","Type":"ContainerStarted","Data":"10ffb830422c20d281bf4886b5cf1d82656e8a5005b98166fd511159981a1db9"}
Jul 29 19:16:13.009400 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.009379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6wscz" event={"ID":"271cd5b5-89c1-464c-97d0-c45b214776f9","Type":"ContainerStarted","Data":"e2d62707615742695e32bbc42bacf5408a40bbe7fd384fa444e1ce2b1b0bbe3e"}
Jul 29 19:16:13.010446 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.010426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhrvq" event={"ID":"ed232216-d9a1-4512-9f78-339059c5dcec","Type":"ContainerStarted","Data":"5cf0b2e5cc8029df3b1d1f3e9981bf6bbab5d93106e5f89939f0bc54d57bac3f"}
Jul 29 19:16:13.011531 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.011501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4x8w" event={"ID":"46ead131-d1b7-4efe-a02d-614d3ab56c26","Type":"ContainerStarted","Data":"599767ebcc57397674c120356cfe32be9df424af0d9b1abd87148b8ad0c04e39"}
Jul 29 19:16:13.012590 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.012570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh" event={"ID":"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb","Type":"ContainerStarted","Data":"33a328f7be94d54cc182dfbc63bdf2a94ce435643ead8f8fdc82a1b50ab8a470"}
Jul 29 19:16:13.013540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.013519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wmxfh" event={"ID":"12532a07-8df9-42e1-af19-188c65123cd6","Type":"ContainerStarted","Data":"2b06c4f04c9ca102d2e7a1e5bfc501737199f2413c6a496f6cd960a5667bf7c3"}
Jul 29 19:16:13.029869 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.029827    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pdqw4" podStartSLOduration=1.736665691 podStartE2EDuration="16.029815331s" totalImagesPullingTime="14.29314964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:13.028544369 +0000 UTC m=+66.945493959" watchObservedRunningTime="2026-07-29 19:16:13.029815331 +0000 UTC m=+66.946764919"
Jul 29 19:16:13.188594 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.188555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:13.189489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.189467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:13.440703 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.440670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:16:13.878468 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:13.878431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:16:14.154484 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:14.154447    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a804f1_dac5_4da8_a2f5_3f5d18a1b17b.slice/crio-87ee59806d5b631c0758df9a2b4d22cf6c5faa9e81df0154b57b7e7380cf3567 WatchSource:0}: Error finding container 87ee59806d5b631c0758df9a2b4d22cf6c5faa9e81df0154b57b7e7380cf3567: Status 404 returned error can't find the container with id 87ee59806d5b631c0758df9a2b4d22cf6c5faa9e81df0154b57b7e7380cf3567
Jul 29 19:16:14.977380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:14.977263    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xgrc9"
Jul 29 19:16:15.025696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.025655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh" event={"ID":"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb","Type":"ContainerStarted","Data":"4d0334faaca2a8c6f7bd7fbc291a41775006916a96b5a16794c2ede3eac4e361"}
Jul 29 19:16:15.025910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.025730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh" event={"ID":"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb","Type":"ContainerStarted","Data":"e4a7f0fa118a60836471c71d3ac1b804badd9cd2736cb0bab6f54af076ede644"}
Jul 29 19:16:15.025910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.025764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh" event={"ID":"3834a7ce-df56-40ad-ba8b-dad5a2b88dfb","Type":"ContainerStarted","Data":"9c56278dad4ada179d113c6aaa119010f9f2f8e1df35fde32ba5b1e5de72511a"}
Jul 29 19:16:15.029122 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.029090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wmxfh" event={"ID":"12532a07-8df9-42e1-af19-188c65123cd6","Type":"ContainerStarted","Data":"c57e7695b42760abba949a99a351cb314064f441705f8e98acaec9531908a4f8"}
Jul 29 19:16:15.029258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.029145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wmxfh" event={"ID":"12532a07-8df9-42e1-af19-188c65123cd6","Type":"ContainerStarted","Data":"ff6ab26145a31c1b3d3e6f4ad2778167062540ccb0151bd9908937d79197127d"}
Jul 29 19:16:15.031509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.031481    2576 generic.go:356] "Generic (PLEG): container finished" podID="46ead131-d1b7-4efe-a02d-614d3ab56c26" containerID="c05f1c4052d22fa444afd8ac593a720ee202a995c6c5e2ed1d36ee73bcfcba1d" exitCode=0
Jul 29 19:16:15.031630 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.031556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4x8w" event={"ID":"46ead131-d1b7-4efe-a02d-614d3ab56c26","Type":"ContainerDied","Data":"c05f1c4052d22fa444afd8ac593a720ee202a995c6c5e2ed1d36ee73bcfcba1d"}
Jul 29 19:16:15.033807 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.033782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"87ee59806d5b631c0758df9a2b4d22cf6c5faa9e81df0154b57b7e7380cf3567"}
Jul 29 19:16:15.049084 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.048864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-js2fh" podStartSLOduration=2.220845257 podStartE2EDuration="4.048847126s" totalImagesPullingTime="1.828001869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:15.04825815 +0000 UTC m=+68.965207760" watchObservedRunningTime="2026-07-29 19:16:15.048847126 +0000 UTC m=+68.965796713"
Jul 29 19:16:15.069521 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.069472    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wmxfh" podStartSLOduration=66.264938353 podStartE2EDuration="1m8.069455906s" totalImagesPullingTime="1.804517553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:15.068175913 +0000 UTC m=+68.985125502" watchObservedRunningTime="2026-07-29 19:16:15.069455906 +0000 UTC m=+68.986405494"
Jul 29 19:16:15.709326 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.709282    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f75dd449b-hfxzz"]
Jul 29 19:16:15.714882 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.714853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.717520 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.717342    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 19:16:15.717722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.717701    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gvmbt\""
Jul 29 19:16:15.718299 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.718277    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 19:16:15.719215 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.719198    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-98r6l0rcv6m3h\""
Jul 29 19:16:15.719392 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.719372    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 19:16:15.719561 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.719544    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 19:16:15.726006 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.725979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f75dd449b-hfxzz"]
Jul 29 19:16:15.811898 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.811863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-audit-log\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.812102 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.811912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-secret-metrics-server-tls\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.812102 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.812015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-client-ca-bundle\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.812102 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.812081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-secret-metrics-server-client-certs\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.812281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.812150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.812281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.812178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-metrics-server-audit-profiles\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.812281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.812235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st7ft\" (UniqueName: \"kubernetes.io/projected/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-kube-api-access-st7ft\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.912878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.912844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st7ft\" (UniqueName: \"kubernetes.io/projected/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-kube-api-access-st7ft\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.912903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-audit-log\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.912929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-secret-metrics-server-tls\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.912982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-client-ca-bundle\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.913016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-secret-metrics-server-client-certs\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.913056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.913072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-metrics-server-audit-profiles\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913856 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.913801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-audit-log\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.913986 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.913908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.914103 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.914086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-metrics-server-audit-profiles\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.916290 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.916265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-secret-metrics-server-client-certs\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.916908 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.916866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-client-ca-bundle\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.917299 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.917278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-secret-metrics-server-tls\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:15.927044 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:15.926983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st7ft\" (UniqueName: \"kubernetes.io/projected/c353dd3e-9f2a-46b0-986a-e0b7378fe8e7-kube-api-access-st7ft\") pod \"metrics-server-5f75dd449b-hfxzz\" (UID: \"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7\") " pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:16.029132 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.029051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:16.042649 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.042374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4x8w" event={"ID":"46ead131-d1b7-4efe-a02d-614d3ab56c26","Type":"ContainerStarted","Data":"7afad39ab72a267f3cffc7bda741471116dd93f3e85fd5870d453fbd1c919a5e"}
Jul 29 19:16:16.042649 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.042436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4x8w" event={"ID":"46ead131-d1b7-4efe-a02d-614d3ab56c26","Type":"ContainerStarted","Data":"db8318164507f34ebd4877a00fa24bff654b02582b12d2aea5a6ea6caf039f0b"}
Jul 29 19:16:16.075498 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.075441    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q4x8w" podStartSLOduration=3.001128187 podStartE2EDuration="5.075424112s" totalImagesPullingTime="1.954694686s" totalInitContainerRuntime="119.601239ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:16.074297934 +0000 UTC m=+69.991247528" watchObservedRunningTime="2026-07-29 19:16:16.075424112 +0000 UTC m=+69.992373700"
Jul 29 19:16:16.603837 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.603808    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"]
Jul 29 19:16:16.607165 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.607144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.609417 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.609397    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 19:16:16.610182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.610158    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 19:16:16.610286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.610249    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 19:16:16.610286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.610263    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 19:16:16.610645 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.610626    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 19:16:16.610703 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.610631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bcmxz\""
Jul 29 19:16:16.614955 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.614933    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 19:16:16.625927 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.625906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"]
Jul 29 19:16:16.719018 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.718981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-telemeter-client-tls\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-federate-client-tls\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-serving-certs-ca-bundle\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-secret-telemeter-client\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719389 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-metrics-client-ca\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.719389 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.719306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlkgh\" (UniqueName: \"kubernetes.io/projected/b97c5fea-80e2-4c25-a12e-a78492d38d7e-kube-api-access-nlkgh\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820312 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-metrics-client-ca\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlkgh\" (UniqueName: \"kubernetes.io/projected/b97c5fea-80e2-4c25-a12e-a78492d38d7e-kube-api-access-nlkgh\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-telemeter-client-tls\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-federate-client-tls\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820725 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-serving-certs-ca-bundle\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.820725 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.820536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-secret-telemeter-client\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.821292 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.821260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-metrics-client-ca\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.821540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.821468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-serving-certs-ca-bundle\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.821723 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.821697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97c5fea-80e2-4c25-a12e-a78492d38d7e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.823089 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.823064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.823219 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.823192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-telemeter-client-tls\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.823686 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.823663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-federate-client-tls\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.823760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.823663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b97c5fea-80e2-4c25-a12e-a78492d38d7e-secret-telemeter-client\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.833427 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.833403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlkgh\" (UniqueName: \"kubernetes.io/projected/b97c5fea-80e2-4c25-a12e-a78492d38d7e-kube-api-access-nlkgh\") pod \"telemeter-client-7b4d4fc79f-sbjff\" (UID: \"b97c5fea-80e2-4c25-a12e-a78492d38d7e\") " pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:16.920148 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:16.920071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"
Jul 29 19:16:17.593380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.593347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:16:17.599175 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.599151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.605798 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.605440    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 19:16:17.605798 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.605590    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 19:16:17.605798 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.605743    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 19:16:17.606075 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.605914    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 19:16:17.606075 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.605999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 19:16:17.606075 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 19:16:17.606243 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606082    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 19:16:17.606562 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606305    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 19:16:17.606562 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 19:16:17.606562 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606357    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 19:16:17.606562 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606450    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 19:16:17.606562 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-59lmm\""
Jul 29 19:16:17.606867 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 19:16:17.606867 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.606772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 19:16:17.615071 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.614948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3j1vca3p7icmm\""
Jul 29 19:16:17.618205 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.616327    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 19:16:17.619439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.619343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:16:17.728706 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.728894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.728894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.728894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.728894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.728894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.728894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.728948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2p9j\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-kube-api-access-g2p9j\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729191 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729406 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729406 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729406 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729406 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729406 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729406 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729623 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.729623 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.729482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.829980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2p9j\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-kube-api-access-g2p9j\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.834265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.830571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.831527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.831836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.832057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.832590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.833543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.833969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.835159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.834186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.837205 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.836880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.840935 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.839531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.844670 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.841731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.844670 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.842140    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.844670 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.842422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.846532 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.846079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.846532 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.846257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.846532 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.846480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.846767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.846667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.847857 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.847286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.847857 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.847451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.847857 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.847467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.847857 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.847820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2p9j\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-kube-api-access-g2p9j\") pod \"prometheus-k8s-0\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:17.913389 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:17.913352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:18.509173 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:18.508566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff"]
Jul 29 19:16:18.532802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:18.532774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f75dd449b-hfxzz"]
Jul 29 19:16:18.536067 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:18.536040    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc353dd3e_9f2a_46b0_986a_e0b7378fe8e7.slice/crio-7da2bb2240e6e488db385c33bd292857df0f02bd1ad64b63e0d19a840f43e972 WatchSource:0}: Error finding container 7da2bb2240e6e488db385c33bd292857df0f02bd1ad64b63e0d19a840f43e972: Status 404 returned error can't find the container with id 7da2bb2240e6e488db385c33bd292857df0f02bd1ad64b63e0d19a840f43e972
Jul 29 19:16:18.536302 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:18.536280    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97c5fea_80e2_4c25_a12e_a78492d38d7e.slice/crio-9a48ea7f8dd0f68048b864e599670b785832465e7376a7dbaaa0c14110b7a8c0 WatchSource:0}: Error finding container 9a48ea7f8dd0f68048b864e599670b785832465e7376a7dbaaa0c14110b7a8c0: Status 404 returned error can't find the container with id 9a48ea7f8dd0f68048b864e599670b785832465e7376a7dbaaa0c14110b7a8c0
Jul 29 19:16:18.538197 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:18.538176    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:16:18.538681 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:18.538622    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:16:18.544640 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:18.544614    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:16:18.549341 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:16:18.548525    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d0fd56_5dff_4195_9e75_5a7cffb837fc.slice/crio-f8ca8f85f68ff37a21317508b622aafd52fde78efb721e7cd1e3fa19f9639813 WatchSource:0}: Error finding container f8ca8f85f68ff37a21317508b622aafd52fde78efb721e7cd1e3fa19f9639813: Status 404 returned error can't find the container with id f8ca8f85f68ff37a21317508b622aafd52fde78efb721e7cd1e3fa19f9639813
Jul 29 19:16:18.550828 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:18.550793    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:16:19.055319 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.055283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff" event={"ID":"b97c5fea-80e2-4c25-a12e-a78492d38d7e","Type":"ContainerStarted","Data":"9a48ea7f8dd0f68048b864e599670b785832465e7376a7dbaaa0c14110b7a8c0"}
Jul 29 19:16:19.057137 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.057105    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468" exitCode=0
Jul 29 19:16:19.057251 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.057195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"}
Jul 29 19:16:19.057301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.057258    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"f8ca8f85f68ff37a21317508b622aafd52fde78efb721e7cd1e3fa19f9639813"}
Jul 29 19:16:19.060153 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.060128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6wscz" event={"ID":"271cd5b5-89c1-464c-97d0-c45b214776f9","Type":"ContainerStarted","Data":"9bd1af684d06ccd030c42e03565bea674836f6337f85b2b1dd966a0096dec836"}
Jul 29 19:16:19.060290 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.060270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:16:19.061846 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.061819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhrvq" event={"ID":"ed232216-d9a1-4512-9f78-339059c5dcec","Type":"ContainerStarted","Data":"90c0c69c270442b04e5f197715188173f09a9273e96350d27eafd29c682b019f"}
Jul 29 19:16:19.064857 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.064834    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a" exitCode=0
Jul 29 19:16:19.064969 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.064953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a"}
Jul 29 19:16:19.066325 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.066267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz" event={"ID":"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7","Type":"ContainerStarted","Data":"7da2bb2240e6e488db385c33bd292857df0f02bd1ad64b63e0d19a840f43e972"}
Jul 29 19:16:19.071285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.071266    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:16:19.153818 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.153760    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6wscz" podStartSLOduration=66.691579908 podStartE2EDuration="1m12.153739317s" totalImagesPullingTime="5.462159409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:19.153500619 +0000 UTC m=+73.070450212" watchObservedRunningTime="2026-07-29 19:16:19.153739317 +0000 UTC m=+73.070688906"
Jul 29 19:16:19.178050 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:19.176900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nhrvq" podStartSLOduration=66.683834679 podStartE2EDuration="1m12.176879313s" totalImagesPullingTime="5.493044634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:19.175862502 +0000 UTC m=+73.092812091" watchObservedRunningTime="2026-07-29 19:16:19.176879313 +0000 UTC m=+73.093828899"
Jul 29 19:16:21.080246 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:21.079877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff" event={"ID":"b97c5fea-80e2-4c25-a12e-a78492d38d7e","Type":"ContainerStarted","Data":"871f3161e2e90cff5013d567d6c5b518b556527b6d2a79e484dddd5dc9f113b3"}
Jul 29 19:16:21.080246 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:21.079943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff" event={"ID":"b97c5fea-80e2-4c25-a12e-a78492d38d7e","Type":"ContainerStarted","Data":"c90b4d864d916205f090f8b15159766eba154da7dcd7d982492b9ad9c0cb478c"}
Jul 29 19:16:21.080246 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:21.079970    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff" event={"ID":"b97c5fea-80e2-4c25-a12e-a78492d38d7e","Type":"ContainerStarted","Data":"93260b9229cfdf87696f1f039e27b41f1268961ed13eb668c75ed665bff5f7d0"}
Jul 29 19:16:21.083280 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:21.083228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz" event={"ID":"c353dd3e-9f2a-46b0-986a-e0b7378fe8e7","Type":"ContainerStarted","Data":"fded8911054cd707cdaf68da6a8227ed371527ddeb7144788bb5a252f727b24d"}
Jul 29 19:16:21.194673 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:21.194500    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz" podStartSLOduration=4.068191917 podStartE2EDuration="6.194478599s" totalImagesPullingTime="2.126286682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:21.19231693 +0000 UTC m=+75.109266521" watchObservedRunningTime="2026-07-29 19:16:21.194478599 +0000 UTC m=+75.111428188"
Jul 29 19:16:21.194673 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:21.194625    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b4d4fc79f-sbjff" podStartSLOduration=3.061705598 podStartE2EDuration="5.194614494s" totalImagesPullingTime="2.132908896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:21.154808996 +0000 UTC m=+75.071758577" watchObservedRunningTime="2026-07-29 19:16:21.194614494 +0000 UTC m=+75.111564083"
Jul 29 19:16:22.101783 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:22.101743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41"}
Jul 29 19:16:22.102213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:22.101864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05"}
Jul 29 19:16:22.102213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:22.101909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771"}
Jul 29 19:16:22.102213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:22.101948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad"}
Jul 29 19:16:22.102213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:22.101987    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5"}
Jul 29 19:16:24.117996 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:24.117971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"}
Jul 29 19:16:24.118433 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:24.118063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"}
Jul 29 19:16:25.126393 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:25.126357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerStarted","Data":"c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5"}
Jul 29 19:16:25.159688 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:25.159642    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.291340092 podStartE2EDuration="13.159621043s" totalImagesPullingTime="8.844011226s" totalInitContainerRuntime="24.269725ms" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:25.157392404 +0000 UTC m=+79.074341992" watchObservedRunningTime="2026-07-29 19:16:25.159621043 +0000 UTC m=+79.076570636"
Jul 29 19:16:27.137376 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:27.137344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"}
Jul 29 19:16:27.137724 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:27.137409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"}
Jul 29 19:16:27.137724 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:27.137439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"}
Jul 29 19:16:27.137724 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:27.137464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerStarted","Data":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"}
Jul 29 19:16:27.175282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:27.175217    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.962811732 podStartE2EDuration="10.175195615s" totalImagesPullingTime="7.185593623s" totalInitContainerRuntime="26.79026ms" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:27.172804816 +0000 UTC m=+81.089754435" watchObservedRunningTime="2026-07-29 19:16:27.175195615 +0000 UTC m=+81.092145203"
Jul 29 19:16:27.914429 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:27.914391    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:16:33.187133 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:33.187096    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6476d6455c-czv7j"]
Jul 29 19:16:36.029800 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:36.029763    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:36.030195 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:36.029822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:50.074069 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:50.074034    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6wscz"
Jul 29 19:16:56.035256 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:56.035226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:56.039090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:56.039067    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f75dd449b-hfxzz"
Jul 29 19:16:58.205691 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.205648    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6476d6455c-czv7j" podUID="b86e0007-b074-4c7a-8a8a-6f68c06b1250" containerName="console" containerID="cri-o://03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008" gracePeriod=15
Jul 29 19:16:58.454460 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.454434    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:16:58.585003 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.584976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-config\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585197 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-serving-cert\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585197 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585080    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-trusted-ca-bundle\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585197 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585104    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-oauth-serving-cert\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585197 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585138    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-service-ca\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585197 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585179    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ff98\" (UniqueName: \"kubernetes.io/projected/b86e0007-b074-4c7a-8a8a-6f68c06b1250-kube-api-access-2ff98\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585450 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585214    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-oauth-config\") pod \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\" (UID: \"b86e0007-b074-4c7a-8a8a-6f68c06b1250\") "
Jul 29 19:16:58.585544 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-config" (OuterVolumeSpecName: "console-config") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:58.585608 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585547    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-service-ca" (OuterVolumeSpecName: "service-ca") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:58.585608 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:58.585694 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.585588    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:58.587612 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.587580    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:16:58.587722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.587631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:16:58.587722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.587625    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86e0007-b074-4c7a-8a8a-6f68c06b1250-kube-api-access-2ff98" (OuterVolumeSpecName: "kube-api-access-2ff98") pod "b86e0007-b074-4c7a-8a8a-6f68c06b1250" (UID: "b86e0007-b074-4c7a-8a8a-6f68c06b1250"). InnerVolumeSpecName "kube-api-access-2ff98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:16:58.686245 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686216    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:58.686245 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686244    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ff98\" (UniqueName: \"kubernetes.io/projected/b86e0007-b074-4c7a-8a8a-6f68c06b1250-kube-api-access-2ff98\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:58.686416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686255    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-oauth-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:58.686416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686264    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:58.686416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686272    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b86e0007-b074-4c7a-8a8a-6f68c06b1250-console-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:58.686416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686281    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-trusted-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:58.686416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:58.686288    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b86e0007-b074-4c7a-8a8a-6f68c06b1250-oauth-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:16:59.260115 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.260058    2576 generic.go:356] "Generic (PLEG): container finished" podID="b86e0007-b074-4c7a-8a8a-6f68c06b1250" containerID="03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008" exitCode=0
Jul 29 19:16:59.260115 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.260116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476d6455c-czv7j"
Jul 29 19:16:59.260625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.260132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476d6455c-czv7j" event={"ID":"b86e0007-b074-4c7a-8a8a-6f68c06b1250","Type":"ContainerDied","Data":"03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008"}
Jul 29 19:16:59.260625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.260169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476d6455c-czv7j" event={"ID":"b86e0007-b074-4c7a-8a8a-6f68c06b1250","Type":"ContainerDied","Data":"65794c177187d99313dbcdc6eb71a7d2c5bd979b5ef104fb1d9cc1006bdbe244"}
Jul 29 19:16:59.260625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.260189    2576 scope.go:117] "RemoveContainer" containerID="03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008"
Jul 29 19:16:59.268204 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.268185    2576 scope.go:117] "RemoveContainer" containerID="03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008"
Jul 29 19:16:59.268458 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:16:59.268441    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008\": container with ID starting with 03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008 not found: ID does not exist" containerID="03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008"
Jul 29 19:16:59.268505 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.268464    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008"} err="failed to get container status \"03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008\": rpc error: code = NotFound desc = could not find container \"03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008\": container with ID starting with 03a7bb402c159a08beaef1ea8b74dbb65cdd267e798c8a8c3c577f7fd3eea008 not found: ID does not exist"
Jul 29 19:16:59.278223 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.278202    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6476d6455c-czv7j"]
Jul 29 19:16:59.281933 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:16:59.281912    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6476d6455c-czv7j"]
Jul 29 19:17:00.671275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:00.671241    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86e0007-b074-4c7a-8a8a-6f68c06b1250" path="/var/lib/kubelet/pods/b86e0007-b074-4c7a-8a8a-6f68c06b1250/volumes"
Jul 29 19:17:17.913894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:17.913847    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:17.933716 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:17.933693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:18.350176 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:18.350152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:31.782040 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.781996    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:17:31.782511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.782372    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="alertmanager" containerID="cri-o://6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5" gracePeriod=120
Jul 29 19:17:31.782511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.782412    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-metric" containerID="cri-o://3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41" gracePeriod=120
Jul 29 19:17:31.782627 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.782476    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-web" containerID="cri-o://e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771" gracePeriod=120
Jul 29 19:17:31.782627 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.782521    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="config-reloader" containerID="cri-o://c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad" gracePeriod=120
Jul 29 19:17:31.782627 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.782476    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="prom-label-proxy" containerID="cri-o://c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5" gracePeriod=120
Jul 29 19:17:31.782627 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:31.782483    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy" containerID="cri-o://2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05" gracePeriod=120
Jul 29 19:17:32.388557 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388528    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5" exitCode=0
Jul 29 19:17:32.388557 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388550    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41" exitCode=0
Jul 29 19:17:32.388557 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388556    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05" exitCode=0
Jul 29 19:17:32.388557 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388563    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad" exitCode=0
Jul 29 19:17:32.388802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388568    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5" exitCode=0
Jul 29 19:17:32.388802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5"}
Jul 29 19:17:32.388802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41"}
Jul 29 19:17:32.388802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05"}
Jul 29 19:17:32.388802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad"}
Jul 29 19:17:32.388802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:32.388731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5"}
Jul 29 19:17:33.033943 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.033920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.082125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082097    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-web-config\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082140    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-cluster-tls-config\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082163    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-web\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-out\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082251    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-tls-assets\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-metrics-client-ca\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-main-db\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082346    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-main-tls\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfjn9\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-kube-api-access-bfjn9\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082482    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-volume\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082508    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.082868 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.082537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle\") pod \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\" (UID: \"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b\") "
Jul 29 19:17:33.083796 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.083719    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:17:33.084041 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.083990    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:33.084288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.084262    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:33.086712 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.086656    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:17:33.086712 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.086664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.087032 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.086982    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-out" (OuterVolumeSpecName: "config-out") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:17:33.087907 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.087779    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-volume" (OuterVolumeSpecName: "config-volume") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.087907 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.087860    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-kube-api-access-bfjn9" (OuterVolumeSpecName: "kube-api-access-bfjn9") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "kube-api-access-bfjn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:17:33.088120 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.088072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.088591 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.088569    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.089239 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.089207    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.092085 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.091995    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.099217 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.099189    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-web-config" (OuterVolumeSpecName: "web-config") pod "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" (UID: "b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183632    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfjn9\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-kube-api-access-bfjn9\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183662    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183675    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183684    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183694    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183703    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-web-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183712    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-cluster-tls-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.183718 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183721    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.184105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183731    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-config-out\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.184105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183740    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-tls-assets\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.184105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183749    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-metrics-client-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.184105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183758    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-alertmanager-main-db\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.184105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.183768    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b-secret-alertmanager-main-tls\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:33.395486 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.395456    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerID="e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771" exitCode=0
Jul 29 19:17:33.395660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.395513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771"}
Jul 29 19:17:33.395660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.395530    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.395660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.395571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b","Type":"ContainerDied","Data":"87ee59806d5b631c0758df9a2b4d22cf6c5faa9e81df0154b57b7e7380cf3567"}
Jul 29 19:17:33.395660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.395604    2576 scope.go:117] "RemoveContainer" containerID="c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5"
Jul 29 19:17:33.403806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.403779    2576 scope.go:117] "RemoveContainer" containerID="3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41"
Jul 29 19:17:33.410721 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.410701    2576 scope.go:117] "RemoveContainer" containerID="2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05"
Jul 29 19:17:33.417448 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.417429    2576 scope.go:117] "RemoveContainer" containerID="e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771"
Jul 29 19:17:33.424536 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.424507    2576 scope.go:117] "RemoveContainer" containerID="c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad"
Jul 29 19:17:33.431459 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.431437    2576 scope.go:117] "RemoveContainer" containerID="6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5"
Jul 29 19:17:33.436000 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.435950    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:17:33.440550 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.439914    2576 scope.go:117] "RemoveContainer" containerID="8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a"
Jul 29 19:17:33.442896 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.442877    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:17:33.448710 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.448696    2576 scope.go:117] "RemoveContainer" containerID="c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5"
Jul 29 19:17:33.448959 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.448941    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5\": container with ID starting with c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5 not found: ID does not exist" containerID="c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5"
Jul 29 19:17:33.449008 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.448970    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5"} err="failed to get container status \"c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5\": rpc error: code = NotFound desc = could not find container \"c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5\": container with ID starting with c186a693b674403f5dae617afa1ae753aa854e6cc5964db9522b15b5ef1705f5 not found: ID does not exist"
Jul 29 19:17:33.449008 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.448992    2576 scope.go:117] "RemoveContainer" containerID="3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41"
Jul 29 19:17:33.449220 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.449202    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41\": container with ID starting with 3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41 not found: ID does not exist" containerID="3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41"
Jul 29 19:17:33.449275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449225    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41"} err="failed to get container status \"3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41\": rpc error: code = NotFound desc = could not find container \"3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41\": container with ID starting with 3db666883faa67d01e8f747c6f269d1f88efd5a3f6a62a040ea0db7ecb27df41 not found: ID does not exist"
Jul 29 19:17:33.449275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449237    2576 scope.go:117] "RemoveContainer" containerID="2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05"
Jul 29 19:17:33.449479 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.449462    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05\": container with ID starting with 2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05 not found: ID does not exist" containerID="2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05"
Jul 29 19:17:33.449534 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449488    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05"} err="failed to get container status \"2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05\": rpc error: code = NotFound desc = could not find container \"2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05\": container with ID starting with 2c97e7a03f6667f134807f06c0d7305c8c350ba295a09202e5d329a814727f05 not found: ID does not exist"
Jul 29 19:17:33.449534 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449512    2576 scope.go:117] "RemoveContainer" containerID="e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771"
Jul 29 19:17:33.449725 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.449708    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771\": container with ID starting with e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771 not found: ID does not exist" containerID="e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771"
Jul 29 19:17:33.449765 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449730    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771"} err="failed to get container status \"e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771\": rpc error: code = NotFound desc = could not find container \"e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771\": container with ID starting with e100d41c85a02b7332e0ea7f97c0bcd46570e59b41736797dddd253a31b98771 not found: ID does not exist"
Jul 29 19:17:33.449765 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449745    2576 scope.go:117] "RemoveContainer" containerID="c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad"
Jul 29 19:17:33.449928 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.449913    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad\": container with ID starting with c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad not found: ID does not exist" containerID="c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad"
Jul 29 19:17:33.449963 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449931    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad"} err="failed to get container status \"c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad\": rpc error: code = NotFound desc = could not find container \"c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad\": container with ID starting with c627b3034fab8156305f6fe1c63ef769841a13561471caf534f71e66d0731bad not found: ID does not exist"
Jul 29 19:17:33.449963 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.449944    2576 scope.go:117] "RemoveContainer" containerID="6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5"
Jul 29 19:17:33.450195 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.450168    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5\": container with ID starting with 6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5 not found: ID does not exist" containerID="6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5"
Jul 29 19:17:33.450255 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.450191    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5"} err="failed to get container status \"6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5\": rpc error: code = NotFound desc = could not find container \"6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5\": container with ID starting with 6c96be8732e9d48dc19121fdb836931b4d4e04bfdd8bbe976af664a593c469b5 not found: ID does not exist"
Jul 29 19:17:33.450255 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.450202    2576 scope.go:117] "RemoveContainer" containerID="8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a"
Jul 29 19:17:33.450426 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.450411    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a\": container with ID starting with 8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a not found: ID does not exist" containerID="8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a"
Jul 29 19:17:33.450459 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.450431    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a"} err="failed to get container status \"8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a\": rpc error: code = NotFound desc = could not find container \"8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a\": container with ID starting with 8f3ff064e051486d4b2f268644117330c771feabd37a4905b43350ceded4ef5a not found: ID does not exist"
Jul 29 19:17:33.485039 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.484995    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:17:33.485299 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485286    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-web"
Jul 29 19:17:33.485346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-web"
Jul 29 19:17:33.485346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485314    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="prom-label-proxy"
Jul 29 19:17:33.485346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485319    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="prom-label-proxy"
Jul 29 19:17:33.485346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485328    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="alertmanager"
Jul 29 19:17:33.485346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485334    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="alertmanager"
Jul 29 19:17:33.485346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485344    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485350    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485358    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-metric"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485364    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-metric"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485370    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86e0007-b074-4c7a-8a8a-6f68c06b1250" containerName="console"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485375    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86e0007-b074-4c7a-8a8a-6f68c06b1250" containerName="console"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485384    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="init-config-reloader"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485389    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="init-config-reloader"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485396    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="config-reloader"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485401    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="config-reloader"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485442    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="config-reloader"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485449    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485454    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="prom-label-proxy"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485462    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86e0007-b074-4c7a-8a8a-6f68c06b1250" containerName="console"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485467    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-web"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485471    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="kube-rbac-proxy-metric"
Jul 29 19:17:33.485511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.485477    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" containerName="alertmanager"
Jul 29 19:17:33.489338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.489320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.495902 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.495846    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-metric\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret"
Jul 29 19:17:33.498005 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.497934    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-web\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret"
Jul 29 19:17:33.498139 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498040    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls-assets-0\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret"
Jul 29 19:17:33.498139 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498041    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret"
Jul 29 19:17:33.498139 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498039    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-web-config\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret"
Jul 29 19:17:33.498139 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498064    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-dockercfg-4rsxg\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rsxg\"" type="*v1.Secret"
Jul 29 19:17:33.498139 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498105    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"alertmanager-trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap"
Jul 29 19:17:33.498139 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498124    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-cluster-tls-config\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret"
Jul 29 19:17:33.498382 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498141    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-generated\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret"
Jul 29 19:17:33.498382 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498164    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"alertmanager-main-0\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" podUID="c8b396d8-14af-4641-8905-cdb9eb41524d" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.498382 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:33.498181    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls\" is forbidden: User \"system:node:ip-10-0-130-131.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-131.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret"
Jul 29 19:17:33.586487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b396d8-14af-4641-8905-cdb9eb41524d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-web-config\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b396d8-14af-4641-8905-cdb9eb41524d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b396d8-14af-4641-8905-cdb9eb41524d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s24wb\" (UniqueName: \"kubernetes.io/projected/c8b396d8-14af-4641-8905-cdb9eb41524d-kube-api-access-s24wb\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b396d8-14af-4641-8905-cdb9eb41524d-config-out\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.586915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.586843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b396d8-14af-4641-8905-cdb9eb41524d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.687949 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.687853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b396d8-14af-4641-8905-cdb9eb41524d-config-out\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.687949 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.687911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b396d8-14af-4641-8905-cdb9eb41524d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.687949 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.687945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b396d8-14af-4641-8905-cdb9eb41524d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.687949 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.687964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-web-config\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688256 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688256 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688256 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688382 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b396d8-14af-4641-8905-cdb9eb41524d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688382 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688382 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688382 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688382 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688376    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b396d8-14af-4641-8905-cdb9eb41524d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688544 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b396d8-14af-4641-8905-cdb9eb41524d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688544 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s24wb\" (UniqueName: \"kubernetes.io/projected/c8b396d8-14af-4641-8905-cdb9eb41524d-kube-api-access-s24wb\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.688834 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.688815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b396d8-14af-4641-8905-cdb9eb41524d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.690129 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.690113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b396d8-14af-4641-8905-cdb9eb41524d-config-out\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:33.837444 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.837411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:17:33.865980 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:33.865944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s24wb\" (UniqueName: \"kubernetes.io/projected/c8b396d8-14af-4641-8905-cdb9eb41524d-kube-api-access-s24wb\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.404299 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.404272    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 19:17:34.411079 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.411053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b396d8-14af-4641-8905-cdb9eb41524d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.456684 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.456650    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 19:17:34.460686 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.460661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-web-config\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.471691 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.471663    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 19:17:34.480822 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.480789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.481112 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.481094    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 19:17:34.489535 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.489510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b396d8-14af-4641-8905-cdb9eb41524d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.521009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.520978    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 19:17:34.531146 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.531112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.617306 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.617273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 19:17:34.620391 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.620369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:34.626368 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.626333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rsxg\""
Jul 29 19:17:34.670707 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.670627    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b" path="/var/lib/kubelet/pods/b0a804f1-dac5-4da8-a2f5-3f5d18a1b17b/volumes"
Jul 29 19:17:34.689134 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:34.689081    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-kube-rbac-proxy-web: failed to sync secret cache: timed out waiting for the condition
Jul 29 19:17:34.689238 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:34.689194    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-web podName:c8b396d8-14af-4641-8905-cdb9eb41524d nodeName:}" failed. No retries permitted until 2026-07-29 19:17:35.189177487 +0000 UTC m=+149.106127052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-kube-rbac-proxy-web" (UniqueName: "kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-web") pod "alertmanager-main-0" (UID: "c8b396d8-14af-4641-8905-cdb9eb41524d") : failed to sync secret cache: timed out waiting for the condition
Jul 29 19:17:34.689238 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:34.689081    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-generated: failed to sync secret cache: timed out waiting for the condition
Jul 29 19:17:34.689322 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:34.689256    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-config-volume podName:c8b396d8-14af-4641-8905-cdb9eb41524d nodeName:}" failed. No retries permitted until 2026-07-29 19:17:35.189242339 +0000 UTC m=+149.106191905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-config-volume") pod "alertmanager-main-0" (UID: "c8b396d8-14af-4641-8905-cdb9eb41524d") : failed to sync secret cache: timed out waiting for the condition
Jul 29 19:17:34.689322 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:34.689104    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-kube-rbac-proxy-metric: failed to sync secret cache: timed out waiting for the condition
Jul 29 19:17:34.689322 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:34.689289    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-metric podName:c8b396d8-14af-4641-8905-cdb9eb41524d nodeName:}" failed. No retries permitted until 2026-07-29 19:17:35.189281353 +0000 UTC m=+149.106230918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-kube-rbac-proxy-metric" (UniqueName: "kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-metric") pod "alertmanager-main-0" (UID: "c8b396d8-14af-4641-8905-cdb9eb41524d") : failed to sync secret cache: timed out waiting for the condition
Jul 29 19:17:34.844722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.844694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 19:17:34.905648 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:34.905616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 19:17:35.042450 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.042361    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 19:17:35.205178 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.205147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.205343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.205197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.205343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.205221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.207660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.207626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.207660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.207642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.207814 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.207743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b396d8-14af-4641-8905-cdb9eb41524d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b396d8-14af-4641-8905-cdb9eb41524d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.300592 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.300507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:17:35.443671 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:35.443631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:17:35.447230 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:17:35.447204    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b396d8_14af_4641_8905_cdb9eb41524d.slice/crio-b0ef022ea654715f2e07c07439aa386ea31c01b406033fb7efa83aa01c61faf0 WatchSource:0}: Error finding container b0ef022ea654715f2e07c07439aa386ea31c01b406033fb7efa83aa01c61faf0: Status 404 returned error can't find the container with id b0ef022ea654715f2e07c07439aa386ea31c01b406033fb7efa83aa01c61faf0
Jul 29 19:17:36.118990 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.118957    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:17:36.119606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.119343    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="prometheus" containerID="cri-o://2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24" gracePeriod=600
Jul 29 19:17:36.119606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.119389    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="thanos-sidecar" containerID="cri-o://4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01" gracePeriod=600
Jul 29 19:17:36.119606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.119400    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-web" containerID="cri-o://5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6" gracePeriod=600
Jul 29 19:17:36.119606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.119437    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058" gracePeriod=600
Jul 29 19:17:36.119606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.119373    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy" containerID="cri-o://a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5" gracePeriod=600
Jul 29 19:17:36.119606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.119534    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="config-reloader" containerID="cri-o://d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258" gracePeriod=600
Jul 29 19:17:36.374194 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.374126    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.411372 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.411337    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8b396d8-14af-4641-8905-cdb9eb41524d" containerID="4fcf808f92dc4b6ba0db60f95a18e2243cd52a6550cdab5a07cec6eed12b2039" exitCode=0
Jul 29 19:17:36.411548 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.411463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerDied","Data":"4fcf808f92dc4b6ba0db60f95a18e2243cd52a6550cdab5a07cec6eed12b2039"}
Jul 29 19:17:36.411548 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.411538    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"b0ef022ea654715f2e07c07439aa386ea31c01b406033fb7efa83aa01c61faf0"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415763    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058" exitCode=0
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415791    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5" exitCode=0
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415805    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6" exitCode=0
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415813    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01" exitCode=0
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415822    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258" exitCode=0
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415829    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24" exitCode=0
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415902    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-db\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-web-config\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.415988    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-1\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config-out\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416064    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-2\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416092    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-serving-certs-ca-bundle\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416131    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-thanos-prometheus-http-client-file\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"}
Jul 29 19:17:36.417144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1d0fd56-5dff-4195-9e75-5a7cffb837fc","Type":"ContainerDied","Data":"f8ca8f85f68ff37a21317508b622aafd52fde78efb721e7cd1e3fa19f9639813"}
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416164    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-0\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416287    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-tls\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416315    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-metrics-client-certs\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416342    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-tls-assets\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-trusted-ca-bundle\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416431    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416453    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2p9j\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-kube-api-access-g2p9j\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-metrics-client-ca\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416518    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-kubelet-serving-ca-bundle\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416546    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-grpc-tls\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.416611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-kube-rbac-proxy\") pod \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\" (UID: \"b1d0fd56-5dff-4195-9e75-5a7cffb837fc\") "
Jul 29 19:17:36.418338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.417458    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.421013 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.419606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.421013 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.419899    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:17:36.421013 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.420158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.421013 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.420384    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.421329 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.421072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.421329 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.421217    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.422154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.421628    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.422154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.421936    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.422154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.421981    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:17:36.423068 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.422894    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.425910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.425805    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config-out" (OuterVolumeSpecName: "config-out") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:17:36.425910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.425843    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.426816 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.426751    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.427141 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.426959    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config" (OuterVolumeSpecName: "config") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.427476 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.427432    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.427865 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.427823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-kube-api-access-g2p9j" (OuterVolumeSpecName: "kube-api-access-g2p9j") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "kube-api-access-g2p9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:17:36.428296 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.428155    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.428296 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.428268    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.428508 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.428446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:17:36.428875 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.428842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.436134 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.436078    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.440744 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.440713    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-web-config" (OuterVolumeSpecName: "web-config") pod "b1d0fd56-5dff-4195-9e75-5a7cffb837fc" (UID: "b1d0fd56-5dff-4195-9e75-5a7cffb837fc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:17:36.444811 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.444786    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.455730 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.455703    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.463511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.463464    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.482442 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.482417    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.499378 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.499353    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.509714 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.509692    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.510039 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.510007    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.510125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510048    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"} err="failed to get container status \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist"
Jul 29 19:17:36.510125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510076    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.510342 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.510323    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.510405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510348    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"} err="failed to get container status \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist"
Jul 29 19:17:36.510405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510365    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.510667 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.510647    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.510754 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510672    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"} err="failed to get container status \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist"
Jul 29 19:17:36.510754 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510687    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.510940 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.510922    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.510994 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510945    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"} err="failed to get container status \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist"
Jul 29 19:17:36.510994 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.510964    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.511237 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.511217    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.511284 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511241    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"} err="failed to get container status \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist"
Jul 29 19:17:36.511284 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511261    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.511498 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.511479    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.511539 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511502    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"} err="failed to get container status \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist"
Jul 29 19:17:36.511539 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511519    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.511735 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:17:36.511718    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.511793 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511737    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"} err="failed to get container status \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist"
Jul 29 19:17:36.511793 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511749    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.512012 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.511983    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"} err="failed to get container status \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist"
Jul 29 19:17:36.512012 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512007    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.512294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512258    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"} err="failed to get container status \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist"
Jul 29 19:17:36.512375 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512294    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.512594 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512568    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"} err="failed to get container status \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist"
Jul 29 19:17:36.512641 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512596    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.512873 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512855    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"} err="failed to get container status \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist"
Jul 29 19:17:36.512922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.512874    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.513134 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513114    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"} err="failed to get container status \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist"
Jul 29 19:17:36.513209 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513134    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.513349 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513331    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"} err="failed to get container status \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist"
Jul 29 19:17:36.513404 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513351    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.513590 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513560    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"} err="failed to get container status \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist"
Jul 29 19:17:36.513590 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513592    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.513944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513911    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"} err="failed to get container status \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist"
Jul 29 19:17:36.513944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.513938    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.514235 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514217    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"} err="failed to get container status \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist"
Jul 29 19:17:36.514235 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514234    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.514458 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514437    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"} err="failed to get container status \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist"
Jul 29 19:17:36.514458 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514457    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.514674 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514656    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"} err="failed to get container status \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist"
Jul 29 19:17:36.514735 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514679    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.514886 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514869    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"} err="failed to get container status \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist"
Jul 29 19:17:36.514886 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.514883    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.515171 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515150    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"} err="failed to get container status \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist"
Jul 29 19:17:36.515171 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515170    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.515446 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515423    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"} err="failed to get container status \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist"
Jul 29 19:17:36.515509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515451    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.515714 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515692    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"} err="failed to get container status \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist"
Jul 29 19:17:36.515796 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515715    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.515932 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515914    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"} err="failed to get container status \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist"
Jul 29 19:17:36.516001 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.515932    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.516228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516201    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"} err="failed to get container status \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist"
Jul 29 19:17:36.516228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516227    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.516499 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516474    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"} err="failed to get container status \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist"
Jul 29 19:17:36.516549 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516503    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.516751 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516731    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"} err="failed to get container status \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist"
Jul 29 19:17:36.516810 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516753    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.516989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516966    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"} err="failed to get container status \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist"
Jul 29 19:17:36.516989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.516985    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.517317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517292    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"} err="failed to get container status \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist"
Jul 29 19:17:36.517413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517317    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.517729 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517631    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"} err="failed to get container status \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist"
Jul 29 19:17:36.517729 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517658    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517766    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517785    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517800    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-metrics-client-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517814    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-tls-assets\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517827    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517839    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517852    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2p9j\" (UniqueName: \"kubernetes.io/projected/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-kube-api-access-g2p9j\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.517887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517885    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-metrics-client-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517897    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517910    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-grpc-tls\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517923    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517935    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-kube-rbac-proxy\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517949    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-db\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517962    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.517975    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-web-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518005    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518041    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-config-out\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518060    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518075    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518281 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518122    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1d0fd56-5dff-4195-9e75-5a7cffb837fc-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:17:36.518767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518430    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"} err="failed to get container status \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist"
Jul 29 19:17:36.518767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518459    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.518767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518740    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"} err="failed to get container status \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist"
Jul 29 19:17:36.518767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518763    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.519008 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.518981    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"} err="failed to get container status \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist"
Jul 29 19:17:36.519008 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519007    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.519313 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519294    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"} err="failed to get container status \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist"
Jul 29 19:17:36.519368 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519313    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.519670 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519648    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"} err="failed to get container status \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist"
Jul 29 19:17:36.519747 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519670    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.519987 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519966    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"} err="failed to get container status \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist"
Jul 29 19:17:36.519987 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.519984    2576 scope.go:117] "RemoveContainer" containerID="59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"
Jul 29 19:17:36.520238 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520219    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058"} err="failed to get container status \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": rpc error: code = NotFound desc = could not find container \"59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058\": container with ID starting with 59614bca448012d5a55052cec7b2230667d735b91f81e1d2593e849118e3b058 not found: ID does not exist"
Jul 29 19:17:36.520238 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520237    2576 scope.go:117] "RemoveContainer" containerID="a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"
Jul 29 19:17:36.520512 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520487    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5"} err="failed to get container status \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": rpc error: code = NotFound desc = could not find container \"a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5\": container with ID starting with a13683846c68982b7a483ac162ca1b876b02071d89b0d412e206e533e5b556c5 not found: ID does not exist"
Jul 29 19:17:36.520512 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520511    2576 scope.go:117] "RemoveContainer" containerID="5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"
Jul 29 19:17:36.520745 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520727    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6"} err="failed to get container status \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": rpc error: code = NotFound desc = could not find container \"5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6\": container with ID starting with 5f8b15e2791e6c3b55b311fcd4b23ef9665dece4e059876a785870319b998fd6 not found: ID does not exist"
Jul 29 19:17:36.520798 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520746    2576 scope.go:117] "RemoveContainer" containerID="4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"
Jul 29 19:17:36.520987 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520969    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01"} err="failed to get container status \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": rpc error: code = NotFound desc = could not find container \"4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01\": container with ID starting with 4ba1e59cd4c7e8f5c6b4e0e845fe98c33df2fbfda844bd32c80f3be8ddcd1a01 not found: ID does not exist"
Jul 29 19:17:36.521058 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.520988    2576 scope.go:117] "RemoveContainer" containerID="d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"
Jul 29 19:17:36.521272 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.521254    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258"} err="failed to get container status \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": rpc error: code = NotFound desc = could not find container \"d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258\": container with ID starting with d5a2162dcdf182c216f9d48397474c0bfccee4567aa68fc413063cae9e1d0258 not found: ID does not exist"
Jul 29 19:17:36.521313 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.521274    2576 scope.go:117] "RemoveContainer" containerID="2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"
Jul 29 19:17:36.521582 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.521549    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24"} err="failed to get container status \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": rpc error: code = NotFound desc = could not find container \"2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24\": container with ID starting with 2a4a73d111bd6eb7eb3d5774cc5c10b228349d8868c9efff7af315f449b29d24 not found: ID does not exist"
Jul 29 19:17:36.521582 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.521574    2576 scope.go:117] "RemoveContainer" containerID="5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"
Jul 29 19:17:36.521888 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.521864    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468"} err="failed to get container status \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": rpc error: code = NotFound desc = could not find container \"5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468\": container with ID starting with 5e3892d7203019226a2fd6d8b298876bf411568a3e7e75a06ae91c4113b89468 not found: ID does not exist"
Jul 29 19:17:36.742285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.742232    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:17:36.748417 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.748383    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:17:36.793142 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.793111    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:17:36.797821 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.797792    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="thanos-sidecar"
Jul 29 19:17:36.798051 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798014    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="thanos-sidecar"
Jul 29 19:17:36.798178 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798157    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="init-config-reloader"
Jul 29 19:17:36.798178 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798174    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="init-config-reloader"
Jul 29 19:17:36.798178 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798187    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="prometheus"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798198    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="prometheus"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798221    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="config-reloader"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798229    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="config-reloader"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798238    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-web"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798246    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-web"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798256    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-thanos"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798264    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-thanos"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798287    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798295    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798379    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="thanos-sidecar"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798392    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-web"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798403    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798413    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="kube-rbac-proxy-thanos"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798423    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="prometheus"
Jul 29 19:17:36.798425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.798434    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" containerName="config-reloader"
Jul 29 19:17:36.801041 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.801009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.804433 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.804402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 19:17:36.804675 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.804656    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 19:17:36.804853 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.804838    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 19:17:36.805059 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805041    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 19:17:36.805273 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805251    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 19:17:36.805372 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805352    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 19:17:36.805518 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805371    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3j1vca3p7icmm\""
Jul 29 19:17:36.806514 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805692    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 19:17:36.806514 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805450    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 19:17:36.806514 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.805849    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 19:17:36.806514 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.806054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 19:17:36.806764 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.806603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-59lmm\""
Jul 29 19:17:36.806889 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.806869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 19:17:36.806991 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.806873    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 19:17:36.808479 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.808460    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 19:17:36.812701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.812679    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 19:17:36.820048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.819993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:17:36.921728 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7901695-fbc7-4532-9d1b-d9ac74457e46-config-out\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921728 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921728 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.921970 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.921987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2tf2\" (UniqueName: \"kubernetes.io/projected/f7901695-fbc7-4532-9d1b-d9ac74457e46-kube-api-access-c2tf2\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7901695-fbc7-4532-9d1b-d9ac74457e46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-web-config\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-config\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:36.922254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:36.922245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023051 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.022965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tf2\" (UniqueName: \"kubernetes.io/projected/f7901695-fbc7-4532-9d1b-d9ac74457e46-kube-api-access-c2tf2\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023051 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7901695-fbc7-4532-9d1b-d9ac74457e46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-web-config\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-config\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7901695-fbc7-4532-9d1b-d9ac74457e46-config-out\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023317 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.023789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.024207 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.023924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.024265 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.024243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.024590 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.024566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.025400 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.025376    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.025989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.025967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.026301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.026275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-web-config\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.026381 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.026310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.026381 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.026326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-config\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.027733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.026782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7901695-fbc7-4532-9d1b-d9ac74457e46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.027733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.026861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.027733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.027198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.027733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.027518    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.027733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.027656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.027733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.027694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f7901695-fbc7-4532-9d1b-d9ac74457e46-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.028656 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.028636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7901695-fbc7-4532-9d1b-d9ac74457e46-config-out\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.028958 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.028941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.029060 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.029040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.029140 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.029126    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.029508 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.029490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7901695-fbc7-4532-9d1b-d9ac74457e46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.031077 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.031057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2tf2\" (UniqueName: \"kubernetes.io/projected/f7901695-fbc7-4532-9d1b-d9ac74457e46-kube-api-access-c2tf2\") pod \"prometheus-k8s-0\" (UID: \"f7901695-fbc7-4532-9d1b-d9ac74457e46\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.114268 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.114211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:17:37.290922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.290883    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 19:17:37.294410 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:17:37.294378    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7901695_fbc7_4532_9d1b_d9ac74457e46.slice/crio-1a27a4d9d4298171c44096aade55da7e614fc25400923c9fac2549a83b1e8182 WatchSource:0}: Error finding container 1a27a4d9d4298171c44096aade55da7e614fc25400923c9fac2549a83b1e8182: Status 404 returned error can't find the container with id 1a27a4d9d4298171c44096aade55da7e614fc25400923c9fac2549a83b1e8182
Jul 29 19:17:37.421461 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.421425    2576 generic.go:356] "Generic (PLEG): container finished" podID="f7901695-fbc7-4532-9d1b-d9ac74457e46" containerID="d539b007143e22ffa5c4583bbdd72c9e91e6a5ab23e7577f2b147d060f0a129c" exitCode=0
Jul 29 19:17:37.421659 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.421526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerDied","Data":"d539b007143e22ffa5c4583bbdd72c9e91e6a5ab23e7577f2b147d060f0a129c"}
Jul 29 19:17:37.421659 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.421607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"1a27a4d9d4298171c44096aade55da7e614fc25400923c9fac2549a83b1e8182"}
Jul 29 19:17:37.425242 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.425201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"269a0d94d3f462c9824e10e692ca6ecbc564ad9b7ae5e3b41d96e88bf84a0f16"}
Jul 29 19:17:37.425384 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.425288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"c7c27bf693de7954973cb458e636802a05f31b78bd8a06f83b941285354a1d11"}
Jul 29 19:17:37.425384 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.425339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"03e66169c8e530f10f11697c66004bd314704f976f02e32900244119d04a3e56"}
Jul 29 19:17:37.425384 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.425371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"cac5c5da13eb9e68b2e051918e3ea3e376f726676aa812e65ceb9060e8030944"}
Jul 29 19:17:37.425541 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.425400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"a5a3287a1789ab98746b3f66f712ddc674942714b9ddb7bb19f9356b72f48808"}
Jul 29 19:17:37.425541 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.425435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b396d8-14af-4641-8905-cdb9eb41524d","Type":"ContainerStarted","Data":"3c991443914acccb32dcfc256a4ae654e6f2c5cdb3e9c60e10ca4a6b167121b0"}
Jul 29 19:17:37.488656 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:37.488599    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.46942538 podStartE2EDuration="4.488576656s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.151276ms" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:37.486773363 +0000 UTC m=+151.403722994" watchObservedRunningTime="2026-07-29 19:17:37.488576656 +0000 UTC m=+151.405526245"
Jul 29 19:17:38.433836 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.433797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"44b8457fccea222b0ba8356b57406b9e9fae62a2809d80c706c2313ab742f371"}
Jul 29 19:17:38.434048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.433866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"60c80ec2f42d7994e4205fd0b92d2b1fb84386cf78048c065733484fa95a2c09"}
Jul 29 19:17:38.434048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.433895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"e8005d130c1b284abd0fd194e4b75e458e16aa037946d788dbcb7f4cf89ff0f9"}
Jul 29 19:17:38.434048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.433918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"9e7237dc5948d6fbc7111c9e999d0ec8d4c02f3bd3045ffbfab27222534c8d7e"}
Jul 29 19:17:38.434048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.433941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"351518ff7f413d5cadd65057ccad3cbb5526d0419f3fe5e095f0b43d17e04195"}
Jul 29 19:17:38.434048 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.433963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f7901695-fbc7-4532-9d1b-d9ac74457e46","Type":"ContainerStarted","Data":"8332989a2a8704960869d7f6dc4410e042e0377ed417f1108cb321d82d3e6187"}
Jul 29 19:17:38.481791 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.481723    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.460760026 podStartE2EDuration="2.481702222s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.942196ms" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:38.48012285 +0000 UTC m=+152.397072466" watchObservedRunningTime="2026-07-29 19:17:38.481702222 +0000 UTC m=+152.398651812"
Jul 29 19:17:38.671551 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:38.671519    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1d0fd56-5dff-4195-9e75-5a7cffb837fc" path="/var/lib/kubelet/pods/b1d0fd56-5dff-4195-9e75-5a7cffb837fc/volumes"
Jul 29 19:17:42.114715 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:17:42.114674    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:18:37.115376 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:18:37.115336    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:18:37.130348 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:18:37.130326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:18:37.665738 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:18:37.665712    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 19:19:03.904346 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.904312    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"]
Jul 29 19:19:03.907308 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.907291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:03.909404 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.909384    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 19:19:03.909992 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.909973    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 19:19:03.910193 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.910009    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9b2gz\""
Jul 29 19:19:03.916086 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.916062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"]
Jul 29 19:19:03.958978 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.958937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057e0660-9706-41b9-93f4-92a4d13bc457-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5fts7\" (UID: \"057e0660-9706-41b9-93f4-92a4d13bc457\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:03.958978 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:03.958973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n4vn\" (UniqueName: \"kubernetes.io/projected/057e0660-9706-41b9-93f4-92a4d13bc457-kube-api-access-9n4vn\") pod \"cert-manager-cainjector-559cdd8c87-5fts7\" (UID: \"057e0660-9706-41b9-93f4-92a4d13bc457\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:04.059518 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.059480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057e0660-9706-41b9-93f4-92a4d13bc457-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5fts7\" (UID: \"057e0660-9706-41b9-93f4-92a4d13bc457\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:04.059518 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.059513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n4vn\" (UniqueName: \"kubernetes.io/projected/057e0660-9706-41b9-93f4-92a4d13bc457-kube-api-access-9n4vn\") pod \"cert-manager-cainjector-559cdd8c87-5fts7\" (UID: \"057e0660-9706-41b9-93f4-92a4d13bc457\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:04.068465 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.068438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057e0660-9706-41b9-93f4-92a4d13bc457-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5fts7\" (UID: \"057e0660-9706-41b9-93f4-92a4d13bc457\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:04.068600 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.068530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n4vn\" (UniqueName: \"kubernetes.io/projected/057e0660-9706-41b9-93f4-92a4d13bc457-kube-api-access-9n4vn\") pod \"cert-manager-cainjector-559cdd8c87-5fts7\" (UID: \"057e0660-9706-41b9-93f4-92a4d13bc457\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:04.227449 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.227365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"
Jul 29 19:19:04.356238 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.356203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5fts7"]
Jul 29 19:19:04.360777 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:19:04.360751    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod057e0660_9706_41b9_93f4_92a4d13bc457.slice/crio-1754c20fd6d78e86c9cb0dd0e0658d87949764d0fb800e2dcc36fe2016143b4e WatchSource:0}: Error finding container 1754c20fd6d78e86c9cb0dd0e0658d87949764d0fb800e2dcc36fe2016143b4e: Status 404 returned error can't find the container with id 1754c20fd6d78e86c9cb0dd0e0658d87949764d0fb800e2dcc36fe2016143b4e
Jul 29 19:19:04.747190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:04.747151    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7" event={"ID":"057e0660-9706-41b9-93f4-92a4d13bc457","Type":"ContainerStarted","Data":"1754c20fd6d78e86c9cb0dd0e0658d87949764d0fb800e2dcc36fe2016143b4e"}
Jul 29 19:19:08.765848 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:08.765813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7" event={"ID":"057e0660-9706-41b9-93f4-92a4d13bc457","Type":"ContainerStarted","Data":"d2604022b6b4e29892498799f0b549120f5208c4ccce6c9f0ab99d03b6751f19"}
Jul 29 19:19:08.794152 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:08.794099    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5fts7" podStartSLOduration=2.356219661 podStartE2EDuration="5.794082716s" totalImagesPullingTime="3.437863055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:08.792829511 +0000 UTC m=+242.709779098" watchObservedRunningTime="2026-07-29 19:19:08.794082716 +0000 UTC m=+242.711032304"
Jul 29 19:19:13.977239 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:13.977205    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"]
Jul 29 19:19:13.980543 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:13.980529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:13.983288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:13.983257    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 19:19:13.983517 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:13.983503    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:19:13.983567 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:13.983530    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8dbk2\""
Jul 29 19:19:14.001095 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.001075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"]
Jul 29 19:19:14.045738 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.045719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bf09da8-7bbb-4807-b596-d86c24cb50b8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cxshx\" (UID: \"6bf09da8-7bbb-4807-b596-d86c24cb50b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.045841 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.045755    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqs6z\" (UniqueName: \"kubernetes.io/projected/6bf09da8-7bbb-4807-b596-d86c24cb50b8-kube-api-access-lqs6z\") pod \"openshift-lws-operator-fd8ccff4c-cxshx\" (UID: \"6bf09da8-7bbb-4807-b596-d86c24cb50b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.146120 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.146093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bf09da8-7bbb-4807-b596-d86c24cb50b8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cxshx\" (UID: \"6bf09da8-7bbb-4807-b596-d86c24cb50b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.146260 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.146143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqs6z\" (UniqueName: \"kubernetes.io/projected/6bf09da8-7bbb-4807-b596-d86c24cb50b8-kube-api-access-lqs6z\") pod \"openshift-lws-operator-fd8ccff4c-cxshx\" (UID: \"6bf09da8-7bbb-4807-b596-d86c24cb50b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.146481 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.146463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bf09da8-7bbb-4807-b596-d86c24cb50b8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cxshx\" (UID: \"6bf09da8-7bbb-4807-b596-d86c24cb50b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.157476 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.157455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqs6z\" (UniqueName: \"kubernetes.io/projected/6bf09da8-7bbb-4807-b596-d86c24cb50b8-kube-api-access-lqs6z\") pod \"openshift-lws-operator-fd8ccff4c-cxshx\" (UID: \"6bf09da8-7bbb-4807-b596-d86c24cb50b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.289783 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.289702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"
Jul 29 19:19:14.412063 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.412036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx"]
Jul 29 19:19:14.415383 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:19:14.415362    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf09da8_7bbb_4807_b596_d86c24cb50b8.slice/crio-64b1a7f447f7b9f7680588d7a9b940a59b931d513f32cd705c37aa393efe5f2b WatchSource:0}: Error finding container 64b1a7f447f7b9f7680588d7a9b940a59b931d513f32cd705c37aa393efe5f2b: Status 404 returned error can't find the container with id 64b1a7f447f7b9f7680588d7a9b940a59b931d513f32cd705c37aa393efe5f2b
Jul 29 19:19:14.794489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:14.794456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx" event={"ID":"6bf09da8-7bbb-4807-b596-d86c24cb50b8","Type":"ContainerStarted","Data":"64b1a7f447f7b9f7680588d7a9b940a59b931d513f32cd705c37aa393efe5f2b"}
Jul 29 19:19:17.812214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:17.812166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx" event={"ID":"6bf09da8-7bbb-4807-b596-d86c24cb50b8","Type":"ContainerStarted","Data":"477e048b14bbc57114c7aee26afeca8dc7071c0ac9c3d56311b729102381af2e"}
Jul 29 19:19:17.831156 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:17.831100    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxshx" podStartSLOduration=2.458683056 podStartE2EDuration="4.831081508s" totalImagesPullingTime="2.372398452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:17.830503591 +0000 UTC m=+251.747453179" watchObservedRunningTime="2026-07-29 19:19:17.831081508 +0000 UTC m=+251.748031097"
Jul 29 19:19:32.807667 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.807590    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"]
Jul 29 19:19:32.813915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.813888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:32.816547 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.816527    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 19:19:32.817169 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.817152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zc5z7\""
Jul 29 19:19:32.817255 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.817191    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 19:19:32.817255 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.817160    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 19:19:32.830164 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.830086    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"]
Jul 29 19:19:32.912262 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.912220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e275497e-70ef-40ff-966b-c3ca8a6252b3-manager-config\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:32.912262 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.912271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e275497e-70ef-40ff-966b-c3ca8a6252b3-metrics-cert\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:32.912481 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.912304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbrvz\" (UniqueName: \"kubernetes.io/projected/e275497e-70ef-40ff-966b-c3ca8a6252b3-kube-api-access-mbrvz\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:32.912481 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:32.912358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e275497e-70ef-40ff-966b-c3ca8a6252b3-cert\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.012745 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.012709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e275497e-70ef-40ff-966b-c3ca8a6252b3-metrics-cert\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.012944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.012755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbrvz\" (UniqueName: \"kubernetes.io/projected/e275497e-70ef-40ff-966b-c3ca8a6252b3-kube-api-access-mbrvz\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.012944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.012806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e275497e-70ef-40ff-966b-c3ca8a6252b3-cert\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.012944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.012828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e275497e-70ef-40ff-966b-c3ca8a6252b3-manager-config\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.013585 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.013567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e275497e-70ef-40ff-966b-c3ca8a6252b3-manager-config\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.015188 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.015169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e275497e-70ef-40ff-966b-c3ca8a6252b3-cert\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.015250 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.015219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e275497e-70ef-40ff-966b-c3ca8a6252b3-metrics-cert\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.030746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.030716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbrvz\" (UniqueName: \"kubernetes.io/projected/e275497e-70ef-40ff-966b-c3ca8a6252b3-kube-api-access-mbrvz\") pod \"lws-controller-manager-66ff6dc8fc-7jqqq\" (UID: \"e275497e-70ef-40ff-966b-c3ca8a6252b3\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.123163 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.123134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:33.260151 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.260127    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"]
Jul 29 19:19:33.262870 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:19:33.262840    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode275497e_70ef_40ff_966b_c3ca8a6252b3.slice/crio-7be563d418eaa8f157aecd1a80f27139d95ade4bbc0b1c9e155124074453fbc5 WatchSource:0}: Error finding container 7be563d418eaa8f157aecd1a80f27139d95ade4bbc0b1c9e155124074453fbc5: Status 404 returned error can't find the container with id 7be563d418eaa8f157aecd1a80f27139d95ade4bbc0b1c9e155124074453fbc5
Jul 29 19:19:33.874037 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:33.873980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq" event={"ID":"e275497e-70ef-40ff-966b-c3ca8a6252b3","Type":"ContainerStarted","Data":"7be563d418eaa8f157aecd1a80f27139d95ade4bbc0b1c9e155124074453fbc5"}
Jul 29 19:19:36.757977 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.757942    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"]
Jul 29 19:19:36.777835 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.777802    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.785857 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.785832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 19:19:36.785999 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.785918    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 19:19:36.785999 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.785964    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 19:19:36.786620 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.786606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-crltb\""
Jul 29 19:19:36.786852 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.786839    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 19:19:36.799396 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.799371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"]
Jul 29 19:19:36.849057 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.849008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c713c056-6503-4f16-b970-20c0029e03eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.849190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.849068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c713c056-6503-4f16-b970-20c0029e03eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.849190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.849100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c713c056-6503-4f16-b970-20c0029e03eb-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.849190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.849117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59kzq\" (UniqueName: \"kubernetes.io/projected/c713c056-6503-4f16-b970-20c0029e03eb-kube-api-access-59kzq\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.849190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.849140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c713c056-6503-4f16-b970-20c0029e03eb-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.888459 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.888430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq" event={"ID":"e275497e-70ef-40ff-966b-c3ca8a6252b3","Type":"ContainerStarted","Data":"a0d8a0973e423ad1ae2f5c6d7a083abdf2095e77b5096e2abfec621790ca1574"}
Jul 29 19:19:36.888582 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.888543    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:36.921493 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.921443    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq" podStartSLOduration=2.034604298 podStartE2EDuration="4.921425766s" totalImagesPullingTime="2.886821468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:36.920309808 +0000 UTC m=+270.837259418" watchObservedRunningTime="2026-07-29 19:19:36.921425766 +0000 UTC m=+270.838375358"
Jul 29 19:19:36.949701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.949672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c713c056-6503-4f16-b970-20c0029e03eb-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.949816 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.949708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59kzq\" (UniqueName: \"kubernetes.io/projected/c713c056-6503-4f16-b970-20c0029e03eb-kube-api-access-59kzq\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.949816 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.949733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c713c056-6503-4f16-b970-20c0029e03eb-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.949911 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.949843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c713c056-6503-4f16-b970-20c0029e03eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.950054 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.950008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c713c056-6503-4f16-b970-20c0029e03eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.950263 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.950240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c713c056-6503-4f16-b970-20c0029e03eb-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.952163 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.952146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c713c056-6503-4f16-b970-20c0029e03eb-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.952318 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.952302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c713c056-6503-4f16-b970-20c0029e03eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.952361 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.952331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c713c056-6503-4f16-b970-20c0029e03eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:36.960705 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:36.960685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59kzq\" (UniqueName: \"kubernetes.io/projected/c713c056-6503-4f16-b970-20c0029e03eb-kube-api-access-59kzq\") pod \"opendatahub-operator-controller-manager-6f775ff5c-xv5fl\" (UID: \"c713c056-6503-4f16-b970-20c0029e03eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:37.088575 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:37.088550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:37.247856 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:37.247808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"]
Jul 29 19:19:37.252084 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:19:37.252060    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc713c056_6503_4f16_b970_20c0029e03eb.slice/crio-1c788e964d5b07c9e3a1b8947b8572374ba184fd622f6d6aa699e17e93fb0edd WatchSource:0}: Error finding container 1c788e964d5b07c9e3a1b8947b8572374ba184fd622f6d6aa699e17e93fb0edd: Status 404 returned error can't find the container with id 1c788e964d5b07c9e3a1b8947b8572374ba184fd622f6d6aa699e17e93fb0edd
Jul 29 19:19:37.894277 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:37.894231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl" event={"ID":"c713c056-6503-4f16-b970-20c0029e03eb","Type":"ContainerStarted","Data":"1c788e964d5b07c9e3a1b8947b8572374ba184fd622f6d6aa699e17e93fb0edd"}
Jul 29 19:19:40.909416 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:40.909380    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl" event={"ID":"c713c056-6503-4f16-b970-20c0029e03eb","Type":"ContainerStarted","Data":"cd49ce218dc232d2185aee6f98b8dfe19b061d026594759327715d02a1a8f838"}
Jul 29 19:19:41.914952 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:41.914916    2576 generic.go:356] "Generic (PLEG): container finished" podID="c713c056-6503-4f16-b970-20c0029e03eb" containerID="cd49ce218dc232d2185aee6f98b8dfe19b061d026594759327715d02a1a8f838" exitCode=0
Jul 29 19:19:41.915343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:41.915002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl" event={"ID":"c713c056-6503-4f16-b970-20c0029e03eb","Type":"ContainerDied","Data":"cd49ce218dc232d2185aee6f98b8dfe19b061d026594759327715d02a1a8f838"}
Jul 29 19:19:42.920861 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:42.920823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl" event={"ID":"c713c056-6503-4f16-b970-20c0029e03eb","Type":"ContainerStarted","Data":"b8469ddf39a2f5d1b771d05140f6feedc0f9cbef6a939d3bf5c9dc6b4eed865d"}
Jul 29 19:19:42.921309 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:42.920888    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:19:42.981896 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:42.981845    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl" podStartSLOduration=2.723637187 podStartE2EDuration="6.9818267s" totalImagesPullingTime="3.266613285s" totalInitContainerRuntime="991.576228ms" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:42.981170385 +0000 UTC m=+276.898119969" watchObservedRunningTime="2026-07-29 19:19:42.9818267 +0000 UTC m=+276.898776289"
Jul 29 19:19:47.896663 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:47.896634    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-7jqqq"
Jul 29 19:19:53.927335 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:19:53.927301    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-xv5fl"
Jul 29 19:20:06.453469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:06.453431    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:20:06.460861 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:06.460834    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 19:20:06.464295 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:06.464274    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:20:08.134677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.134649    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"]
Jul 29 19:20:08.137924 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.137906    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.141867 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.141844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 19:20:08.141995 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.141974    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xrn5j\""
Jul 29 19:20:08.142380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.142363    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 19:20:08.142560 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.142535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 19:20:08.142760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.142742    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 19:20:08.154631 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.154609    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"]
Jul 29 19:20:08.231174 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.231143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcb37299-f419-43ca-ba36-d638195bf871-tmp\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.231319 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.231179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb37299-f419-43ca-ba36-d638195bf871-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.231319 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.231204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56sd\" (UniqueName: \"kubernetes.io/projected/dcb37299-f419-43ca-ba36-d638195bf871-kube-api-access-s56sd\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.332581 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.332540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcb37299-f419-43ca-ba36-d638195bf871-tmp\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.332581 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.332587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb37299-f419-43ca-ba36-d638195bf871-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.332814 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.332611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s56sd\" (UniqueName: \"kubernetes.io/projected/dcb37299-f419-43ca-ba36-d638195bf871-kube-api-access-s56sd\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.334794 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.334772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcb37299-f419-43ca-ba36-d638195bf871-tmp\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.334997 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.334980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcb37299-f419-43ca-ba36-d638195bf871-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.357827 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.357797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56sd\" (UniqueName: \"kubernetes.io/projected/dcb37299-f419-43ca-ba36-d638195bf871-kube-api-access-s56sd\") pod \"kube-auth-proxy-5fb4d8769-zxv9t\" (UID: \"dcb37299-f419-43ca-ba36-d638195bf871\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.448587 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.448509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"
Jul 29 19:20:08.591166 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.591142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t"]
Jul 29 19:20:08.593601 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:20:08.593575    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb37299_f419_43ca_ba36_d638195bf871.slice/crio-68a6231a8303e9c603017d531d7eee2f37fc1e4ab2e2438f557d42f53bba4dbf WatchSource:0}: Error finding container 68a6231a8303e9c603017d531d7eee2f37fc1e4ab2e2438f557d42f53bba4dbf: Status 404 returned error can't find the container with id 68a6231a8303e9c603017d531d7eee2f37fc1e4ab2e2438f557d42f53bba4dbf
Jul 29 19:20:08.595733 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:08.595524    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:20:09.033494 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:09.033466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t" event={"ID":"dcb37299-f419-43ca-ba36-d638195bf871","Type":"ContainerStarted","Data":"68a6231a8303e9c603017d531d7eee2f37fc1e4ab2e2438f557d42f53bba4dbf"}
Jul 29 19:20:12.048124 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:12.048085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t" event={"ID":"dcb37299-f419-43ca-ba36-d638195bf871","Type":"ContainerStarted","Data":"189be5bc57fe9a2daffa10147fdc0d1208e3ff540ee68a6d58936de18aa1783d"}
Jul 29 19:20:12.072105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:20:12.072048    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-zxv9t" podStartSLOduration=1.157378265 podStartE2EDuration="4.072005356s" totalImagesPullingTime="2.914627091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:12.071736966 +0000 UTC m=+305.988686554" watchObservedRunningTime="2026-07-29 19:20:12.072005356 +0000 UTC m=+305.988954945"
Jul 29 19:21:40.975936 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.975898    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"]
Jul 29 19:21:40.979551 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.979527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:40.983298 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.983278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 19:21:40.983519 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.983504    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 19:21:40.983601 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.983534    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hmvqt\""
Jul 29 19:21:40.983601 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.983536    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 19:21:40.998223 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:40.998203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"]
Jul 29 19:21:41.039016 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:41.038987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspkc\" (UniqueName: \"kubernetes.io/projected/f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb-kube-api-access-fspkc\") pod \"dns-operator-controller-manager-864dd78c4c-cgxrw\" (UID: \"f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:41.140509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:41.140478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspkc\" (UniqueName: \"kubernetes.io/projected/f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb-kube-api-access-fspkc\") pod \"dns-operator-controller-manager-864dd78c4c-cgxrw\" (UID: \"f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:41.153042 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:41.152996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspkc\" (UniqueName: \"kubernetes.io/projected/f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb-kube-api-access-fspkc\") pod \"dns-operator-controller-manager-864dd78c4c-cgxrw\" (UID: \"f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:41.289342 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:41.289270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:41.443934 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:41.443903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"]
Jul 29 19:21:41.447819 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:21:41.447785    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d0108b_0643_40f0_8c2a_9dc32e7f4fbb.slice/crio-af3dbacd4906d23e50ca301415e010f1c8876878397e19173965066e0772aac9 WatchSource:0}: Error finding container af3dbacd4906d23e50ca301415e010f1c8876878397e19173965066e0772aac9: Status 404 returned error can't find the container with id af3dbacd4906d23e50ca301415e010f1c8876878397e19173965066e0772aac9
Jul 29 19:21:42.424267 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:42.424228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw" event={"ID":"f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb","Type":"ContainerStarted","Data":"af3dbacd4906d23e50ca301415e010f1c8876878397e19173965066e0772aac9"}
Jul 29 19:21:44.435720 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.435683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw" event={"ID":"f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb","Type":"ContainerStarted","Data":"aaa8f8cbe1ffb8b30762ae33f1a40ebf351a938492c2e47ced825cddc36caf00"}
Jul 29 19:21:44.436121 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.435828    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:44.462885 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.462837    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw" podStartSLOduration=1.672016523 podStartE2EDuration="4.46282238s" totalImagesPullingTime="2.790805857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:44.461624916 +0000 UTC m=+398.378574526" watchObservedRunningTime="2026-07-29 19:21:44.46282238 +0000 UTC m=+398.379771968"
Jul 29 19:21:44.758460 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.758431    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"]
Jul 29 19:21:44.761915 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.761890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:21:44.765411 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.765390    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dgqsm\""
Jul 29 19:21:44.782626 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.782601    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"]
Jul 29 19:21:44.876099 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.876066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szxwg\" (UniqueName: \"kubernetes.io/projected/549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3-kube-api-access-szxwg\") pod \"authorino-operator-75cc8d5cb7-r6bmv\" (UID: \"549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:21:44.977432 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.977403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szxwg\" (UniqueName: \"kubernetes.io/projected/549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3-kube-api-access-szxwg\") pod \"authorino-operator-75cc8d5cb7-r6bmv\" (UID: \"549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:21:44.991130 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:44.991103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szxwg\" (UniqueName: \"kubernetes.io/projected/549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3-kube-api-access-szxwg\") pod \"authorino-operator-75cc8d5cb7-r6bmv\" (UID: \"549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:21:45.071694 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:45.071667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:21:45.201209 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:45.201186    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"]
Jul 29 19:21:45.203510 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:21:45.203481    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549fc7c9_d20b_4ee4_902e_2cc4b0bf39c3.slice/crio-9449054a7d7711e630f25b009d9cb7567f8df8e3cf1fa464c803fa0de1dab404 WatchSource:0}: Error finding container 9449054a7d7711e630f25b009d9cb7567f8df8e3cf1fa464c803fa0de1dab404: Status 404 returned error can't find the container with id 9449054a7d7711e630f25b009d9cb7567f8df8e3cf1fa464c803fa0de1dab404
Jul 29 19:21:45.440747 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:45.440666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv" event={"ID":"549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3","Type":"ContainerStarted","Data":"9449054a7d7711e630f25b009d9cb7567f8df8e3cf1fa464c803fa0de1dab404"}
Jul 29 19:21:47.490684 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.490621    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"]
Jul 29 19:21:47.495347 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.495324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.500319 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.500302    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 19:21:47.500550 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.500535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2wfx7\""
Jul 29 19:21:47.502889 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.502868    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 19:21:47.514440 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.514411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"]
Jul 29 19:21:47.599581 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.599542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/182de768-f1a0-45c7-ae39-d1175249c924-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.599751 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.599606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/182de768-f1a0-45c7-ae39-d1175249c924-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.599751 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.599660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwwl\" (UniqueName: \"kubernetes.io/projected/182de768-f1a0-45c7-ae39-d1175249c924-kube-api-access-9zwwl\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.700380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.700295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/182de768-f1a0-45c7-ae39-d1175249c924-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.700380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.700342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/182de768-f1a0-45c7-ae39-d1175249c924-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.700566 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.700382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwwl\" (UniqueName: \"kubernetes.io/projected/182de768-f1a0-45c7-ae39-d1175249c924-kube-api-access-9zwwl\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.701145 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.701122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/182de768-f1a0-45c7-ae39-d1175249c924-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.702863 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.702836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/182de768-f1a0-45c7-ae39-d1175249c924-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.727601 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.727563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwwl\" (UniqueName: \"kubernetes.io/projected/182de768-f1a0-45c7-ae39-d1175249c924-kube-api-access-9zwwl\") pod \"kuadrant-console-plugin-66b5774985-b2bx7\" (UID: \"182de768-f1a0-45c7-ae39-d1175249c924\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.803864 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.803830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"
Jul 29 19:21:47.954263 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:47.954188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7"]
Jul 29 19:21:47.957392 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:21:47.957367    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod182de768_f1a0_45c7_ae39_d1175249c924.slice/crio-0ccfbf43a2cef2f6353d1921feeb774af8f337c64fb2aab0c70324e403b4a3d4 WatchSource:0}: Error finding container 0ccfbf43a2cef2f6353d1921feeb774af8f337c64fb2aab0c70324e403b4a3d4: Status 404 returned error can't find the container with id 0ccfbf43a2cef2f6353d1921feeb774af8f337c64fb2aab0c70324e403b4a3d4
Jul 29 19:21:48.457708 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:48.457665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv" event={"ID":"549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3","Type":"ContainerStarted","Data":"93882e453440730e9a3ebef0d8ddc611b5727a973147c1c97522e2ab7e11eada"}
Jul 29 19:21:48.457880 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:48.457787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:21:48.458850 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:48.458828    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7" event={"ID":"182de768-f1a0-45c7-ae39-d1175249c924","Type":"ContainerStarted","Data":"0ccfbf43a2cef2f6353d1921feeb774af8f337c64fb2aab0c70324e403b4a3d4"}
Jul 29 19:21:48.490143 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:48.490089    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv" podStartSLOduration=2.254222737 podStartE2EDuration="4.490071483s" totalImagesPullingTime="2.235848746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:48.48672191 +0000 UTC m=+402.403671499" watchObservedRunningTime="2026-07-29 19:21:48.490071483 +0000 UTC m=+402.407021147"
Jul 29 19:21:55.443408 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:55.443376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgxrw"
Jul 29 19:21:59.466940 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:21:59.466910    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r6bmv"
Jul 29 19:22:10.571036 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:10.570990    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7" event={"ID":"182de768-f1a0-45c7-ae39-d1175249c924","Type":"ContainerStarted","Data":"6f67b6be985bda4d66cfeb8749cd30ee11bf8af64fc69cf54c99f4fd26956fec"}
Jul 29 19:22:10.604199 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:10.604149    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b2bx7" podStartSLOduration=1.5847295639999999 podStartE2EDuration="23.604132416s" totalImagesPullingTime="22.019402852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:10.602572676 +0000 UTC m=+424.519522264" watchObservedRunningTime="2026-07-29 19:22:10.604132416 +0000 UTC m=+424.521082003"
Jul 29 19:22:29.833298 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:29.833222    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqkbk"]
Jul 29 19:22:29.836325 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:29.836309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:22:29.838765 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:29.838745    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4tl97\""
Jul 29 19:22:29.848352 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:29.848330    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqkbk"]
Jul 29 19:22:29.985448 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:29.985416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc9hj\" (UniqueName: \"kubernetes.io/projected/831a2989-2a99-48a2-a719-5c5ae70bbad5-kube-api-access-bc9hj\") pod \"authorino-75d556bd77-wqkbk\" (UID: \"831a2989-2a99-48a2-a719-5c5ae70bbad5\") " pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:22:30.086474 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:30.086388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc9hj\" (UniqueName: \"kubernetes.io/projected/831a2989-2a99-48a2-a719-5c5ae70bbad5-kube-api-access-bc9hj\") pod \"authorino-75d556bd77-wqkbk\" (UID: \"831a2989-2a99-48a2-a719-5c5ae70bbad5\") " pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:22:30.095444 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:30.095416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc9hj\" (UniqueName: \"kubernetes.io/projected/831a2989-2a99-48a2-a719-5c5ae70bbad5-kube-api-access-bc9hj\") pod \"authorino-75d556bd77-wqkbk\" (UID: \"831a2989-2a99-48a2-a719-5c5ae70bbad5\") " pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:22:30.145073 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:30.145010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:22:30.272009 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:30.271983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqkbk"]
Jul 29 19:22:30.274601 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:22:30.274574    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod831a2989_2a99_48a2_a719_5c5ae70bbad5.slice/crio-144883426e581b0d09ccfa3ff4a811ff645f50b5876701005a86192d990494f0 WatchSource:0}: Error finding container 144883426e581b0d09ccfa3ff4a811ff645f50b5876701005a86192d990494f0: Status 404 returned error can't find the container with id 144883426e581b0d09ccfa3ff4a811ff645f50b5876701005a86192d990494f0
Jul 29 19:22:30.663937 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:30.663902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqkbk" event={"ID":"831a2989-2a99-48a2-a719-5c5ae70bbad5","Type":"ContainerStarted","Data":"144883426e581b0d09ccfa3ff4a811ff645f50b5876701005a86192d990494f0"}
Jul 29 19:22:33.679285 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:33.679249    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqkbk" event={"ID":"831a2989-2a99-48a2-a719-5c5ae70bbad5","Type":"ContainerStarted","Data":"315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c"}
Jul 29 19:22:33.715917 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:22:33.715868    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wqkbk" podStartSLOduration=1.893748376 podStartE2EDuration="4.715849411s" totalImagesPullingTime="2.822101035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:33.712486906 +0000 UTC m=+447.629436493" watchObservedRunningTime="2026-07-29 19:22:33.715849411 +0000 UTC m=+447.632798999"
Jul 29 19:23:04.248381 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.248347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-whdj7"]
Jul 29 19:23:04.252974 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.252948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:04.260154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.260131    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-whdj7"]
Jul 29 19:23:04.287339 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.287293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8k6v\" (UniqueName: \"kubernetes.io/projected/8d071568-a4c7-434c-88c5-b5df6b550a05-kube-api-access-j8k6v\") pod \"authorino-5d4b67c446-whdj7\" (UID: \"8d071568-a4c7-434c-88c5-b5df6b550a05\") " pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:04.387971 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.387926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8k6v\" (UniqueName: \"kubernetes.io/projected/8d071568-a4c7-434c-88c5-b5df6b550a05-kube-api-access-j8k6v\") pod \"authorino-5d4b67c446-whdj7\" (UID: \"8d071568-a4c7-434c-88c5-b5df6b550a05\") " pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:04.396462 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.396435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8k6v\" (UniqueName: \"kubernetes.io/projected/8d071568-a4c7-434c-88c5-b5df6b550a05-kube-api-access-j8k6v\") pod \"authorino-5d4b67c446-whdj7\" (UID: \"8d071568-a4c7-434c-88c5-b5df6b550a05\") " pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:04.472060 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.472007    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-whdj7"]
Jul 29 19:23:04.472394 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.472375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:04.607253 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.607109    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-whdj7"]
Jul 29 19:23:04.610068 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:23:04.610041    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d071568_a4c7_434c_88c5_b5df6b550a05.slice/crio-cee7ed7f2203c856706afdf95638041278daaa280085b575343b302b1a28c378 WatchSource:0}: Error finding container cee7ed7f2203c856706afdf95638041278daaa280085b575343b302b1a28c378: Status 404 returned error can't find the container with id cee7ed7f2203c856706afdf95638041278daaa280085b575343b302b1a28c378
Jul 29 19:23:04.647467 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.647431    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f9f54df6-rtmkf"]
Jul 29 19:23:04.650225 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.650206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.652419 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.652404    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 19:23:04.659920 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.659899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f9f54df6-rtmkf"]
Jul 29 19:23:04.691221 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.691187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-tls-cert\") pod \"authorino-5f9f54df6-rtmkf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") " pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.691366 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.691291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjtlq\" (UniqueName: \"kubernetes.io/projected/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-kube-api-access-jjtlq\") pod \"authorino-5f9f54df6-rtmkf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") " pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.792732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.792646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-tls-cert\") pod \"authorino-5f9f54df6-rtmkf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") " pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.792880 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.792757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjtlq\" (UniqueName: \"kubernetes.io/projected/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-kube-api-access-jjtlq\") pod \"authorino-5f9f54df6-rtmkf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") " pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.795112 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.795086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-tls-cert\") pod \"authorino-5f9f54df6-rtmkf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") " pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.803074 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.803052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjtlq\" (UniqueName: \"kubernetes.io/projected/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-kube-api-access-jjtlq\") pod \"authorino-5f9f54df6-rtmkf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") " pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:04.815698 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.815673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-whdj7" event={"ID":"8d071568-a4c7-434c-88c5-b5df6b550a05","Type":"ContainerStarted","Data":"cee7ed7f2203c856706afdf95638041278daaa280085b575343b302b1a28c378"}
Jul 29 19:23:04.959904 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:04.959883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:23:05.109498 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.109461    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f9f54df6-rtmkf"]
Jul 29 19:23:05.112793 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:23:05.112767    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc605668b_1cc8_42d3_82b6_4b3a3df3edbf.slice/crio-d36037553ce89e6da70adc6ca688443636532f1d5eaff68746e2cfce2b6a7721 WatchSource:0}: Error finding container d36037553ce89e6da70adc6ca688443636532f1d5eaff68746e2cfce2b6a7721: Status 404 returned error can't find the container with id d36037553ce89e6da70adc6ca688443636532f1d5eaff68746e2cfce2b6a7721
Jul 29 19:23:05.821602 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.821565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-whdj7" event={"ID":"8d071568-a4c7-434c-88c5-b5df6b550a05","Type":"ContainerStarted","Data":"76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410"}
Jul 29 19:23:05.821602 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.821586    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-whdj7" podUID="8d071568-a4c7-434c-88c5-b5df6b550a05" containerName="authorino" containerID="cri-o://76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410" gracePeriod=30
Jul 29 19:23:05.823222 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.823197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f9f54df6-rtmkf" event={"ID":"c605668b-1cc8-42d3-82b6-4b3a3df3edbf","Type":"ContainerStarted","Data":"9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c"}
Jul 29 19:23:05.823363 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.823232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f9f54df6-rtmkf" event={"ID":"c605668b-1cc8-42d3-82b6-4b3a3df3edbf","Type":"ContainerStarted","Data":"d36037553ce89e6da70adc6ca688443636532f1d5eaff68746e2cfce2b6a7721"}
Jul 29 19:23:05.837387 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.837306    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-whdj7" podStartSLOduration=1.534832204 podStartE2EDuration="1.837285962s" totalImagesPullingTime="302.453758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:05.83728228 +0000 UTC m=+479.754231868" watchObservedRunningTime="2026-07-29 19:23:05.837285962 +0000 UTC m=+479.754235551"
Jul 29 19:23:05.858318 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.858255    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f9f54df6-rtmkf" podStartSLOduration=1.483321307 podStartE2EDuration="1.858237358s" totalImagesPullingTime="374.916051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:05.858076045 +0000 UTC m=+479.775025633" watchObservedRunningTime="2026-07-29 19:23:05.858237358 +0000 UTC m=+479.775186945"
Jul 29 19:23:05.900017 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.899979    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqkbk"]
Jul 29 19:23:05.900241 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:05.900215    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wqkbk" podUID="831a2989-2a99-48a2-a719-5c5ae70bbad5" containerName="authorino" containerID="cri-o://315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c" gracePeriod=30
Jul 29 19:23:06.145914 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.145888    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:06.153070 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.153042    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:23:06.204474 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.204439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8k6v\" (UniqueName: \"kubernetes.io/projected/8d071568-a4c7-434c-88c5-b5df6b550a05-kube-api-access-j8k6v\") pod \"8d071568-a4c7-434c-88c5-b5df6b550a05\" (UID: \"8d071568-a4c7-434c-88c5-b5df6b550a05\") "
Jul 29 19:23:06.204646 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.204537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc9hj\" (UniqueName: \"kubernetes.io/projected/831a2989-2a99-48a2-a719-5c5ae70bbad5-kube-api-access-bc9hj\") pod \"831a2989-2a99-48a2-a719-5c5ae70bbad5\" (UID: \"831a2989-2a99-48a2-a719-5c5ae70bbad5\") "
Jul 29 19:23:06.206618 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.206589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d071568-a4c7-434c-88c5-b5df6b550a05-kube-api-access-j8k6v" (OuterVolumeSpecName: "kube-api-access-j8k6v") pod "8d071568-a4c7-434c-88c5-b5df6b550a05" (UID: "8d071568-a4c7-434c-88c5-b5df6b550a05"). InnerVolumeSpecName "kube-api-access-j8k6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:23:06.206725 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.206619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831a2989-2a99-48a2-a719-5c5ae70bbad5-kube-api-access-bc9hj" (OuterVolumeSpecName: "kube-api-access-bc9hj") pod "831a2989-2a99-48a2-a719-5c5ae70bbad5" (UID: "831a2989-2a99-48a2-a719-5c5ae70bbad5"). InnerVolumeSpecName "kube-api-access-bc9hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:23:06.305910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.305866    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc9hj\" (UniqueName: \"kubernetes.io/projected/831a2989-2a99-48a2-a719-5c5ae70bbad5-kube-api-access-bc9hj\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:23:06.305910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.305901    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8k6v\" (UniqueName: \"kubernetes.io/projected/8d071568-a4c7-434c-88c5-b5df6b550a05-kube-api-access-j8k6v\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:23:06.828807 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.828766    2576 generic.go:356] "Generic (PLEG): container finished" podID="831a2989-2a99-48a2-a719-5c5ae70bbad5" containerID="315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c" exitCode=0
Jul 29 19:23:06.829297 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.828829    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqkbk"
Jul 29 19:23:06.829297 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.828857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqkbk" event={"ID":"831a2989-2a99-48a2-a719-5c5ae70bbad5","Type":"ContainerDied","Data":"315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c"}
Jul 29 19:23:06.829297 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.828910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqkbk" event={"ID":"831a2989-2a99-48a2-a719-5c5ae70bbad5","Type":"ContainerDied","Data":"144883426e581b0d09ccfa3ff4a811ff645f50b5876701005a86192d990494f0"}
Jul 29 19:23:06.829297 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.828935    2576 scope.go:117] "RemoveContainer" containerID="315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c"
Jul 29 19:23:06.830224 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.830163    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d071568-a4c7-434c-88c5-b5df6b550a05" containerID="76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410" exitCode=0
Jul 29 19:23:06.830224 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.830196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-whdj7" event={"ID":"8d071568-a4c7-434c-88c5-b5df6b550a05","Type":"ContainerDied","Data":"76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410"}
Jul 29 19:23:06.830351 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.830239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-whdj7" event={"ID":"8d071568-a4c7-434c-88c5-b5df6b550a05","Type":"ContainerDied","Data":"cee7ed7f2203c856706afdf95638041278daaa280085b575343b302b1a28c378"}
Jul 29 19:23:06.830351 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.830238    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-whdj7"
Jul 29 19:23:06.837283 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.837266    2576 scope.go:117] "RemoveContainer" containerID="315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c"
Jul 29 19:23:06.837567 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:23:06.837547    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c\": container with ID starting with 315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c not found: ID does not exist" containerID="315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c"
Jul 29 19:23:06.837613 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.837576    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c"} err="failed to get container status \"315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c\": rpc error: code = NotFound desc = could not find container \"315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c\": container with ID starting with 315eada8a9eace7159e18e06da687a25920a5a6f0e4d5ae643c1b3bd0a59359c not found: ID does not exist"
Jul 29 19:23:06.837613 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.837593    2576 scope.go:117] "RemoveContainer" containerID="76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410"
Jul 29 19:23:06.844936 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.844919    2576 scope.go:117] "RemoveContainer" containerID="76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410"
Jul 29 19:23:06.845250 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:23:06.845225    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410\": container with ID starting with 76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410 not found: ID does not exist" containerID="76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410"
Jul 29 19:23:06.845324 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.845261    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410"} err="failed to get container status \"76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410\": rpc error: code = NotFound desc = could not find container \"76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410\": container with ID starting with 76ee91b9cdf5bebedf0c1bbd1d780ccf902726e806df2cf1ca7fdbecbf6d9410 not found: ID does not exist"
Jul 29 19:23:06.867095 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.867065    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqkbk"]
Jul 29 19:23:06.874676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.874651    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqkbk"]
Jul 29 19:23:06.898781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.898749    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-whdj7"]
Jul 29 19:23:06.908167 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:06.908141    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-whdj7"]
Jul 29 19:23:08.672828 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:08.672796    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="831a2989-2a99-48a2-a719-5c5ae70bbad5" path="/var/lib/kubelet/pods/831a2989-2a99-48a2-a719-5c5ae70bbad5/volumes"
Jul 29 19:23:08.673314 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:23:08.673148    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d071568-a4c7-434c-88c5-b5df6b550a05" path="/var/lib/kubelet/pods/8d071568-a4c7-434c-88c5-b5df6b550a05/volumes"
Jul 29 19:24:29.937767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.937722    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"]
Jul 29 19:24:29.938240 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.938182    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d071568-a4c7-434c-88c5-b5df6b550a05" containerName="authorino"
Jul 29 19:24:29.938240 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.938197    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d071568-a4c7-434c-88c5-b5df6b550a05" containerName="authorino"
Jul 29 19:24:29.938240 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.938212    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831a2989-2a99-48a2-a719-5c5ae70bbad5" containerName="authorino"
Jul 29 19:24:29.938240 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.938218    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="831a2989-2a99-48a2-a719-5c5ae70bbad5" containerName="authorino"
Jul 29 19:24:29.938368 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.938269    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d071568-a4c7-434c-88c5-b5df6b550a05" containerName="authorino"
Jul 29 19:24:29.938368 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.938280    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="831a2989-2a99-48a2-a719-5c5ae70bbad5" containerName="authorino"
Jul 29 19:24:29.941266 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.941245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:29.944646 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.944621    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pm4b4\""
Jul 29 19:24:29.944772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.944647    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 19:24:29.944772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.944628    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 19:24:29.945571 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.945555    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 19:24:29.952839 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.952815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"]
Jul 29 19:24:29.957451 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.957428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:29.957555 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.957465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6b126c1-5612-482a-ba3d-59646bb4d78e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:29.957555 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.957490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7hqt\" (UniqueName: \"kubernetes.io/projected/e6b126c1-5612-482a-ba3d-59646bb4d78e-kube-api-access-m7hqt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:29.957555 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.957526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:29.957680 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.957561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:29.957680 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:29.957603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058298 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6b126c1-5612-482a-ba3d-59646bb4d78e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7hqt\" (UniqueName: \"kubernetes.io/projected/e6b126c1-5612-482a-ba3d-59646bb4d78e-kube-api-access-m7hqt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058489 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058763 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058763 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.058859 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.058801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.060722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.060697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6b126c1-5612-482a-ba3d-59646bb4d78e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.060897 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.060879    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6b126c1-5612-482a-ba3d-59646bb4d78e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.067203 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.067181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7hqt\" (UniqueName: \"kubernetes.io/projected/e6b126c1-5612-482a-ba3d-59646bb4d78e-kube-api-access-m7hqt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdjjf\" (UID: \"e6b126c1-5612-482a-ba3d-59646bb4d78e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.252005 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.251918    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:30.396640 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:30.396605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"]
Jul 29 19:24:30.399836 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:24:30.399803    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b126c1_5612_482a_ba3d_59646bb4d78e.slice/crio-678411906b5dd1a91b18991e280cd060f3d2890e17b8321b972ac509afbf954a WatchSource:0}: Error finding container 678411906b5dd1a91b18991e280cd060f3d2890e17b8321b972ac509afbf954a: Status 404 returned error can't find the container with id 678411906b5dd1a91b18991e280cd060f3d2890e17b8321b972ac509afbf954a
Jul 29 19:24:31.218187 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:31.218141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf" event={"ID":"e6b126c1-5612-482a-ba3d-59646bb4d78e","Type":"ContainerStarted","Data":"678411906b5dd1a91b18991e280cd060f3d2890e17b8321b972ac509afbf954a"}
Jul 29 19:24:32.224654 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:32.224619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf" event={"ID":"e6b126c1-5612-482a-ba3d-59646bb4d78e","Type":"ContainerStarted","Data":"b6f497a0ef6f2e7f2c10d9adf94424a04962024df21bc76f35d71812f9bc0085"}
Jul 29 19:24:32.246125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:32.246070    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf" podStartSLOduration=2.149268113 podStartE2EDuration="3.246053728s" totalImagesPullingTime="1.096785615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:32.243852134 +0000 UTC m=+566.160801732" watchObservedRunningTime="2026-07-29 19:24:32.246053728 +0000 UTC m=+566.163003317"
Jul 29 19:24:40.252280 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:40.252235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:40.252867 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:40.252347    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:40.265098 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:40.265070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:40.276619 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:40.276593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdjjf"
Jul 29 19:24:42.825879 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.825841    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"]
Jul 29 19:24:42.829516 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.829491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.832016 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.831992    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 19:24:42.840785 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.840760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"]
Jul 29 19:24:42.878305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.878267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.878478 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.878318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.878478 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.878404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.878478 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.878437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdxf\" (UniqueName: \"kubernetes.io/projected/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-kube-api-access-fzdxf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.878478 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.878463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.878612 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.878536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979013 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.978973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979220 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979220 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979307 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979307 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979382 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdxf\" (UniqueName: \"kubernetes.io/projected/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-kube-api-access-fzdxf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979515 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.979652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.979622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.981291 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.981268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.981552 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.981532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:42.988188 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:42.988167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdxf\" (UniqueName: \"kubernetes.io/projected/c1a9a6f1-f101-46f6-80ce-f1405baa08cf-kube-api-access-fzdxf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bf8bg\" (UID: \"c1a9a6f1-f101-46f6-80ce-f1405baa08cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:43.140843 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:43.140750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:43.279772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:43.279746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"]
Jul 29 19:24:43.281096 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:24:43.281070    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a9a6f1_f101_46f6_80ce_f1405baa08cf.slice/crio-75c15276c57856f1f7d05e163aa61909e0eefe48c9fa563c0cc6e40cd77be26d WatchSource:0}: Error finding container 75c15276c57856f1f7d05e163aa61909e0eefe48c9fa563c0cc6e40cd77be26d: Status 404 returned error can't find the container with id 75c15276c57856f1f7d05e163aa61909e0eefe48c9fa563c0cc6e40cd77be26d
Jul 29 19:24:44.280487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:44.280454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg" event={"ID":"c1a9a6f1-f101-46f6-80ce-f1405baa08cf","Type":"ContainerStarted","Data":"232dc6b31f677fdb543d83507582a969ec287f57f3dded4994c351ae656fbfe9"}
Jul 29 19:24:44.280872 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:44.280509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg" event={"ID":"c1a9a6f1-f101-46f6-80ce-f1405baa08cf","Type":"ContainerStarted","Data":"75c15276c57856f1f7d05e163aa61909e0eefe48c9fa563c0cc6e40cd77be26d"}
Jul 29 19:24:44.306366 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:44.306313    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg" podStartSLOduration=2.100398399 podStartE2EDuration="2.306295636s" totalImagesPullingTime="205.897237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:44.303059722 +0000 UTC m=+578.220009309" watchObservedRunningTime="2026-07-29 19:24:44.306295636 +0000 UTC m=+578.223245235"
Jul 29 19:24:53.141343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:53.141295    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:53.141883 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:53.141379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:53.158804 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:53.158771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:24:53.344107 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:24:53.344077    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bf8bg"
Jul 29 19:25:06.482923 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:25:06.482890    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:25:06.490537 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:25:06.490517    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:26:12.173566 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.173529    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77749db965-fj6rp"]
Jul 29 19:26:12.176759 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.176742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.185723 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.185698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77749db965-fj6rp"]
Jul 29 19:26:12.292871 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.292830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppsll\" (UniqueName: \"kubernetes.io/projected/6f020335-16b5-490d-a733-ed49bd82cbf1-kube-api-access-ppsll\") pod \"authorino-77749db965-fj6rp\" (UID: \"6f020335-16b5-490d-a733-ed49bd82cbf1\") " pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.293097 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.292891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f020335-16b5-490d-a733-ed49bd82cbf1-tls-cert\") pod \"authorino-77749db965-fj6rp\" (UID: \"6f020335-16b5-490d-a733-ed49bd82cbf1\") " pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.393545 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.393503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppsll\" (UniqueName: \"kubernetes.io/projected/6f020335-16b5-490d-a733-ed49bd82cbf1-kube-api-access-ppsll\") pod \"authorino-77749db965-fj6rp\" (UID: \"6f020335-16b5-490d-a733-ed49bd82cbf1\") " pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.393731 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.393572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f020335-16b5-490d-a733-ed49bd82cbf1-tls-cert\") pod \"authorino-77749db965-fj6rp\" (UID: \"6f020335-16b5-490d-a733-ed49bd82cbf1\") " pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.395910 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.395887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f020335-16b5-490d-a733-ed49bd82cbf1-tls-cert\") pod \"authorino-77749db965-fj6rp\" (UID: \"6f020335-16b5-490d-a733-ed49bd82cbf1\") " pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.401881 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.401860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppsll\" (UniqueName: \"kubernetes.io/projected/6f020335-16b5-490d-a733-ed49bd82cbf1-kube-api-access-ppsll\") pod \"authorino-77749db965-fj6rp\" (UID: \"6f020335-16b5-490d-a733-ed49bd82cbf1\") " pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.486685 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.486622    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77749db965-fj6rp"
Jul 29 19:26:12.631798 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.631765    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77749db965-fj6rp"]
Jul 29 19:26:12.635186 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:26:12.635154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f020335_16b5_490d_a733_ed49bd82cbf1.slice/crio-5b1554245a42b45f090afe682c21bb2f42c8705d991e7c72de6dfdfe04dcb95c WatchSource:0}: Error finding container 5b1554245a42b45f090afe682c21bb2f42c8705d991e7c72de6dfdfe04dcb95c: Status 404 returned error can't find the container with id 5b1554245a42b45f090afe682c21bb2f42c8705d991e7c72de6dfdfe04dcb95c
Jul 29 19:26:12.636434 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.636414    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:26:12.688226 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:12.688194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77749db965-fj6rp" event={"ID":"6f020335-16b5-490d-a733-ed49bd82cbf1","Type":"ContainerStarted","Data":"5b1554245a42b45f090afe682c21bb2f42c8705d991e7c72de6dfdfe04dcb95c"}
Jul 29 19:26:13.694668 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:13.694626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77749db965-fj6rp" event={"ID":"6f020335-16b5-490d-a733-ed49bd82cbf1","Type":"ContainerStarted","Data":"a341a99d17f2c9ee07bd1de3bd4e7430fb83a0ce7d569a4c50d2e44cdf9be900"}
Jul 29 19:26:13.761140 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:13.761073    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77749db965-fj6rp" podStartSLOduration=1.296911659 podStartE2EDuration="1.761042726s" totalImagesPullingTime="464.131067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:13.737607501 +0000 UTC m=+667.654557089" watchObservedRunningTime="2026-07-29 19:26:13.761042726 +0000 UTC m=+667.677992307"
Jul 29 19:26:13.802514 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:13.802479    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f9f54df6-rtmkf"]
Jul 29 19:26:13.802717 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:13.802693    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5f9f54df6-rtmkf" podUID="c605668b-1cc8-42d3-82b6-4b3a3df3edbf" containerName="authorino" containerID="cri-o://9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c" gracePeriod=30
Jul 29 19:26:14.056667 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.056640    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:26:14.211492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.211461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-tls-cert\") pod \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") "
Jul 29 19:26:14.211676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.211539    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjtlq\" (UniqueName: \"kubernetes.io/projected/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-kube-api-access-jjtlq\") pod \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\" (UID: \"c605668b-1cc8-42d3-82b6-4b3a3df3edbf\") "
Jul 29 19:26:14.214184 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.214134    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-kube-api-access-jjtlq" (OuterVolumeSpecName: "kube-api-access-jjtlq") pod "c605668b-1cc8-42d3-82b6-4b3a3df3edbf" (UID: "c605668b-1cc8-42d3-82b6-4b3a3df3edbf"). InnerVolumeSpecName "kube-api-access-jjtlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:26:14.230810 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.230722    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c605668b-1cc8-42d3-82b6-4b3a3df3edbf" (UID: "c605668b-1cc8-42d3-82b6-4b3a3df3edbf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:26:14.312877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.312837    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjtlq\" (UniqueName: \"kubernetes.io/projected/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-kube-api-access-jjtlq\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:26:14.312877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.312872    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c605668b-1cc8-42d3-82b6-4b3a3df3edbf-tls-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:26:14.700831 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.700794    2576 generic.go:356] "Generic (PLEG): container finished" podID="c605668b-1cc8-42d3-82b6-4b3a3df3edbf" containerID="9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c" exitCode=0
Jul 29 19:26:14.700831 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.700831    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f9f54df6-rtmkf"
Jul 29 19:26:14.701289 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.700871    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f9f54df6-rtmkf" event={"ID":"c605668b-1cc8-42d3-82b6-4b3a3df3edbf","Type":"ContainerDied","Data":"9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c"}
Jul 29 19:26:14.701289 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.700918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f9f54df6-rtmkf" event={"ID":"c605668b-1cc8-42d3-82b6-4b3a3df3edbf","Type":"ContainerDied","Data":"d36037553ce89e6da70adc6ca688443636532f1d5eaff68746e2cfce2b6a7721"}
Jul 29 19:26:14.701289 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.700936    2576 scope.go:117] "RemoveContainer" containerID="9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c"
Jul 29 19:26:14.709540 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.709524    2576 scope.go:117] "RemoveContainer" containerID="9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c"
Jul 29 19:26:14.709781 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:26:14.709764    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c\": container with ID starting with 9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c not found: ID does not exist" containerID="9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c"
Jul 29 19:26:14.709851 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.709790    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c"} err="failed to get container status \"9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c\": rpc error: code = NotFound desc = could not find container \"9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c\": container with ID starting with 9032af3944d64bae8597fff715911f97cf638578d191046883710ec840c9537c not found: ID does not exist"
Jul 29 19:26:14.720500 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.720468    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f9f54df6-rtmkf"]
Jul 29 19:26:14.732496 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:14.732466    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f9f54df6-rtmkf"]
Jul 29 19:26:16.672053 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:26:16.672006    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c605668b-1cc8-42d3-82b6-4b3a3df3edbf" path="/var/lib/kubelet/pods/c605668b-1cc8-42d3-82b6-4b3a3df3edbf/volumes"
Jul 29 19:30:06.511189 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:30:06.511115    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:30:06.516785 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:30:06.516762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:35:06.543759 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:35:06.543733    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:35:06.545877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:35:06.545854    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:37:02.958273 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.958238    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"]
Jul 29 19:37:02.960975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.958750    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c605668b-1cc8-42d3-82b6-4b3a3df3edbf" containerName="authorino"
Jul 29 19:37:02.960975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.958764    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c605668b-1cc8-42d3-82b6-4b3a3df3edbf" containerName="authorino"
Jul 29 19:37:02.960975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.958843    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c605668b-1cc8-42d3-82b6-4b3a3df3edbf" containerName="authorino"
Jul 29 19:37:02.961897 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.961880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:02.964266 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.964250    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-52b12a4b-kserve-self-signed-certs\""
Jul 29 19:37:02.982668 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:02.982642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"]
Jul 29 19:37:03.107754 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.107728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-model-cache\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.107916 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.107760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-home\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.107916 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.107785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a833f328-7fb6-4396-8918-ba18981ce6df-tls-certs\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.107916 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.107896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnrh\" (UniqueName: \"kubernetes.io/projected/a833f328-7fb6-4396-8918-ba18981ce6df-kube-api-access-gnnrh\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.108103 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.107945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-dshm\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.108103 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.108013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-tmp-dir\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209235 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-model-cache\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209235 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-home\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209373 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a833f328-7fb6-4396-8918-ba18981ce6df-tls-certs\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209373 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnrh\" (UniqueName: \"kubernetes.io/projected/a833f328-7fb6-4396-8918-ba18981ce6df-kube-api-access-gnnrh\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209373 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-dshm\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-tmp-dir\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209614 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-model-cache\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-home\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.209677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.209648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-tmp-dir\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.211488 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.211468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-dshm\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.211677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.211661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a833f328-7fb6-4396-8918-ba18981ce6df-tls-certs\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.219005 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.218986    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnrh\" (UniqueName: \"kubernetes.io/projected/a833f328-7fb6-4396-8918-ba18981ce6df-kube-api-access-gnnrh\") pod \"e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") " pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.270701 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.270683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:03.403440 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.403405    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"]
Jul 29 19:37:03.404739 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:37:03.404698    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda833f328_7fb6_4396_8918_ba18981ce6df.slice/crio-ae2d99db6456e65a07b4a9c54154dc0ba0db97fee404176f4490a61b6fb2bb91 WatchSource:0}: Error finding container ae2d99db6456e65a07b4a9c54154dc0ba0db97fee404176f4490a61b6fb2bb91: Status 404 returned error can't find the container with id ae2d99db6456e65a07b4a9c54154dc0ba0db97fee404176f4490a61b6fb2bb91
Jul 29 19:37:03.692936 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.692905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s" event={"ID":"a833f328-7fb6-4396-8918-ba18981ce6df","Type":"ContainerStarted","Data":"6ee3a415ac53544ca8a55df93f580e8b92536417213880aaf704f7ad9b3ade8c"}
Jul 29 19:37:03.693104 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.692944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s" event={"ID":"a833f328-7fb6-4396-8918-ba18981ce6df","Type":"ContainerStarted","Data":"ae2d99db6456e65a07b4a9c54154dc0ba0db97fee404176f4490a61b6fb2bb91"}
Jul 29 19:37:03.714746 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:03.714700    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s" podStartSLOduration=1.714685389 podStartE2EDuration="1.714685389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:37:03.713486587 +0000 UTC m=+1317.630436175" watchObservedRunningTime="2026-07-29 19:37:03.714685389 +0000 UTC m=+1317.631634975"
Jul 29 19:37:13.271001 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:13.270922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:13.271001 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:13.270971    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:13.282776 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:13.282749    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:13.756676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:13.756639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:39.665258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:39.665188    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"]
Jul 29 19:37:54.683795 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:54.683733    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s" podUID="a833f328-7fb6-4396-8918-ba18981ce6df" containerName="main" containerID="cri-o://6ee3a415ac53544ca8a55df93f580e8b92536417213880aaf704f7ad9b3ade8c" gracePeriod=45
Jul 29 19:37:54.928650 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:54.928620    2576 generic.go:356] "Generic (PLEG): container finished" podID="a833f328-7fb6-4396-8918-ba18981ce6df" containerID="6ee3a415ac53544ca8a55df93f580e8b92536417213880aaf704f7ad9b3ade8c" exitCode=0
Jul 29 19:37:54.928784 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:54.928686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s" event={"ID":"a833f328-7fb6-4396-8918-ba18981ce6df","Type":"ContainerDied","Data":"6ee3a415ac53544ca8a55df93f580e8b92536417213880aaf704f7ad9b3ade8c"}
Jul 29 19:37:54.928784 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:54.928729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s" event={"ID":"a833f328-7fb6-4396-8918-ba18981ce6df","Type":"ContainerDied","Data":"ae2d99db6456e65a07b4a9c54154dc0ba0db97fee404176f4490a61b6fb2bb91"}
Jul 29 19:37:54.928784 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:54.928741    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae2d99db6456e65a07b4a9c54154dc0ba0db97fee404176f4490a61b6fb2bb91"
Jul 29 19:37:54.937764 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:54.937701    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:55.053087 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-home\") pod \"a833f328-7fb6-4396-8918-ba18981ce6df\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") "
Jul 29 19:37:55.053277 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-tmp-dir\") pod \"a833f328-7fb6-4396-8918-ba18981ce6df\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") "
Jul 29 19:37:55.053277 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnnrh\" (UniqueName: \"kubernetes.io/projected/a833f328-7fb6-4396-8918-ba18981ce6df-kube-api-access-gnnrh\") pod \"a833f328-7fb6-4396-8918-ba18981ce6df\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") "
Jul 29 19:37:55.053277 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053240    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-model-cache\") pod \"a833f328-7fb6-4396-8918-ba18981ce6df\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") "
Jul 29 19:37:55.053447 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053285    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-home" (OuterVolumeSpecName: "home") pod "a833f328-7fb6-4396-8918-ba18981ce6df" (UID: "a833f328-7fb6-4396-8918-ba18981ce6df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:55.053447 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053293    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a833f328-7fb6-4396-8918-ba18981ce6df-tls-certs\") pod \"a833f328-7fb6-4396-8918-ba18981ce6df\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") "
Jul 29 19:37:55.053447 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a833f328-7fb6-4396-8918-ba18981ce6df" (UID: "a833f328-7fb6-4396-8918-ba18981ce6df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:55.053447 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-dshm\") pod \"a833f328-7fb6-4396-8918-ba18981ce6df\" (UID: \"a833f328-7fb6-4396-8918-ba18981ce6df\") "
Jul 29 19:37:55.053656 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053511    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-model-cache" (OuterVolumeSpecName: "model-cache") pod "a833f328-7fb6-4396-8918-ba18981ce6df" (UID: "a833f328-7fb6-4396-8918-ba18981ce6df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:55.053711 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053697    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:37:55.053760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053711    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:37:55.053760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.053721    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:37:55.055474 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.055442    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-dshm" (OuterVolumeSpecName: "dshm") pod "a833f328-7fb6-4396-8918-ba18981ce6df" (UID: "a833f328-7fb6-4396-8918-ba18981ce6df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:55.055474 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.055463    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a833f328-7fb6-4396-8918-ba18981ce6df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a833f328-7fb6-4396-8918-ba18981ce6df" (UID: "a833f328-7fb6-4396-8918-ba18981ce6df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:37:55.055621 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.055542    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a833f328-7fb6-4396-8918-ba18981ce6df-kube-api-access-gnnrh" (OuterVolumeSpecName: "kube-api-access-gnnrh") pod "a833f328-7fb6-4396-8918-ba18981ce6df" (UID: "a833f328-7fb6-4396-8918-ba18981ce6df"). InnerVolumeSpecName "kube-api-access-gnnrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:37:55.160830 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.155160    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnnrh\" (UniqueName: \"kubernetes.io/projected/a833f328-7fb6-4396-8918-ba18981ce6df-kube-api-access-gnnrh\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:37:55.160830 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.155205    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a833f328-7fb6-4396-8918-ba18981ce6df-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:37:55.160830 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.155220    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a833f328-7fb6-4396-8918-ba18981ce6df-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:37:55.933621 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.933591    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"
Jul 29 19:37:55.954210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.954181    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"]
Jul 29 19:37:55.961534 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:55.961501    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-52b12a4b-kserve-6dbfbbfbff-nw82s"]
Jul 29 19:37:56.673650 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:37:56.673609    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a833f328-7fb6-4396-8918-ba18981ce6df" path="/var/lib/kubelet/pods/a833f328-7fb6-4396-8918-ba18981ce6df/volumes"
Jul 29 19:40:06.579114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:40:06.579087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:40:06.580145 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:40:06.580123    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:41:55.179083 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.179052    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"]
Jul 29 19:41:55.179493 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.179391    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a833f328-7fb6-4396-8918-ba18981ce6df" containerName="main"
Jul 29 19:41:55.179493 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.179402    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a833f328-7fb6-4396-8918-ba18981ce6df" containerName="main"
Jul 29 19:41:55.179493 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.179466    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a833f328-7fb6-4396-8918-ba18981ce6df" containerName="main"
Jul 29 19:41:55.182439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.182424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:41:55.184668 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.184646    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:41:55.184781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.184699    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:41:55.190148 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.189964    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"]
Jul 29 19:41:55.347858 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.347821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c9fa14-596f-430b-8173-7ed78e506863-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc\" (UID: \"78c9fa14-596f-430b-8173-7ed78e506863\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:41:55.448401 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.448318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c9fa14-596f-430b-8173-7ed78e506863-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc\" (UID: \"78c9fa14-596f-430b-8173-7ed78e506863\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:41:55.448926 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.448907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c9fa14-596f-430b-8173-7ed78e506863-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc\" (UID: \"78c9fa14-596f-430b-8173-7ed78e506863\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:41:55.494369 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.494327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:41:55.622126 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.622094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"]
Jul 29 19:41:55.626068 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:41:55.626006    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c9fa14_596f_430b_8173_7ed78e506863.slice/crio-fc18a756c42f1ba1fc005c55f839a0a08cf89d94bb576ef6aef2dc1500255cac WatchSource:0}: Error finding container fc18a756c42f1ba1fc005c55f839a0a08cf89d94bb576ef6aef2dc1500255cac: Status 404 returned error can't find the container with id fc18a756c42f1ba1fc005c55f839a0a08cf89d94bb576ef6aef2dc1500255cac
Jul 29 19:41:55.628003 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:55.627986    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:41:56.015185 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:56.015155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc" event={"ID":"78c9fa14-596f-430b-8173-7ed78e506863","Type":"ContainerStarted","Data":"fc18a756c42f1ba1fc005c55f839a0a08cf89d94bb576ef6aef2dc1500255cac"}
Jul 29 19:41:58.026615 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:58.026543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc" event={"ID":"78c9fa14-596f-430b-8173-7ed78e506863","Type":"ContainerStarted","Data":"61d1ad0225d034aec559700982a27dca92650d724cfdb628d06c61afc65c9149"}
Jul 29 19:41:58.042774 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:58.042726    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc" podStartSLOduration=0.997390244 podStartE2EDuration="3.042712079s" totalImagesPullingTime="2.045321835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:41:58.041248384 +0000 UTC m=+1611.958197974" watchObservedRunningTime="2026-07-29 19:41:58.042712079 +0000 UTC m=+1611.959661705"
Jul 29 19:41:59.032955 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:59.032920    2576 generic.go:356] "Generic (PLEG): container finished" podID="78c9fa14-596f-430b-8173-7ed78e506863" containerID="61d1ad0225d034aec559700982a27dca92650d724cfdb628d06c61afc65c9149" exitCode=0
Jul 29 19:41:59.033364 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:41:59.033009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc" event={"ID":"78c9fa14-596f-430b-8173-7ed78e506863","Type":"ContainerDied","Data":"61d1ad0225d034aec559700982a27dca92650d724cfdb628d06c61afc65c9149"}
Jul 29 19:42:00.167939 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:00.167914    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:42:00.296697 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:00.296608    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c9fa14-596f-430b-8173-7ed78e506863-maas-api-service-ca\") pod \"78c9fa14-596f-430b-8173-7ed78e506863\" (UID: \"78c9fa14-596f-430b-8173-7ed78e506863\") "
Jul 29 19:42:00.297087 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:00.297064    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78c9fa14-596f-430b-8173-7ed78e506863-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78c9fa14-596f-430b-8173-7ed78e506863" (UID: "78c9fa14-596f-430b-8173-7ed78e506863"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:00.398371 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:00.398338    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c9fa14-596f-430b-8173-7ed78e506863-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:42:01.044345 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:01.044258    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc" event={"ID":"78c9fa14-596f-430b-8173-7ed78e506863","Type":"ContainerDied","Data":"fc18a756c42f1ba1fc005c55f839a0a08cf89d94bb576ef6aef2dc1500255cac"}
Jul 29 19:42:01.044345 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:01.044292    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"
Jul 29 19:42:01.044345 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:01.044305    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc18a756c42f1ba1fc005c55f839a0a08cf89d94bb576ef6aef2dc1500255cac"
Jul 29 19:42:10.911852 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:10.911814    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"]
Jul 29 19:42:10.917918 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:10.917890    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5c29115-h8lqc"]
Jul 29 19:42:12.671667 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:12.671633    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c9fa14-596f-430b-8173-7ed78e506863" path="/var/lib/kubelet/pods/78c9fa14-596f-430b-8173-7ed78e506863/volumes"
Jul 29 19:42:40.050689 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.050649    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"]
Jul 29 19:42:40.051131 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.051004    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78c9fa14-596f-430b-8173-7ed78e506863" containerName="revoke-keys"
Jul 29 19:42:40.051131 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.051016    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c9fa14-596f-430b-8173-7ed78e506863" containerName="revoke-keys"
Jul 29 19:42:40.051131 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.051110    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="78c9fa14-596f-430b-8173-7ed78e506863" containerName="revoke-keys"
Jul 29 19:42:40.054293 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.054277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:40.056361 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.056339    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:42:40.056475 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.056449    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:42:40.063811 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.063786    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"]
Jul 29 19:42:40.146567 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.146534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452dc3b2-054d-401f-91a0-2c361f32ff4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98\" (UID: \"452dc3b2-054d-401f-91a0-2c361f32ff4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:40.247828 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.247796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452dc3b2-054d-401f-91a0-2c361f32ff4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98\" (UID: \"452dc3b2-054d-401f-91a0-2c361f32ff4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:40.248492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.248471    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452dc3b2-054d-401f-91a0-2c361f32ff4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98\" (UID: \"452dc3b2-054d-401f-91a0-2c361f32ff4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:40.364787 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.364765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:40.500343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:40.500319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"]
Jul 29 19:42:40.502898 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:42:40.502870    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452dc3b2_054d_401f_91a0_2c361f32ff4d.slice/crio-39b2dddf63f29169c0c88a1ea0606c95957d4d1f4b82310a74586fb210d162b8 WatchSource:0}: Error finding container 39b2dddf63f29169c0c88a1ea0606c95957d4d1f4b82310a74586fb210d162b8: Status 404 returned error can't find the container with id 39b2dddf63f29169c0c88a1ea0606c95957d4d1f4b82310a74586fb210d162b8
Jul 29 19:42:41.227955 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:41.227919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98" event={"ID":"452dc3b2-054d-401f-91a0-2c361f32ff4d","Type":"ContainerStarted","Data":"3f7f1e64118eaba7215aff7f65586e625a3a30c95b9fdae2362bd1e43a68c887"}
Jul 29 19:42:41.228354 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:41.227972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98" event={"ID":"452dc3b2-054d-401f-91a0-2c361f32ff4d","Type":"ContainerStarted","Data":"39b2dddf63f29169c0c88a1ea0606c95957d4d1f4b82310a74586fb210d162b8"}
Jul 29 19:42:41.245548 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:41.245505    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98" podStartSLOduration=1.245490362 podStartE2EDuration="1.245490362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:41.24342986 +0000 UTC m=+1655.160379470" watchObservedRunningTime="2026-07-29 19:42:41.245490362 +0000 UTC m=+1655.162439949"
Jul 29 19:42:42.233335 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:42.233302    2576 generic.go:356] "Generic (PLEG): container finished" podID="452dc3b2-054d-401f-91a0-2c361f32ff4d" containerID="3f7f1e64118eaba7215aff7f65586e625a3a30c95b9fdae2362bd1e43a68c887" exitCode=0
Jul 29 19:42:42.233682 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:42.233373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98" event={"ID":"452dc3b2-054d-401f-91a0-2c361f32ff4d","Type":"ContainerDied","Data":"3f7f1e64118eaba7215aff7f65586e625a3a30c95b9fdae2362bd1e43a68c887"}
Jul 29 19:42:43.367747 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:43.367726    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:43.476502 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:43.476477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452dc3b2-054d-401f-91a0-2c361f32ff4d-maas-api-service-ca\") pod \"452dc3b2-054d-401f-91a0-2c361f32ff4d\" (UID: \"452dc3b2-054d-401f-91a0-2c361f32ff4d\") "
Jul 29 19:42:43.476891 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:43.476871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452dc3b2-054d-401f-91a0-2c361f32ff4d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "452dc3b2-054d-401f-91a0-2c361f32ff4d" (UID: "452dc3b2-054d-401f-91a0-2c361f32ff4d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:43.577845 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:43.577819    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452dc3b2-054d-401f-91a0-2c361f32ff4d-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:42:44.249165 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:44.249136    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"
Jul 29 19:42:44.249335 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:44.249137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98" event={"ID":"452dc3b2-054d-401f-91a0-2c361f32ff4d","Type":"ContainerDied","Data":"39b2dddf63f29169c0c88a1ea0606c95957d4d1f4b82310a74586fb210d162b8"}
Jul 29 19:42:44.249335 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:44.249265    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39b2dddf63f29169c0c88a1ea0606c95957d4d1f4b82310a74586fb210d162b8"
Jul 29 19:42:46.005899 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:46.005863    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"]
Jul 29 19:42:46.008487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:46.008462    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-57a0d2c8-cxm98"]
Jul 29 19:42:46.671749 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:46.671718    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452dc3b2-054d-401f-91a0-2c361f32ff4d" path="/var/lib/kubelet/pods/452dc3b2-054d-401f-91a0-2c361f32ff4d/volumes"
Jul 29 19:42:50.353393 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.353362    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"]
Jul 29 19:42:50.353847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.353685    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452dc3b2-054d-401f-91a0-2c361f32ff4d" containerName="revoke-keys"
Jul 29 19:42:50.353847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.353695    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="452dc3b2-054d-401f-91a0-2c361f32ff4d" containerName="revoke-keys"
Jul 29 19:42:50.353847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.353762    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="452dc3b2-054d-401f-91a0-2c361f32ff4d" containerName="revoke-keys"
Jul 29 19:42:50.356944 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.356925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.359054 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.359016    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ed80512f-dockercfg-5xxcq\""
Jul 29 19:42:50.359174 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.359016    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ed80512f\""
Jul 29 19:42:50.370096 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.368296    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"]
Jul 29 19:42:50.536963 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.536932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274f8f88-9a8a-4a53-9621-2b1bda7b5519-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") " pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.537136 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.536979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d227f\" (UniqueName: \"kubernetes.io/projected/274f8f88-9a8a-4a53-9621-2b1bda7b5519-kube-api-access-d227f\") pod \"payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") " pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.638376 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.638307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274f8f88-9a8a-4a53-9621-2b1bda7b5519-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") " pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.638376 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.638353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d227f\" (UniqueName: \"kubernetes.io/projected/274f8f88-9a8a-4a53-9621-2b1bda7b5519-kube-api-access-d227f\") pod \"payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") " pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.639090 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.639064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274f8f88-9a8a-4a53-9621-2b1bda7b5519-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") " pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.648114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.648092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d227f\" (UniqueName: \"kubernetes.io/projected/274f8f88-9a8a-4a53-9621-2b1bda7b5519-kube-api-access-d227f\") pod \"payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") " pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.674518 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.674499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:50.803935 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:50.803835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"]
Jul 29 19:42:50.806593 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:42:50.806568    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274f8f88_9a8a_4a53_9621_2b1bda7b5519.slice/crio-02fb472e4e1868ce880ab62d71f7491e8deb38c94fc1421f818015b1cc2f3a2f WatchSource:0}: Error finding container 02fb472e4e1868ce880ab62d71f7491e8deb38c94fc1421f818015b1cc2f3a2f: Status 404 returned error can't find the container with id 02fb472e4e1868ce880ab62d71f7491e8deb38c94fc1421f818015b1cc2f3a2f
Jul 29 19:42:51.282085 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:51.282053    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48" event={"ID":"274f8f88-9a8a-4a53-9621-2b1bda7b5519","Type":"ContainerStarted","Data":"02fb472e4e1868ce880ab62d71f7491e8deb38c94fc1421f818015b1cc2f3a2f"}
Jul 29 19:42:53.292959 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:53.292927    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48" event={"ID":"274f8f88-9a8a-4a53-9621-2b1bda7b5519","Type":"ContainerStarted","Data":"ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386"}
Jul 29 19:42:53.293348 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:53.292991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:42:53.312482 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:42:53.312434    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48" podStartSLOduration=1.811323333 podStartE2EDuration="3.31241609s" totalImagesPullingTime="1.501092757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:53.311766002 +0000 UTC m=+1667.228715601" watchObservedRunningTime="2026-07-29 19:42:53.31241609 +0000 UTC m=+1667.229365680"
Jul 29 19:43:04.300193 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:04.300157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:43:06.657749 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:06.657718    2576 scope.go:117] "RemoveContainer" containerID="6ee3a415ac53544ca8a55df93f580e8b92536417213880aaf704f7ad9b3ade8c"
Jul 29 19:43:14.937259 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:14.937227    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"]
Jul 29 19:43:14.940709 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:14.940694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:14.942940 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:14.942917    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:43:14.943079 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:14.943004    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:43:14.951158 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:14.951138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"]
Jul 29 19:43:15.058118 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:15.058089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26823fec-c273-41d9-ab84-583babd23f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb\" (UID: \"26823fec-c273-41d9-ab84-583babd23f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:15.159621 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:15.159584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26823fec-c273-41d9-ab84-583babd23f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb\" (UID: \"26823fec-c273-41d9-ab84-583babd23f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:15.160268 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:15.160251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26823fec-c273-41d9-ab84-583babd23f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb\" (UID: \"26823fec-c273-41d9-ab84-583babd23f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:15.251564 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:15.251480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:15.380700 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:15.380666    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"]
Jul 29 19:43:15.383994 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:43:15.383969    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26823fec_c273_41d9_ab84_583babd23f6d.slice/crio-6964329a74282dfcf895ff36db43d19aebd2d9d8e0ac7081b707982c62e3d958 WatchSource:0}: Error finding container 6964329a74282dfcf895ff36db43d19aebd2d9d8e0ac7081b707982c62e3d958: Status 404 returned error can't find the container with id 6964329a74282dfcf895ff36db43d19aebd2d9d8e0ac7081b707982c62e3d958
Jul 29 19:43:15.395527 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:15.395501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb" event={"ID":"26823fec-c273-41d9-ab84-583babd23f6d","Type":"ContainerStarted","Data":"6964329a74282dfcf895ff36db43d19aebd2d9d8e0ac7081b707982c62e3d958"}
Jul 29 19:43:16.401618 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:16.401583    2576 generic.go:356] "Generic (PLEG): container finished" podID="26823fec-c273-41d9-ab84-583babd23f6d" containerID="f73b4a3a4a390bd4b18a2afc663e28f35e2b991539d07073761f383b7792cdaa" exitCode=0
Jul 29 19:43:16.402061 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:16.401665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb" event={"ID":"26823fec-c273-41d9-ab84-583babd23f6d","Type":"ContainerDied","Data":"f73b4a3a4a390bd4b18a2afc663e28f35e2b991539d07073761f383b7792cdaa"}
Jul 29 19:43:17.550394 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:17.550372    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:17.685247 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:17.685171    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26823fec-c273-41d9-ab84-583babd23f6d-maas-api-service-ca\") pod \"26823fec-c273-41d9-ab84-583babd23f6d\" (UID: \"26823fec-c273-41d9-ab84-583babd23f6d\") "
Jul 29 19:43:17.685524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:17.685502    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26823fec-c273-41d9-ab84-583babd23f6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26823fec-c273-41d9-ab84-583babd23f6d" (UID: "26823fec-c273-41d9-ab84-583babd23f6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:17.786171 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:17.786144    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26823fec-c273-41d9-ab84-583babd23f6d-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:18.412132 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:18.412100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb" event={"ID":"26823fec-c273-41d9-ab84-583babd23f6d","Type":"ContainerDied","Data":"6964329a74282dfcf895ff36db43d19aebd2d9d8e0ac7081b707982c62e3d958"}
Jul 29 19:43:18.412132 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:18.412116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"
Jul 29 19:43:18.412351 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:18.412147    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6964329a74282dfcf895ff36db43d19aebd2d9d8e0ac7081b707982c62e3d958"
Jul 29 19:43:20.114527 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.114491    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"]
Jul 29 19:43:20.114952 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.114725    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48" podUID="274f8f88-9a8a-4a53-9621-2b1bda7b5519" containerName="payload-processing" containerID="cri-o://ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386" gracePeriod=30
Jul 29 19:43:20.283895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.283858    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"]
Jul 29 19:43:20.287063 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.287037    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed80512f-2bdbb"]
Jul 29 19:43:20.383435 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.383412    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:43:20.422590 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.422561    2576 generic.go:356] "Generic (PLEG): container finished" podID="274f8f88-9a8a-4a53-9621-2b1bda7b5519" containerID="ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386" exitCode=0
Jul 29 19:43:20.422734 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.422608    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"
Jul 29 19:43:20.422734 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.422629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48" event={"ID":"274f8f88-9a8a-4a53-9621-2b1bda7b5519","Type":"ContainerDied","Data":"ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386"}
Jul 29 19:43:20.422734 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.422670    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48" event={"ID":"274f8f88-9a8a-4a53-9621-2b1bda7b5519","Type":"ContainerDied","Data":"02fb472e4e1868ce880ab62d71f7491e8deb38c94fc1421f818015b1cc2f3a2f"}
Jul 29 19:43:20.422734 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.422691    2576 scope.go:117] "RemoveContainer" containerID="ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386"
Jul 29 19:43:20.430684 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.430663    2576 scope.go:117] "RemoveContainer" containerID="ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386"
Jul 29 19:43:20.430936 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:43:20.430917    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386\": container with ID starting with ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386 not found: ID does not exist" containerID="ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386"
Jul 29 19:43:20.430997 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.430948    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386"} err="failed to get container status \"ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386\": rpc error: code = NotFound desc = could not find container \"ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386\": container with ID starting with ad3c35c07e293ceb7c92b85b508642595c2bd9074ff531e1e67d78cc58aee386 not found: ID does not exist"
Jul 29 19:43:20.511687 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.511668    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d227f\" (UniqueName: \"kubernetes.io/projected/274f8f88-9a8a-4a53-9621-2b1bda7b5519-kube-api-access-d227f\") pod \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") "
Jul 29 19:43:20.511807 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.511779    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274f8f88-9a8a-4a53-9621-2b1bda7b5519-plugins-config-volume\") pod \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\" (UID: \"274f8f88-9a8a-4a53-9621-2b1bda7b5519\") "
Jul 29 19:43:20.512160 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.512137    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/274f8f88-9a8a-4a53-9621-2b1bda7b5519-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "274f8f88-9a8a-4a53-9621-2b1bda7b5519" (UID: "274f8f88-9a8a-4a53-9621-2b1bda7b5519"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:20.513820 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.513798    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/274f8f88-9a8a-4a53-9621-2b1bda7b5519-kube-api-access-d227f" (OuterVolumeSpecName: "kube-api-access-d227f") pod "274f8f88-9a8a-4a53-9621-2b1bda7b5519" (UID: "274f8f88-9a8a-4a53-9621-2b1bda7b5519"). InnerVolumeSpecName "kube-api-access-d227f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:20.612773 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.612746    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d227f\" (UniqueName: \"kubernetes.io/projected/274f8f88-9a8a-4a53-9621-2b1bda7b5519-kube-api-access-d227f\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.612773 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.612773    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274f8f88-9a8a-4a53-9621-2b1bda7b5519-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.672500 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.672407    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26823fec-c273-41d9-ab84-583babd23f6d" path="/var/lib/kubelet/pods/26823fec-c273-41d9-ab84-583babd23f6d/volumes"
Jul 29 19:43:20.738280 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.738246    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"]
Jul 29 19:43:20.744254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:20.744231    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed80512f-b5fbc8894-p9d48"]
Jul 29 19:43:22.672113 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:22.672087    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="274f8f88-9a8a-4a53-9621-2b1bda7b5519" path="/var/lib/kubelet/pods/274f8f88-9a8a-4a53-9621-2b1bda7b5519/volumes"
Jul 29 19:43:25.816119 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816087    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"]
Jul 29 19:43:25.816477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816420    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="274f8f88-9a8a-4a53-9621-2b1bda7b5519" containerName="payload-processing"
Jul 29 19:43:25.816477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816431    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="274f8f88-9a8a-4a53-9621-2b1bda7b5519" containerName="payload-processing"
Jul 29 19:43:25.816477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816452    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26823fec-c273-41d9-ab84-583babd23f6d" containerName="revoke-keys"
Jul 29 19:43:25.816477 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816457    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26823fec-c273-41d9-ab84-583babd23f6d" containerName="revoke-keys"
Jul 29 19:43:25.816649 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816524    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="274f8f88-9a8a-4a53-9621-2b1bda7b5519" containerName="payload-processing"
Jul 29 19:43:25.816649 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.816534    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26823fec-c273-41d9-ab84-583babd23f6d" containerName="revoke-keys"
Jul 29 19:43:25.821834 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.821816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:25.827275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.827258    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-01750ee0\""
Jul 29 19:43:25.835729 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.835705    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"]
Jul 29 19:43:25.913686 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.913648    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"]
Jul 29 19:43:25.917459 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.917444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:25.921147 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.921124    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-01750ee0-dockercfg-n9jrd\""
Jul 29 19:43:25.936234 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.936208    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"]
Jul 29 19:43:25.961375 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.961349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8khk\" (UniqueName: \"kubernetes.io/projected/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-kube-api-access-z8khk\") pod \"payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") " pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:25.961513 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:25.961433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-plugins-config-volume\") pod \"payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") " pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.062392 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.062355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2z48\" (UniqueName: \"kubernetes.io/projected/786c0de9-e9e4-47c4-9f90-4822d0d4def7-kube-api-access-t2z48\") pod \"payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.062577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.062416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-plugins-config-volume\") pod \"payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") " pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.062577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.062472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/786c0de9-e9e4-47c4-9f90-4822d0d4def7-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.062577 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.062496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8khk\" (UniqueName: \"kubernetes.io/projected/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-kube-api-access-z8khk\") pod \"payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") " pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.063047 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.063011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-plugins-config-volume\") pod \"payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") " pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.074494 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.074440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8khk\" (UniqueName: \"kubernetes.io/projected/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-kube-api-access-z8khk\") pod \"payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") " pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.131409 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.131381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.163204 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.163178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/786c0de9-e9e4-47c4-9f90-4822d0d4def7-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.163326 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.163237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2z48\" (UniqueName: \"kubernetes.io/projected/786c0de9-e9e4-47c4-9f90-4822d0d4def7-kube-api-access-t2z48\") pod \"payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.163867 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.163844    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/786c0de9-e9e4-47c4-9f90-4822d0d4def7-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.174975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.174955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2z48\" (UniqueName: \"kubernetes.io/projected/786c0de9-e9e4-47c4-9f90-4822d0d4def7-kube-api-access-t2z48\") pod \"payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.227393 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.227355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.269884 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.269205    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"]
Jul 29 19:43:26.271738 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:43:26.271711    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed0f3b6_18fd_4d9a_a6e9_49e3f31a14fd.slice/crio-19ae776740d2a89c29763c850d0268729247c43337e5ad182736bd723f420c06 WatchSource:0}: Error finding container 19ae776740d2a89c29763c850d0268729247c43337e5ad182736bd723f420c06: Status 404 returned error can't find the container with id 19ae776740d2a89c29763c850d0268729247c43337e5ad182736bd723f420c06
Jul 29 19:43:26.366522 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.366491    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"]
Jul 29 19:43:26.370331 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:43:26.370306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786c0de9_e9e4_47c4_9f90_4822d0d4def7.slice/crio-9840fff013ea67e107a9d5b6cd51fbc450cfc5a1b7b6b88603a3af4a77be3ab7 WatchSource:0}: Error finding container 9840fff013ea67e107a9d5b6cd51fbc450cfc5a1b7b6b88603a3af4a77be3ab7: Status 404 returned error can't find the container with id 9840fff013ea67e107a9d5b6cd51fbc450cfc5a1b7b6b88603a3af4a77be3ab7
Jul 29 19:43:26.460754 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.460726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p" event={"ID":"786c0de9-e9e4-47c4-9f90-4822d0d4def7","Type":"ContainerStarted","Data":"06d3d5cfad6c9d71295fe8aab83c46dd40c0a04e648f376bef8b1ae510848b03"}
Jul 29 19:43:26.460941 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.460775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p" event={"ID":"786c0de9-e9e4-47c4-9f90-4822d0d4def7","Type":"ContainerStarted","Data":"9840fff013ea67e107a9d5b6cd51fbc450cfc5a1b7b6b88603a3af4a77be3ab7"}
Jul 29 19:43:26.460941 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.460809    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:26.462340 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.462318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg" event={"ID":"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd","Type":"ContainerStarted","Data":"fcae2516d383a72b1e4aba054e49a0cebbc7d543b0365e37bfafb7266251192a"}
Jul 29 19:43:26.462466 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.462354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg" event={"ID":"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd","Type":"ContainerStarted","Data":"19ae776740d2a89c29763c850d0268729247c43337e5ad182736bd723f420c06"}
Jul 29 19:43:26.462466 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.462374    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:26.477696 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.477649    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p" podStartSLOduration=1.477633148 podStartE2EDuration="1.477633148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:43:26.477160063 +0000 UTC m=+1700.394109652" watchObservedRunningTime="2026-07-29 19:43:26.477633148 +0000 UTC m=+1700.394582728"
Jul 29 19:43:26.498295 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:26.498253    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg" podStartSLOduration=1.498240143 podStartE2EDuration="1.498240143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:43:26.49719808 +0000 UTC m=+1700.414147667" watchObservedRunningTime="2026-07-29 19:43:26.498240143 +0000 UTC m=+1700.415189731"
Jul 29 19:43:37.470763 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:37.470728    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:37.471185 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:37.470819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:49.248855 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.248819    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"]
Jul 29 19:43:49.252273 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.252257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:49.254424 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.254404    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:43:49.254424 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.254413    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:43:49.263764 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.263739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"]
Jul 29 19:43:49.353917 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.353870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7cc60b-5944-4046-be29-e271f25ed5fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-01750ee0-2lghx\" (UID: \"ad7cc60b-5944-4046-be29-e271f25ed5fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:49.454883 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.454838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7cc60b-5944-4046-be29-e271f25ed5fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-01750ee0-2lghx\" (UID: \"ad7cc60b-5944-4046-be29-e271f25ed5fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:49.455461 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.455441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7cc60b-5944-4046-be29-e271f25ed5fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-01750ee0-2lghx\" (UID: \"ad7cc60b-5944-4046-be29-e271f25ed5fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:49.568363 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.568334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:49.701844 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:49.701820    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"]
Jul 29 19:43:49.704426 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:43:49.704399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7cc60b_5944_4046_be29_e271f25ed5fd.slice/crio-8e109ea535533bcfce09c8dc85e1772863b4c1cc4eb261e8866a3bc521a806ee WatchSource:0}: Error finding container 8e109ea535533bcfce09c8dc85e1772863b4c1cc4eb261e8866a3bc521a806ee: Status 404 returned error can't find the container with id 8e109ea535533bcfce09c8dc85e1772863b4c1cc4eb261e8866a3bc521a806ee
Jul 29 19:43:50.582583 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:50.582552    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad7cc60b-5944-4046-be29-e271f25ed5fd" containerID="c9975cb676c0374a8a3c1445fd6757918a0ca519d46f35c1ae8c2763a3ec2cfb" exitCode=0
Jul 29 19:43:50.582953 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:50.582589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx" event={"ID":"ad7cc60b-5944-4046-be29-e271f25ed5fd","Type":"ContainerDied","Data":"c9975cb676c0374a8a3c1445fd6757918a0ca519d46f35c1ae8c2763a3ec2cfb"}
Jul 29 19:43:50.582953 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:50.582672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx" event={"ID":"ad7cc60b-5944-4046-be29-e271f25ed5fd","Type":"ContainerStarted","Data":"8e109ea535533bcfce09c8dc85e1772863b4c1cc4eb261e8866a3bc521a806ee"}
Jul 29 19:43:51.715703 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:51.715681    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:51.774606 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:51.774579    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7cc60b-5944-4046-be29-e271f25ed5fd-maas-api-service-ca\") pod \"ad7cc60b-5944-4046-be29-e271f25ed5fd\" (UID: \"ad7cc60b-5944-4046-be29-e271f25ed5fd\") "
Jul 29 19:43:51.774894 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:51.774874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad7cc60b-5944-4046-be29-e271f25ed5fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad7cc60b-5944-4046-be29-e271f25ed5fd" (UID: "ad7cc60b-5944-4046-be29-e271f25ed5fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:51.875582 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:51.875522    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7cc60b-5944-4046-be29-e271f25ed5fd-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:52.592570 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:52.592547    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"
Jul 29 19:43:52.592765 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:52.592542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx" event={"ID":"ad7cc60b-5944-4046-be29-e271f25ed5fd","Type":"ContainerDied","Data":"8e109ea535533bcfce09c8dc85e1772863b4c1cc4eb261e8866a3bc521a806ee"}
Jul 29 19:43:52.592765 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:52.592678    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e109ea535533bcfce09c8dc85e1772863b4c1cc4eb261e8866a3bc521a806ee"
Jul 29 19:43:55.413641 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.413598    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"]
Jul 29 19:43:55.414124 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.413943    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg" podUID="6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" containerName="payload-processing" containerID="cri-o://fcae2516d383a72b1e4aba054e49a0cebbc7d543b0365e37bfafb7266251192a" gracePeriod=30
Jul 29 19:43:55.420940 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.420910    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"]
Jul 29 19:43:55.421226 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.421181    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p" podUID="786c0de9-e9e4-47c4-9f90-4822d0d4def7" containerName="payload-pre-processing" containerID="cri-o://06d3d5cfad6c9d71295fe8aab83c46dd40c0a04e648f376bef8b1ae510848b03" gracePeriod=30
Jul 29 19:43:55.603186 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.603126    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"]
Jul 29 19:43:55.605288 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.605268    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-01750ee0-2lghx"]
Jul 29 19:43:55.610223 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.610187    2576 generic.go:356] "Generic (PLEG): container finished" podID="786c0de9-e9e4-47c4-9f90-4822d0d4def7" containerID="06d3d5cfad6c9d71295fe8aab83c46dd40c0a04e648f376bef8b1ae510848b03" exitCode=0
Jul 29 19:43:55.610354 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.610258    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p" event={"ID":"786c0de9-e9e4-47c4-9f90-4822d0d4def7","Type":"ContainerDied","Data":"06d3d5cfad6c9d71295fe8aab83c46dd40c0a04e648f376bef8b1ae510848b03"}
Jul 29 19:43:55.611777 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.611757    2576 generic.go:356] "Generic (PLEG): container finished" podID="6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" containerID="fcae2516d383a72b1e4aba054e49a0cebbc7d543b0365e37bfafb7266251192a" exitCode=0
Jul 29 19:43:55.611876 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.611793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg" event={"ID":"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd","Type":"ContainerDied","Data":"fcae2516d383a72b1e4aba054e49a0cebbc7d543b0365e37bfafb7266251192a"}
Jul 29 19:43:55.689968 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.689946    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:55.697528 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.697503    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:55.807314 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2z48\" (UniqueName: \"kubernetes.io/projected/786c0de9-e9e4-47c4-9f90-4822d0d4def7-kube-api-access-t2z48\") pod \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") "
Jul 29 19:43:55.807507 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807352    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/786c0de9-e9e4-47c4-9f90-4822d0d4def7-plugins-config-volume\") pod \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\" (UID: \"786c0de9-e9e4-47c4-9f90-4822d0d4def7\") "
Jul 29 19:43:55.807507 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807447    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8khk\" (UniqueName: \"kubernetes.io/projected/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-kube-api-access-z8khk\") pod \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") "
Jul 29 19:43:55.807507 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-plugins-config-volume\") pod \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\" (UID: \"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd\") "
Jul 29 19:43:55.807678 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807633    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/786c0de9-e9e4-47c4-9f90-4822d0d4def7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "786c0de9-e9e4-47c4-9f90-4822d0d4def7" (UID: "786c0de9-e9e4-47c4-9f90-4822d0d4def7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:55.807854 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807830    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" (UID: "6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:55.807942 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807930    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:55.807986 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.807945    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/786c0de9-e9e4-47c4-9f90-4822d0d4def7-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:55.809401 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.809378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/786c0de9-e9e4-47c4-9f90-4822d0d4def7-kube-api-access-t2z48" (OuterVolumeSpecName: "kube-api-access-t2z48") pod "786c0de9-e9e4-47c4-9f90-4822d0d4def7" (UID: "786c0de9-e9e4-47c4-9f90-4822d0d4def7"). InnerVolumeSpecName "kube-api-access-t2z48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:55.809475 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.809451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-kube-api-access-z8khk" (OuterVolumeSpecName: "kube-api-access-z8khk") pod "6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" (UID: "6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd"). InnerVolumeSpecName "kube-api-access-z8khk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:55.909395 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.909354    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2z48\" (UniqueName: \"kubernetes.io/projected/786c0de9-e9e4-47c4-9f90-4822d0d4def7-kube-api-access-t2z48\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:55.909395 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:55.909394    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8khk\" (UniqueName: \"kubernetes.io/projected/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd-kube-api-access-z8khk\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:43:56.618301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.618271    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"
Jul 29 19:43:56.618685 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.618302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg" event={"ID":"6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd","Type":"ContainerDied","Data":"19ae776740d2a89c29763c850d0268729247c43337e5ad182736bd723f420c06"}
Jul 29 19:43:56.618685 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.618363    2576 scope.go:117] "RemoveContainer" containerID="fcae2516d383a72b1e4aba054e49a0cebbc7d543b0365e37bfafb7266251192a"
Jul 29 19:43:56.619776 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.619755    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p" event={"ID":"786c0de9-e9e4-47c4-9f90-4822d0d4def7","Type":"ContainerDied","Data":"9840fff013ea67e107a9d5b6cd51fbc450cfc5a1b7b6b88603a3af4a77be3ab7"}
Jul 29 19:43:56.619847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.619788    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"
Jul 29 19:43:56.627542 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.627523    2576 scope.go:117] "RemoveContainer" containerID="06d3d5cfad6c9d71295fe8aab83c46dd40c0a04e648f376bef8b1ae510848b03"
Jul 29 19:43:56.646484 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.646459    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"]
Jul 29 19:43:56.651879 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.651857    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-01750ee0-796ffc66fd-plfjg"]
Jul 29 19:43:56.661951 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.661930    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"]
Jul 29 19:43:56.673096 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.673069    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" path="/var/lib/kubelet/pods/6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd/volumes"
Jul 29 19:43:56.673430 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.673417    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad7cc60b-5944-4046-be29-e271f25ed5fd" path="/var/lib/kubelet/pods/ad7cc60b-5944-4046-be29-e271f25ed5fd/volumes"
Jul 29 19:43:56.673643 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:56.673631    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-01750ee0-9765dc896-8r98p"]
Jul 29 19:43:58.671462 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:43:58.671430    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="786c0de9-e9e4-47c4-9f90-4822d0d4def7" path="/var/lib/kubelet/pods/786c0de9-e9e4-47c4-9f90-4822d0d4def7/volumes"
Jul 29 19:45:06.607453 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:06.607418    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:45:06.609238 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:06.609220    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:45:53.968042 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.967997    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"]
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968359    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" containerName="payload-processing"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968370    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" containerName="payload-processing"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968377    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad7cc60b-5944-4046-be29-e271f25ed5fd" containerName="revoke-keys"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968383    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad7cc60b-5944-4046-be29-e271f25ed5fd" containerName="revoke-keys"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968393    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="786c0de9-e9e4-47c4-9f90-4822d0d4def7" containerName="payload-pre-processing"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968399    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="786c0de9-e9e4-47c4-9f90-4822d0d4def7" containerName="payload-pre-processing"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968448    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed0f3b6-18fd-4d9a-a6e9-49e3f31a14fd" containerName="payload-processing"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968457    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad7cc60b-5944-4046-be29-e271f25ed5fd" containerName="revoke-keys"
Jul 29 19:45:53.968490 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.968465    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="786c0de9-e9e4-47c4-9f90-4822d0d4def7" containerName="payload-pre-processing"
Jul 29 19:45:53.971466 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.971448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:53.980534 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.980513    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-60d3c925-dockercfg-kjzzc\""
Jul 29 19:45:53.980612 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.980513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-60d3c925\""
Jul 29 19:45:53.990749 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:53.990726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"]
Jul 29 19:45:54.043258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.043232    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"]
Jul 29 19:45:54.046692 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.046672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.059146 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.059123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"]
Jul 29 19:45:54.084154 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.084130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wtd\" (UniqueName: \"kubernetes.io/projected/d38ec69b-01fb-49a9-af0b-f46527372f34-kube-api-access-v4wtd\") pod \"payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.084261 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.084187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d38ec69b-01fb-49a9-af0b-f46527372f34-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.185294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.185264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b26ccef-6dc8-4c26-b22a-500024365925-plugins-config-volume\") pod \"payload-processing-e2e-mt-60d3c925-96db7746-6trnp\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") " pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.185429 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.185311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wtd\" (UniqueName: \"kubernetes.io/projected/d38ec69b-01fb-49a9-af0b-f46527372f34-kube-api-access-v4wtd\") pod \"payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.185429 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.185375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmv6\" (UniqueName: \"kubernetes.io/projected/2b26ccef-6dc8-4c26-b22a-500024365925-kube-api-access-ghmv6\") pod \"payload-processing-e2e-mt-60d3c925-96db7746-6trnp\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") " pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.185513 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.185426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d38ec69b-01fb-49a9-af0b-f46527372f34-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.186080 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.186064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d38ec69b-01fb-49a9-af0b-f46527372f34-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.204453 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.204432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wtd\" (UniqueName: \"kubernetes.io/projected/d38ec69b-01fb-49a9-af0b-f46527372f34-kube-api-access-v4wtd\") pod \"payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.281462 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.281406    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:54.286616 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.286598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmv6\" (UniqueName: \"kubernetes.io/projected/2b26ccef-6dc8-4c26-b22a-500024365925-kube-api-access-ghmv6\") pod \"payload-processing-e2e-mt-60d3c925-96db7746-6trnp\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") " pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.286679 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.286651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b26ccef-6dc8-4c26-b22a-500024365925-plugins-config-volume\") pod \"payload-processing-e2e-mt-60d3c925-96db7746-6trnp\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") " pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.287295 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.287280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b26ccef-6dc8-4c26-b22a-500024365925-plugins-config-volume\") pod \"payload-processing-e2e-mt-60d3c925-96db7746-6trnp\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") " pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.296562 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.296539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmv6\" (UniqueName: \"kubernetes.io/projected/2b26ccef-6dc8-4c26-b22a-500024365925-kube-api-access-ghmv6\") pod \"payload-processing-e2e-mt-60d3c925-96db7746-6trnp\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") " pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.356058 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.355986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:54.422335 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.422308    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"]
Jul 29 19:45:54.424305 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:45:54.424275    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38ec69b_01fb_49a9_af0b_f46527372f34.slice/crio-e9df7e541b2ae16b15f068a3742d2306df398e75f7d0b775f7d33a6739f86584 WatchSource:0}: Error finding container e9df7e541b2ae16b15f068a3742d2306df398e75f7d0b775f7d33a6739f86584: Status 404 returned error can't find the container with id e9df7e541b2ae16b15f068a3742d2306df398e75f7d0b775f7d33a6739f86584
Jul 29 19:45:54.496439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:54.496414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"]
Jul 29 19:45:54.498966 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:45:54.498936    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b26ccef_6dc8_4c26_b22a_500024365925.slice/crio-ece70cd9e898fc5ce58eff51e69fa311323d7062fd87b3d8fa881b6e773be8c1 WatchSource:0}: Error finding container ece70cd9e898fc5ce58eff51e69fa311323d7062fd87b3d8fa881b6e773be8c1: Status 404 returned error can't find the container with id ece70cd9e898fc5ce58eff51e69fa311323d7062fd87b3d8fa881b6e773be8c1
Jul 29 19:45:55.175620 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.175584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp" event={"ID":"2b26ccef-6dc8-4c26-b22a-500024365925","Type":"ContainerStarted","Data":"74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68"}
Jul 29 19:45:55.176120 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.175644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp" event={"ID":"2b26ccef-6dc8-4c26-b22a-500024365925","Type":"ContainerStarted","Data":"ece70cd9e898fc5ce58eff51e69fa311323d7062fd87b3d8fa881b6e773be8c1"}
Jul 29 19:45:55.176120 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.175708    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:45:55.177286 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.177263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs" event={"ID":"d38ec69b-01fb-49a9-af0b-f46527372f34","Type":"ContainerStarted","Data":"97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59"}
Jul 29 19:45:55.177417 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.177298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs" event={"ID":"d38ec69b-01fb-49a9-af0b-f46527372f34","Type":"ContainerStarted","Data":"e9df7e541b2ae16b15f068a3742d2306df398e75f7d0b775f7d33a6739f86584"}
Jul 29 19:45:55.177417 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.177395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:45:55.204971 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:45:55.204935    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp" podStartSLOduration=1.204923009 podStartE2EDuration="1.204923009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:45:55.200131897 +0000 UTC m=+1849.117081484" watchObservedRunningTime="2026-07-29 19:45:55.204923009 +0000 UTC m=+1849.121872574"
Jul 29 19:46:06.185207 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:06.185176    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:46:06.185626 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:06.185388    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:46:06.204456 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:06.204412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs" podStartSLOduration=13.204397043 podStartE2EDuration="13.204397043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:45:55.230485477 +0000 UTC m=+1849.147435063" watchObservedRunningTime="2026-07-29 19:46:06.204397043 +0000 UTC m=+1860.121346629"
Jul 29 19:46:25.280311 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.280277    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"]
Jul 29 19:46:25.283415 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.283400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:25.286760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.286738    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:46:25.291948 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.291933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:46:25.329134 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.329115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/987b9dc9-8df8-443f-8bbd-7ad84119848b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-60d3c925-v66dn\" (UID: \"987b9dc9-8df8-443f-8bbd-7ad84119848b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:25.365328 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.365303    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"]
Jul 29 19:46:25.430082 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.430064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/987b9dc9-8df8-443f-8bbd-7ad84119848b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-60d3c925-v66dn\" (UID: \"987b9dc9-8df8-443f-8bbd-7ad84119848b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:25.430560 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.430541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/987b9dc9-8df8-443f-8bbd-7ad84119848b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-60d3c925-v66dn\" (UID: \"987b9dc9-8df8-443f-8bbd-7ad84119848b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:25.592633 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.592609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:25.712294 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:25.712256    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"]
Jul 29 19:46:25.715016 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:46:25.714989    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987b9dc9_8df8_443f_8bbd_7ad84119848b.slice/crio-819b4696ebf73362a9b9b035b518c236fb1720892a621d9418d11b869b04ef70 WatchSource:0}: Error finding container 819b4696ebf73362a9b9b035b518c236fb1720892a621d9418d11b869b04ef70: Status 404 returned error can't find the container with id 819b4696ebf73362a9b9b035b518c236fb1720892a621d9418d11b869b04ef70
Jul 29 19:46:26.322186 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:26.322152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn" event={"ID":"987b9dc9-8df8-443f-8bbd-7ad84119848b","Type":"ContainerStarted","Data":"d94c319e1aa793c74eba0ae7179152512da7d147f64db95b7d8124feb2a09ec1"}
Jul 29 19:46:26.322554 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:26.322210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn" event={"ID":"987b9dc9-8df8-443f-8bbd-7ad84119848b","Type":"ContainerStarted","Data":"819b4696ebf73362a9b9b035b518c236fb1720892a621d9418d11b869b04ef70"}
Jul 29 19:46:26.338060 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:26.337998    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn" podStartSLOduration=1.337984487 podStartE2EDuration="1.337984487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:46:26.335319153 +0000 UTC m=+1880.252268739" watchObservedRunningTime="2026-07-29 19:46:26.337984487 +0000 UTC m=+1880.254934073"
Jul 29 19:46:27.327830 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:27.327798    2576 generic.go:356] "Generic (PLEG): container finished" podID="987b9dc9-8df8-443f-8bbd-7ad84119848b" containerID="d94c319e1aa793c74eba0ae7179152512da7d147f64db95b7d8124feb2a09ec1" exitCode=0
Jul 29 19:46:27.328207 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:27.327878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn" event={"ID":"987b9dc9-8df8-443f-8bbd-7ad84119848b","Type":"ContainerDied","Data":"d94c319e1aa793c74eba0ae7179152512da7d147f64db95b7d8124feb2a09ec1"}
Jul 29 19:46:28.457839 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:28.457816    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:28.559224 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:28.559194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/987b9dc9-8df8-443f-8bbd-7ad84119848b-maas-api-service-ca\") pod \"987b9dc9-8df8-443f-8bbd-7ad84119848b\" (UID: \"987b9dc9-8df8-443f-8bbd-7ad84119848b\") "
Jul 29 19:46:28.559511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:28.559491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987b9dc9-8df8-443f-8bbd-7ad84119848b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "987b9dc9-8df8-443f-8bbd-7ad84119848b" (UID: "987b9dc9-8df8-443f-8bbd-7ad84119848b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:46:28.660056 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:28.659975    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/987b9dc9-8df8-443f-8bbd-7ad84119848b-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:46:29.338000 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:29.337967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn" event={"ID":"987b9dc9-8df8-443f-8bbd-7ad84119848b","Type":"ContainerDied","Data":"819b4696ebf73362a9b9b035b518c236fb1720892a621d9418d11b869b04ef70"}
Jul 29 19:46:29.338000 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:29.337998    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"
Jul 29 19:46:29.338220 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:29.338018    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="819b4696ebf73362a9b9b035b518c236fb1720892a621d9418d11b869b04ef70"
Jul 29 19:46:35.824459 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:35.824426    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"]
Jul 29 19:46:35.824906 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:35.824686    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp" podUID="2b26ccef-6dc8-4c26-b22a-500024365925" containerName="payload-processing" containerID="cri-o://74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68" gracePeriod=30
Jul 29 19:46:35.835301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:35.835273    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"]
Jul 29 19:46:35.835493 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:35.835473    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs" podUID="d38ec69b-01fb-49a9-af0b-f46527372f34" containerName="payload-pre-processing" containerID="cri-o://97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59" gracePeriod=30
Jul 29 19:46:36.086310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.086250    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:46:36.118282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.118255    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:46:36.121480 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.121457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghmv6\" (UniqueName: \"kubernetes.io/projected/2b26ccef-6dc8-4c26-b22a-500024365925-kube-api-access-ghmv6\") pod \"2b26ccef-6dc8-4c26-b22a-500024365925\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") "
Jul 29 19:46:36.121570 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.121554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b26ccef-6dc8-4c26-b22a-500024365925-plugins-config-volume\") pod \"2b26ccef-6dc8-4c26-b22a-500024365925\" (UID: \"2b26ccef-6dc8-4c26-b22a-500024365925\") "
Jul 29 19:46:36.121893 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.121868    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b26ccef-6dc8-4c26-b22a-500024365925-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b26ccef-6dc8-4c26-b22a-500024365925" (UID: "2b26ccef-6dc8-4c26-b22a-500024365925"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:46:36.123603 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.123580    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b26ccef-6dc8-4c26-b22a-500024365925-kube-api-access-ghmv6" (OuterVolumeSpecName: "kube-api-access-ghmv6") pod "2b26ccef-6dc8-4c26-b22a-500024365925" (UID: "2b26ccef-6dc8-4c26-b22a-500024365925"). InnerVolumeSpecName "kube-api-access-ghmv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:46:36.130534 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.130512    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"]
Jul 29 19:46:36.138652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.138628    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-60d3c925-v66dn"]
Jul 29 19:46:36.222554 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.222514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4wtd\" (UniqueName: \"kubernetes.io/projected/d38ec69b-01fb-49a9-af0b-f46527372f34-kube-api-access-v4wtd\") pod \"d38ec69b-01fb-49a9-af0b-f46527372f34\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") "
Jul 29 19:46:36.222725 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.222610    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d38ec69b-01fb-49a9-af0b-f46527372f34-plugins-config-volume\") pod \"d38ec69b-01fb-49a9-af0b-f46527372f34\" (UID: \"d38ec69b-01fb-49a9-af0b-f46527372f34\") "
Jul 29 19:46:36.222835 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.222818    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b26ccef-6dc8-4c26-b22a-500024365925-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.222872 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.222841    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghmv6\" (UniqueName: \"kubernetes.io/projected/2b26ccef-6dc8-4c26-b22a-500024365925-kube-api-access-ghmv6\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.223002 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.222983    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d38ec69b-01fb-49a9-af0b-f46527372f34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d38ec69b-01fb-49a9-af0b-f46527372f34" (UID: "d38ec69b-01fb-49a9-af0b-f46527372f34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:46:36.224574 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.224543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38ec69b-01fb-49a9-af0b-f46527372f34-kube-api-access-v4wtd" (OuterVolumeSpecName: "kube-api-access-v4wtd") pod "d38ec69b-01fb-49a9-af0b-f46527372f34" (UID: "d38ec69b-01fb-49a9-af0b-f46527372f34"). InnerVolumeSpecName "kube-api-access-v4wtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:46:36.323895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.323858    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4wtd\" (UniqueName: \"kubernetes.io/projected/d38ec69b-01fb-49a9-af0b-f46527372f34-kube-api-access-v4wtd\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.323895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.323892    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d38ec69b-01fb-49a9-af0b-f46527372f34-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.371877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.371797    2576 generic.go:356] "Generic (PLEG): container finished" podID="d38ec69b-01fb-49a9-af0b-f46527372f34" containerID="97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59" exitCode=0
Jul 29 19:46:36.371877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.371839    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"
Jul 29 19:46:36.372072 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.371884    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs" event={"ID":"d38ec69b-01fb-49a9-af0b-f46527372f34","Type":"ContainerDied","Data":"97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59"}
Jul 29 19:46:36.372072 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.371934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs" event={"ID":"d38ec69b-01fb-49a9-af0b-f46527372f34","Type":"ContainerDied","Data":"e9df7e541b2ae16b15f068a3742d2306df398e75f7d0b775f7d33a6739f86584"}
Jul 29 19:46:36.372072 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.371961    2576 scope.go:117] "RemoveContainer" containerID="97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59"
Jul 29 19:46:36.373221 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.373200    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b26ccef-6dc8-4c26-b22a-500024365925" containerID="74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68" exitCode=0
Jul 29 19:46:36.373308 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.373247    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"
Jul 29 19:46:36.373308 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.373275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp" event={"ID":"2b26ccef-6dc8-4c26-b22a-500024365925","Type":"ContainerDied","Data":"74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68"}
Jul 29 19:46:36.373386 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.373329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp" event={"ID":"2b26ccef-6dc8-4c26-b22a-500024365925","Type":"ContainerDied","Data":"ece70cd9e898fc5ce58eff51e69fa311323d7062fd87b3d8fa881b6e773be8c1"}
Jul 29 19:46:36.380664 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.380650    2576 scope.go:117] "RemoveContainer" containerID="97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59"
Jul 29 19:46:36.380921 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:46:36.380904    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59\": container with ID starting with 97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59 not found: ID does not exist" containerID="97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59"
Jul 29 19:46:36.380992 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.380928    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59"} err="failed to get container status \"97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59\": rpc error: code = NotFound desc = could not find container \"97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59\": container with ID starting with 97e357dc667bb2bf4b4c85280035e039c64021845f6b2924f5c8e5fd92426e59 not found: ID does not exist"
Jul 29 19:46:36.380992 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.380944    2576 scope.go:117] "RemoveContainer" containerID="74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68"
Jul 29 19:46:36.388767 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.388753    2576 scope.go:117] "RemoveContainer" containerID="74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68"
Jul 29 19:46:36.389041 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:46:36.389003    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68\": container with ID starting with 74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68 not found: ID does not exist" containerID="74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68"
Jul 29 19:46:36.389151 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.389070    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68"} err="failed to get container status \"74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68\": rpc error: code = NotFound desc = could not find container \"74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68\": container with ID starting with 74a238e2dbbeb3c26c3c895dd5d9a53e384945af92edd85f6a7fc27a69573c68 not found: ID does not exist"
Jul 29 19:46:36.399112 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.399089    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"]
Jul 29 19:46:36.411380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.409463    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-60d3c925-96db7746-6trnp"]
Jul 29 19:46:36.421155 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.421132    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"]
Jul 29 19:46:36.427275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.427254    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-60d3c925-6b9c65bf56-ttfrs"]
Jul 29 19:46:36.672869 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.672792    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b26ccef-6dc8-4c26-b22a-500024365925" path="/var/lib/kubelet/pods/2b26ccef-6dc8-4c26-b22a-500024365925/volumes"
Jul 29 19:46:36.673157 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.673143    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="987b9dc9-8df8-443f-8bbd-7ad84119848b" path="/var/lib/kubelet/pods/987b9dc9-8df8-443f-8bbd-7ad84119848b/volumes"
Jul 29 19:46:36.673465 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:46:36.673453    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38ec69b-01fb-49a9-af0b-f46527372f34" path="/var/lib/kubelet/pods/d38ec69b-01fb-49a9-af0b-f46527372f34/volumes"
Jul 29 19:47:06.978534 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978453    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"]
Jul 29 19:47:06.978922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978823    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b26ccef-6dc8-4c26-b22a-500024365925" containerName="payload-processing"
Jul 29 19:47:06.978922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978835    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b26ccef-6dc8-4c26-b22a-500024365925" containerName="payload-processing"
Jul 29 19:47:06.978922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978865    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987b9dc9-8df8-443f-8bbd-7ad84119848b" containerName="revoke-keys"
Jul 29 19:47:06.978922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978872    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="987b9dc9-8df8-443f-8bbd-7ad84119848b" containerName="revoke-keys"
Jul 29 19:47:06.978922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978882    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38ec69b-01fb-49a9-af0b-f46527372f34" containerName="payload-pre-processing"
Jul 29 19:47:06.978922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978889    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38ec69b-01fb-49a9-af0b-f46527372f34" containerName="payload-pre-processing"
Jul 29 19:47:06.979135 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978944    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="987b9dc9-8df8-443f-8bbd-7ad84119848b" containerName="revoke-keys"
Jul 29 19:47:06.979135 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978955    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38ec69b-01fb-49a9-af0b-f46527372f34" containerName="payload-pre-processing"
Jul 29 19:47:06.979135 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.978962    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b26ccef-6dc8-4c26-b22a-500024365925" containerName="payload-processing"
Jul 29 19:47:06.983631 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.983608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:06.986274 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.986246    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b20ef80a\""
Jul 29 19:47:06.986411 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:06.986362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b20ef80a-dockercfg-4jhsm\""
Jul 29 19:47:07.000269 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.000240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"]
Jul 29 19:47:07.009596 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.009568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjbk\" (UniqueName: \"kubernetes.io/projected/c6aaa641-981a-4b2e-9c75-8db33b200ac3-kube-api-access-xpjbk\") pod \"payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") " pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.009742 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.009618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6aaa641-981a-4b2e-9c75-8db33b200ac3-plugins-config-volume\") pod \"payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") " pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.040912 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.040876    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"]
Jul 29 19:47:07.044110 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.044093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.053714 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.053688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"]
Jul 29 19:47:07.110615 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.110578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9ls\" (UniqueName: \"kubernetes.io/projected/db2614ba-0bec-4272-af58-e71639b56270-kube-api-access-5j9ls\") pod \"payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.110781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.110644    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjbk\" (UniqueName: \"kubernetes.io/projected/c6aaa641-981a-4b2e-9c75-8db33b200ac3-kube-api-access-xpjbk\") pod \"payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") " pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.110781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.110681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2614ba-0bec-4272-af58-e71639b56270-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.110781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.110705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6aaa641-981a-4b2e-9c75-8db33b200ac3-plugins-config-volume\") pod \"payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") " pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.111404 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.111386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6aaa641-981a-4b2e-9c75-8db33b200ac3-plugins-config-volume\") pod \"payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") " pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.118806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.118784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjbk\" (UniqueName: \"kubernetes.io/projected/c6aaa641-981a-4b2e-9c75-8db33b200ac3-kube-api-access-xpjbk\") pod \"payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") " pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.211543 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.211503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2614ba-0bec-4272-af58-e71639b56270-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.211741 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.211594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9ls\" (UniqueName: \"kubernetes.io/projected/db2614ba-0bec-4272-af58-e71639b56270-kube-api-access-5j9ls\") pod \"payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.212323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.212301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2614ba-0bec-4272-af58-e71639b56270-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.219553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.219525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9ls\" (UniqueName: \"kubernetes.io/projected/db2614ba-0bec-4272-af58-e71639b56270-kube-api-access-5j9ls\") pod \"payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.295681 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.295592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:07.355116 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.355082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:07.437955 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.437921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"]
Jul 29 19:47:07.441641 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:47:07.441605    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6aaa641_981a_4b2e_9c75_8db33b200ac3.slice/crio-cac416430cb137084e8614e93e601e995ac84e5f5e658eb66eb30b4547126854 WatchSource:0}: Error finding container cac416430cb137084e8614e93e601e995ac84e5f5e658eb66eb30b4547126854: Status 404 returned error can't find the container with id cac416430cb137084e8614e93e601e995ac84e5f5e658eb66eb30b4547126854
Jul 29 19:47:07.499358 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.499333    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"]
Jul 29 19:47:07.502160 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:47:07.502134    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2614ba_0bec_4272_af58_e71639b56270.slice/crio-041761c92a4e861a35ec071c471180b939ebe3a1ce485d792f8d38d6f77e4194 WatchSource:0}: Error finding container 041761c92a4e861a35ec071c471180b939ebe3a1ce485d792f8d38d6f77e4194: Status 404 returned error can't find the container with id 041761c92a4e861a35ec071c471180b939ebe3a1ce485d792f8d38d6f77e4194
Jul 29 19:47:07.520730 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.520698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c" event={"ID":"c6aaa641-981a-4b2e-9c75-8db33b200ac3","Type":"ContainerStarted","Data":"ded39531e75e0f144fac423c39367ce3dc5efca161ff6efe31efa45080c5e0c9"}
Jul 29 19:47:07.520843 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.520760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c" event={"ID":"c6aaa641-981a-4b2e-9c75-8db33b200ac3","Type":"ContainerStarted","Data":"cac416430cb137084e8614e93e601e995ac84e5f5e658eb66eb30b4547126854"}
Jul 29 19:47:07.522077 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:07.522052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds" event={"ID":"db2614ba-0bec-4272-af58-e71639b56270","Type":"ContainerStarted","Data":"041761c92a4e861a35ec071c471180b939ebe3a1ce485d792f8d38d6f77e4194"}
Jul 29 19:47:08.531885 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:08.531841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds" event={"ID":"db2614ba-0bec-4272-af58-e71639b56270","Type":"ContainerStarted","Data":"e202a0b18a204c27805c9adadc878f571000e26c85a6d6c7ecbeae5430379a52"}
Jul 29 19:47:08.532347 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:08.531954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:08.548629 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:08.548573    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds" podStartSLOduration=1.548554927 podStartE2EDuration="1.548554927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:47:08.546349283 +0000 UTC m=+1922.463298871" watchObservedRunningTime="2026-07-29 19:47:08.548554927 +0000 UTC m=+1922.465504506"
Jul 29 19:47:09.536626 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:09.536583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:19.538962 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:19.538930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:47:19.559435 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:19.559378    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c" podStartSLOduration=13.559361105 podStartE2EDuration="13.559361105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:47:08.561808434 +0000 UTC m=+1922.478758023" watchObservedRunningTime="2026-07-29 19:47:19.559361105 +0000 UTC m=+1933.476310693"
Jul 29 19:47:20.543660 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:20.543627    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:47:34.722507 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.722464    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"]
Jul 29 19:47:34.726123 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.726103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.728917 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.728890    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b20ef80a\"/\"default-dockercfg-79rqz\""
Jul 29 19:47:34.729091 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.728893    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b20ef80a\"/\"openshift-service-ca.crt\""
Jul 29 19:47:34.729091 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.728893    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b20ef80a\"/\"e2e-lifecycle-model-b20ef80a-kserve-self-signed-certs\""
Jul 29 19:47:34.729091 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.728957    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b20ef80a\"/\"kube-root-ca.crt\""
Jul 29 19:47:34.734688 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.734666    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"]
Jul 29 19:47:34.872979 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.872939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-dshm\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.873166 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.872998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-home\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.873166 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.873108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-model-cache\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.873166 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.873158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tmp-dir\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.873300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.873186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tls-certs\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.873300 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.873211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6x8r\" (UniqueName: \"kubernetes.io/projected/f2099cb8-d006-4c0c-9e00-2e2fca21e164-kube-api-access-x6x8r\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.974623 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.974575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-dshm\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.974623 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.974633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-home\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.974899 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.974763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-model-cache\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.974899 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.974807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tmp-dir\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.974899 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.974838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tls-certs\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.974899 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.974880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6x8r\" (UniqueName: \"kubernetes.io/projected/f2099cb8-d006-4c0c-9e00-2e2fca21e164-kube-api-access-x6x8r\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.975213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.975062    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-home\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.975213 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.975127    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-model-cache\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.975313 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.975237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tmp-dir\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.976856 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.976837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-dshm\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.977214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.977197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tls-certs\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:34.984296 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:34.984224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6x8r\" (UniqueName: \"kubernetes.io/projected/f2099cb8-d006-4c0c-9e00-2e2fca21e164-kube-api-access-x6x8r\") pod \"e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") " pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:35.037017 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:35.036965    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:35.172539 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:35.172463    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"]
Jul 29 19:47:35.175214 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:47:35.175187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2099cb8_d006_4c0c_9e00_2e2fca21e164.slice/crio-58565f6d354ac2795b3eeb8f7e5bc6e2dcb46d3b8b356cfd40bbb41310bb4ae7 WatchSource:0}: Error finding container 58565f6d354ac2795b3eeb8f7e5bc6e2dcb46d3b8b356cfd40bbb41310bb4ae7: Status 404 returned error can't find the container with id 58565f6d354ac2795b3eeb8f7e5bc6e2dcb46d3b8b356cfd40bbb41310bb4ae7
Jul 29 19:47:35.668569 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:35.668527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn" event={"ID":"f2099cb8-d006-4c0c-9e00-2e2fca21e164","Type":"ContainerStarted","Data":"5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469"}
Jul 29 19:47:35.668569 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:35.668569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn" event={"ID":"f2099cb8-d006-4c0c-9e00-2e2fca21e164","Type":"ContainerStarted","Data":"58565f6d354ac2795b3eeb8f7e5bc6e2dcb46d3b8b356cfd40bbb41310bb4ae7"}
Jul 29 19:47:35.701747 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:35.701667    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn" podStartSLOduration=1.701648278 podStartE2EDuration="1.701648278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:47:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:47:35.700315054 +0000 UTC m=+1949.617264643" watchObservedRunningTime="2026-07-29 19:47:35.701648278 +0000 UTC m=+1949.618597866"
Jul 29 19:47:45.037177 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:45.037144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:45.037650 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:45.037195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:45.049918 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:45.049894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:47:45.733791 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:47:45.733761    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:48:06.725342 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:06.725255    2576 scope.go:117] "RemoveContainer" containerID="61d1ad0225d034aec559700982a27dca92650d724cfdb628d06c61afc65c9149"
Jul 29 19:48:10.587608 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.587573    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"]
Jul 29 19:48:10.588049 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.587837    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c" podUID="c6aaa641-981a-4b2e-9c75-8db33b200ac3" containerName="payload-processing" containerID="cri-o://ded39531e75e0f144fac423c39367ce3dc5efca161ff6efe31efa45080c5e0c9" gracePeriod=30
Jul 29 19:48:10.596274 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.596248    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"]
Jul 29 19:48:10.596512 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.596480    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds" podUID="db2614ba-0bec-4272-af58-e71639b56270" containerName="payload-pre-processing" containerID="cri-o://e202a0b18a204c27805c9adadc878f571000e26c85a6d6c7ecbeae5430379a52" gracePeriod=30
Jul 29 19:48:10.854292 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.854255    2576 generic.go:356] "Generic (PLEG): container finished" podID="db2614ba-0bec-4272-af58-e71639b56270" containerID="e202a0b18a204c27805c9adadc878f571000e26c85a6d6c7ecbeae5430379a52" exitCode=0
Jul 29 19:48:10.854407 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.854321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds" event={"ID":"db2614ba-0bec-4272-af58-e71639b56270","Type":"ContainerDied","Data":"e202a0b18a204c27805c9adadc878f571000e26c85a6d6c7ecbeae5430379a52"}
Jul 29 19:48:10.855773 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.855747    2576 generic.go:356] "Generic (PLEG): container finished" podID="c6aaa641-981a-4b2e-9c75-8db33b200ac3" containerID="ded39531e75e0f144fac423c39367ce3dc5efca161ff6efe31efa45080c5e0c9" exitCode=0
Jul 29 19:48:10.855895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.855793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c" event={"ID":"c6aaa641-981a-4b2e-9c75-8db33b200ac3","Type":"ContainerDied","Data":"ded39531e75e0f144fac423c39367ce3dc5efca161ff6efe31efa45080c5e0c9"}
Jul 29 19:48:10.855895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.855839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c" event={"ID":"c6aaa641-981a-4b2e-9c75-8db33b200ac3","Type":"ContainerDied","Data":"cac416430cb137084e8614e93e601e995ac84e5f5e658eb66eb30b4547126854"}
Jul 29 19:48:10.855895 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.855864    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cac416430cb137084e8614e93e601e995ac84e5f5e658eb66eb30b4547126854"
Jul 29 19:48:10.870400 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.870378    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:48:10.873397 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:10.873379    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:48:11.003583 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.003546    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6aaa641-981a-4b2e-9c75-8db33b200ac3-plugins-config-volume\") pod \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") "
Jul 29 19:48:11.003772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.003612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpjbk\" (UniqueName: \"kubernetes.io/projected/c6aaa641-981a-4b2e-9c75-8db33b200ac3-kube-api-access-xpjbk\") pod \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\" (UID: \"c6aaa641-981a-4b2e-9c75-8db33b200ac3\") "
Jul 29 19:48:11.003772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.003663    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2614ba-0bec-4272-af58-e71639b56270-plugins-config-volume\") pod \"db2614ba-0bec-4272-af58-e71639b56270\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") "
Jul 29 19:48:11.003772 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.003688    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j9ls\" (UniqueName: \"kubernetes.io/projected/db2614ba-0bec-4272-af58-e71639b56270-kube-api-access-5j9ls\") pod \"db2614ba-0bec-4272-af58-e71639b56270\" (UID: \"db2614ba-0bec-4272-af58-e71639b56270\") "
Jul 29 19:48:11.004040 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.003993    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6aaa641-981a-4b2e-9c75-8db33b200ac3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6aaa641-981a-4b2e-9c75-8db33b200ac3" (UID: "c6aaa641-981a-4b2e-9c75-8db33b200ac3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:48:11.004176 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.004050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db2614ba-0bec-4272-af58-e71639b56270-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db2614ba-0bec-4272-af58-e71639b56270" (UID: "db2614ba-0bec-4272-af58-e71639b56270"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:48:11.005731 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.005701    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6aaa641-981a-4b2e-9c75-8db33b200ac3-kube-api-access-xpjbk" (OuterVolumeSpecName: "kube-api-access-xpjbk") pod "c6aaa641-981a-4b2e-9c75-8db33b200ac3" (UID: "c6aaa641-981a-4b2e-9c75-8db33b200ac3"). InnerVolumeSpecName "kube-api-access-xpjbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:48:11.005905 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.005876    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2614ba-0bec-4272-af58-e71639b56270-kube-api-access-5j9ls" (OuterVolumeSpecName: "kube-api-access-5j9ls") pod "db2614ba-0bec-4272-af58-e71639b56270" (UID: "db2614ba-0bec-4272-af58-e71639b56270"). InnerVolumeSpecName "kube-api-access-5j9ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:48:11.105472 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.105376    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2614ba-0bec-4272-af58-e71639b56270-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:11.105472 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.105416    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j9ls\" (UniqueName: \"kubernetes.io/projected/db2614ba-0bec-4272-af58-e71639b56270-kube-api-access-5j9ls\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:11.105472 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.105430    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6aaa641-981a-4b2e-9c75-8db33b200ac3-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:11.105472 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.105442    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpjbk\" (UniqueName: \"kubernetes.io/projected/c6aaa641-981a-4b2e-9c75-8db33b200ac3-kube-api-access-xpjbk\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:11.862275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.862238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds" event={"ID":"db2614ba-0bec-4272-af58-e71639b56270","Type":"ContainerDied","Data":"041761c92a4e861a35ec071c471180b939ebe3a1ce485d792f8d38d6f77e4194"}
Jul 29 19:48:11.862748 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.862310    2576 scope.go:117] "RemoveContainer" containerID="e202a0b18a204c27805c9adadc878f571000e26c85a6d6c7ecbeae5430379a52"
Jul 29 19:48:11.862748 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.862256    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"
Jul 29 19:48:11.862748 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.862256    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"
Jul 29 19:48:11.889681 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.889642    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"]
Jul 29 19:48:11.894366 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.894333    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b20ef80a-77fcd6c84d-wlcds"]
Jul 29 19:48:11.905447 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.905413    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"]
Jul 29 19:48:11.909965 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:11.909933    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b20ef80a-dd556464b-mwq2c"]
Jul 29 19:48:12.672134 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:12.672103    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6aaa641-981a-4b2e-9c75-8db33b200ac3" path="/var/lib/kubelet/pods/c6aaa641-981a-4b2e-9c75-8db33b200ac3/volumes"
Jul 29 19:48:12.672471 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:12.672457    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db2614ba-0bec-4272-af58-e71639b56270" path="/var/lib/kubelet/pods/db2614ba-0bec-4272-af58-e71639b56270/volumes"
Jul 29 19:48:18.868822 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:18.868784    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"]
Jul 29 19:48:33.888093 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:33.888037    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn" podUID="f2099cb8-d006-4c0c-9e00-2e2fca21e164" containerName="main" containerID="cri-o://5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469" gracePeriod=45
Jul 29 19:48:34.137347 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.137322    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:48:34.313086 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313053    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-model-cache\") pod \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") "
Jul 29 19:48:34.313282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313097    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tmp-dir\") pod \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") "
Jul 29 19:48:34.313282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tls-certs\") pod \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") "
Jul 29 19:48:34.313282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313167    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-dshm\") pod \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") "
Jul 29 19:48:34.313282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-home\") pod \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") "
Jul 29 19:48:34.313282 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313275    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6x8r\" (UniqueName: \"kubernetes.io/projected/f2099cb8-d006-4c0c-9e00-2e2fca21e164-kube-api-access-x6x8r\") pod \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\" (UID: \"f2099cb8-d006-4c0c-9e00-2e2fca21e164\") "
Jul 29 19:48:34.313544 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313393    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-model-cache" (OuterVolumeSpecName: "model-cache") pod "f2099cb8-d006-4c0c-9e00-2e2fca21e164" (UID: "f2099cb8-d006-4c0c-9e00-2e2fca21e164"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:48:34.313544 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313403    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f2099cb8-d006-4c0c-9e00-2e2fca21e164" (UID: "f2099cb8-d006-4c0c-9e00-2e2fca21e164"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:48:34.313544 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313520    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-home" (OuterVolumeSpecName: "home") pod "f2099cb8-d006-4c0c-9e00-2e2fca21e164" (UID: "f2099cb8-d006-4c0c-9e00-2e2fca21e164"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:48:34.313711 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313615    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:34.313711 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313628    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:34.313711 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.313637    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:34.315517 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.315489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-dshm" (OuterVolumeSpecName: "dshm") pod "f2099cb8-d006-4c0c-9e00-2e2fca21e164" (UID: "f2099cb8-d006-4c0c-9e00-2e2fca21e164"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:48:34.315629 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.315519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2099cb8-d006-4c0c-9e00-2e2fca21e164" (UID: "f2099cb8-d006-4c0c-9e00-2e2fca21e164"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:48:34.315629 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.315598    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2099cb8-d006-4c0c-9e00-2e2fca21e164-kube-api-access-x6x8r" (OuterVolumeSpecName: "kube-api-access-x6x8r") pod "f2099cb8-d006-4c0c-9e00-2e2fca21e164" (UID: "f2099cb8-d006-4c0c-9e00-2e2fca21e164"). InnerVolumeSpecName "kube-api-access-x6x8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:48:34.414449 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.414397    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2099cb8-d006-4c0c-9e00-2e2fca21e164-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:34.414449 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.414442    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2099cb8-d006-4c0c-9e00-2e2fca21e164-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:34.414449 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.414453    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6x8r\" (UniqueName: \"kubernetes.io/projected/f2099cb8-d006-4c0c-9e00-2e2fca21e164-kube-api-access-x6x8r\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:48:34.975100 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.974992    2576 generic.go:356] "Generic (PLEG): container finished" podID="f2099cb8-d006-4c0c-9e00-2e2fca21e164" containerID="5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469" exitCode=0
Jul 29 19:48:34.975100 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.975074    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"
Jul 29 19:48:34.975100 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.975081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn" event={"ID":"f2099cb8-d006-4c0c-9e00-2e2fca21e164","Type":"ContainerDied","Data":"5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469"}
Jul 29 19:48:34.975683 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.975143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn" event={"ID":"f2099cb8-d006-4c0c-9e00-2e2fca21e164","Type":"ContainerDied","Data":"58565f6d354ac2795b3eeb8f7e5bc6e2dcb46d3b8b356cfd40bbb41310bb4ae7"}
Jul 29 19:48:34.975683 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.975168    2576 scope.go:117] "RemoveContainer" containerID="5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469"
Jul 29 19:48:34.983845 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.983827    2576 scope.go:117] "RemoveContainer" containerID="5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469"
Jul 29 19:48:34.984104 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:48:34.984083    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469\": container with ID starting with 5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469 not found: ID does not exist" containerID="5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469"
Jul 29 19:48:34.984169 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.984113    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469"} err="failed to get container status \"5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469\": rpc error: code = NotFound desc = could not find container \"5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469\": container with ID starting with 5250f910eb6aafcac344d3ec981062fd53aaf37185e6d9fb8c48c1e4edcf3469 not found: ID does not exist"
Jul 29 19:48:34.990736 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.990713    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"]
Jul 29 19:48:34.995594 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:34.995570    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b20ef80a/e2e-lifecycle-model-b20ef80a-kserve-7dc4b9cb7f-9j4tn"]
Jul 29 19:48:36.671906 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:48:36.671871    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2099cb8-d006-4c0c-9e00-2e2fca21e164" path="/var/lib/kubelet/pods/f2099cb8-d006-4c0c-9e00-2e2fca21e164/volumes"
Jul 29 19:49:06.743870 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:49:06.743833    2576 scope.go:117] "RemoveContainer" containerID="3f7f1e64118eaba7215aff7f65586e625a3a30c95b9fdae2362bd1e43a68c887"
Jul 29 19:50:06.637113 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:06.637085    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:50:06.639227 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:06.639203    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:50:06.772100 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:06.772071    2576 scope.go:117] "RemoveContainer" containerID="c9975cb676c0374a8a3c1445fd6757918a0ca519d46f35c1ae8c2763a3ec2cfb"
Jul 29 19:50:06.779921 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:06.779900    2576 scope.go:117] "RemoveContainer" containerID="f73b4a3a4a390bd4b18a2afc663e28f35e2b991539d07073761f383b7792cdaa"
Jul 29 19:50:09.074528 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074495    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"]
Jul 29 19:50:09.074878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074820    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6aaa641-981a-4b2e-9c75-8db33b200ac3" containerName="payload-processing"
Jul 29 19:50:09.074878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074831    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6aaa641-981a-4b2e-9c75-8db33b200ac3" containerName="payload-processing"
Jul 29 19:50:09.074878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074849    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2099cb8-d006-4c0c-9e00-2e2fca21e164" containerName="main"
Jul 29 19:50:09.074878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074855    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2099cb8-d006-4c0c-9e00-2e2fca21e164" containerName="main"
Jul 29 19:50:09.074878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074866    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db2614ba-0bec-4272-af58-e71639b56270" containerName="payload-pre-processing"
Jul 29 19:50:09.074878 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074872    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2614ba-0bec-4272-af58-e71639b56270" containerName="payload-pre-processing"
Jul 29 19:50:09.075104 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074930    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="db2614ba-0bec-4272-af58-e71639b56270" containerName="payload-pre-processing"
Jul 29 19:50:09.075104 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074940    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6aaa641-981a-4b2e-9c75-8db33b200ac3" containerName="payload-processing"
Jul 29 19:50:09.075104 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.074947    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2099cb8-d006-4c0c-9e00-2e2fca21e164" containerName="main"
Jul 29 19:50:09.079368 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.079349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.081669 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.081651    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-4d9536-dockercfg-hw6rr\""
Jul 29 19:50:09.081888 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.081875    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-4d9536\""
Jul 29 19:50:09.087597 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.087576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"]
Jul 29 19:50:09.129112 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.129091    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"]
Jul 29 19:50:09.132214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.132197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.142639 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.142622    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"]
Jul 29 19:50:09.163397 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.163362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79mbf\" (UniqueName: \"kubernetes.io/projected/b42e8f99-0415-4a7c-927f-7f59ae33cd83-kube-api-access-79mbf\") pod \"payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.163495 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.163453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42e8f99-0415-4a7c-927f-7f59ae33cd83-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.264211 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.264183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42e8f99-0415-4a7c-927f-7f59ae33cd83-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.264336 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.264229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.264407 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.264339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79mbf\" (UniqueName: \"kubernetes.io/projected/b42e8f99-0415-4a7c-927f-7f59ae33cd83-kube-api-access-79mbf\") pod \"payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.264504 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.264481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q42lk\" (UniqueName: \"kubernetes.io/projected/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-kube-api-access-q42lk\") pod \"payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.265064 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.265039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42e8f99-0415-4a7c-927f-7f59ae33cd83-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.272860 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.272838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79mbf\" (UniqueName: \"kubernetes.io/projected/b42e8f99-0415-4a7c-927f-7f59ae33cd83-kube-api-access-79mbf\") pod \"payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.365802 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.365742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.365905 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.365821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q42lk\" (UniqueName: \"kubernetes.io/projected/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-kube-api-access-q42lk\") pod \"payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.366520 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.366502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.373290 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.373271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q42lk\" (UniqueName: \"kubernetes.io/projected/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-kube-api-access-q42lk\") pod \"payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.390068 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.390046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:09.442374 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.442350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:09.604146 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.604123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"]
Jul 29 19:50:09.606822 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:50:09.606793    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42e8f99_0415_4a7c_927f_7f59ae33cd83.slice/crio-304c4f510989c7dd09c0ba10a585f815705964f4c5e49f6df36779f69d7f8196 WatchSource:0}: Error finding container 304c4f510989c7dd09c0ba10a585f815705964f4c5e49f6df36779f69d7f8196: Status 404 returned error can't find the container with id 304c4f510989c7dd09c0ba10a585f815705964f4c5e49f6df36779f69d7f8196
Jul 29 19:50:09.730408 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:09.730380    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"]
Jul 29 19:50:09.732822 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:50:09.732797    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed476fb_941a_4d82_9cec_2cc90c80b7d9.slice/crio-77b5d48e42b550309190197ca9715fe81ec6db6257adf8347d8c6dc9a0132d6e WatchSource:0}: Error finding container 77b5d48e42b550309190197ca9715fe81ec6db6257adf8347d8c6dc9a0132d6e: Status 404 returned error can't find the container with id 77b5d48e42b550309190197ca9715fe81ec6db6257adf8347d8c6dc9a0132d6e
Jul 29 19:50:10.438215 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.438180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s" event={"ID":"5ed476fb-941a-4d82-9cec-2cc90c80b7d9","Type":"ContainerStarted","Data":"0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e"}
Jul 29 19:50:10.438646 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.438237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s" event={"ID":"5ed476fb-941a-4d82-9cec-2cc90c80b7d9","Type":"ContainerStarted","Data":"77b5d48e42b550309190197ca9715fe81ec6db6257adf8347d8c6dc9a0132d6e"}
Jul 29 19:50:10.438646 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.438273    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:10.439835 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.439812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn" event={"ID":"b42e8f99-0415-4a7c-927f-7f59ae33cd83","Type":"ContainerStarted","Data":"c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841"}
Jul 29 19:50:10.439966 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.439856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn" event={"ID":"b42e8f99-0415-4a7c-927f-7f59ae33cd83","Type":"ContainerStarted","Data":"304c4f510989c7dd09c0ba10a585f815705964f4c5e49f6df36779f69d7f8196"}
Jul 29 19:50:10.439966 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.439948    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:10.453557 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.453507    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s" podStartSLOduration=1.453490688 podStartE2EDuration="1.453490688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:10.452802919 +0000 UTC m=+2104.369752506" watchObservedRunningTime="2026-07-29 19:50:10.453490688 +0000 UTC m=+2104.370440278"
Jul 29 19:50:10.469403 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:10.469331    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn" podStartSLOduration=1.46931397 podStartE2EDuration="1.46931397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:10.469042491 +0000 UTC m=+2104.385992079" watchObservedRunningTime="2026-07-29 19:50:10.46931397 +0000 UTC m=+2104.386263560"
Jul 29 19:50:21.446789 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:21.446758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:50:21.447240 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:21.447072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:50:37.083255 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.083225    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"]
Jul 29 19:50:37.086763 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.086743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.088697 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.088671    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-5c1453\""
Jul 29 19:50:37.088929 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.088912    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-5c1453-dockercfg-x5k5t\""
Jul 29 19:50:37.098135 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.098113    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"]
Jul 29 19:50:37.149726 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.149704    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"]
Jul 29 19:50:37.153145 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.153130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.161985 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.161956    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"]
Jul 29 19:50:37.195189 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.195163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040199a2-b867-45e0-8137-f2a43f5add11-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.195295 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.195227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ztcw\" (UniqueName: \"kubernetes.io/projected/040199a2-b867-45e0-8137-f2a43f5add11-kube-api-access-9ztcw\") pod \"payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.296254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.296231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.296442 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.296261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd4pg\" (UniqueName: \"kubernetes.io/projected/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-kube-api-access-dd4pg\") pod \"payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.296442 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.296291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040199a2-b867-45e0-8137-f2a43f5add11-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.296442 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.296416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ztcw\" (UniqueName: \"kubernetes.io/projected/040199a2-b867-45e0-8137-f2a43f5add11-kube-api-access-9ztcw\") pod \"payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.296934 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.296915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040199a2-b867-45e0-8137-f2a43f5add11-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.303457 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.303438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ztcw\" (UniqueName: \"kubernetes.io/projected/040199a2-b867-45e0-8137-f2a43f5add11-kube-api-access-9ztcw\") pod \"payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.396861 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.396804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.396861 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.396831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd4pg\" (UniqueName: \"kubernetes.io/projected/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-kube-api-access-dd4pg\") pod \"payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.397195 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.397182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:37.397483 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.397466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.404709 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.404684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd4pg\" (UniqueName: \"kubernetes.io/projected/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-kube-api-access-dd4pg\") pod \"payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.464423 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.464358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:37.528481 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.528452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"]
Jul 29 19:50:37.533211 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:50:37.533158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040199a2_b867_45e0_8137_f2a43f5add11.slice/crio-8b24250a6ede9d41cb874fa40d6afeedbd796fedab87d843c757a2873d336b61 WatchSource:0}: Error finding container 8b24250a6ede9d41cb874fa40d6afeedbd796fedab87d843c757a2873d336b61: Status 404 returned error can't find the container with id 8b24250a6ede9d41cb874fa40d6afeedbd796fedab87d843c757a2873d336b61
Jul 29 19:50:37.568554 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.568529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb" event={"ID":"040199a2-b867-45e0-8137-f2a43f5add11","Type":"ContainerStarted","Data":"8b24250a6ede9d41cb874fa40d6afeedbd796fedab87d843c757a2873d336b61"}
Jul 29 19:50:37.824320 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:37.824282    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"]
Jul 29 19:50:37.826209 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:50:37.826176    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d18cde_a07a_4eac_8c44_9ba8f4c39191.slice/crio-1221288b99d5b97961d775b92000dba1eddfab3be34ce0ff97ca70d338660692 WatchSource:0}: Error finding container 1221288b99d5b97961d775b92000dba1eddfab3be34ce0ff97ca70d338660692: Status 404 returned error can't find the container with id 1221288b99d5b97961d775b92000dba1eddfab3be34ce0ff97ca70d338660692
Jul 29 19:50:38.574569 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.574536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k" event={"ID":"f6d18cde-a07a-4eac-8c44-9ba8f4c39191","Type":"ContainerStarted","Data":"c0270d13bb39b8cad5f2e7848fb0d385a997c1cb5969b07660e1b5b5dd364340"}
Jul 29 19:50:38.575075 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.574598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:50:38.575075 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.574622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k" event={"ID":"f6d18cde-a07a-4eac-8c44-9ba8f4c39191","Type":"ContainerStarted","Data":"1221288b99d5b97961d775b92000dba1eddfab3be34ce0ff97ca70d338660692"}
Jul 29 19:50:38.576147 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.576121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb" event={"ID":"040199a2-b867-45e0-8137-f2a43f5add11","Type":"ContainerStarted","Data":"b5a981c47d0dbd2cf18309e6d6fb346ba48644429473e07e2b2861b60c55836e"}
Jul 29 19:50:38.576256 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.576230    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:38.602343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.602300    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k" podStartSLOduration=1.602281483 podStartE2EDuration="1.602281483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:38.601139778 +0000 UTC m=+2132.518089377" watchObservedRunningTime="2026-07-29 19:50:38.602281483 +0000 UTC m=+2132.519231074"
Jul 29 19:50:38.629499 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:38.625334    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb" podStartSLOduration=1.625316417 podStartE2EDuration="1.625316417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:38.622530314 +0000 UTC m=+2132.539479902" watchObservedRunningTime="2026-07-29 19:50:38.625316417 +0000 UTC m=+2132.542266006"
Jul 29 19:50:49.583361 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:49.583326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:50:49.583777 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:50:49.583490    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:51:07.724545 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.724475    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"]
Jul 29 19:51:07.728188 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.728172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.730809 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.730777    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4d9536\"/\"kube-root-ca.crt\""
Jul 29 19:51:07.730809 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.730787    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4d9536\"/\"openshift-service-ca.crt\""
Jul 29 19:51:07.731008 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.730814    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4d9536\"/\"default-dockercfg-q28xl\""
Jul 29 19:51:07.731091 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.731052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4d9536\"/\"test-model-4d9536-kserve-self-signed-certs\""
Jul 29 19:51:07.737903 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.737183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"]
Jul 29 19:51:07.763350 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.763323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-home\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.763509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.763356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-model-cache\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.763509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.763385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tm85\" (UniqueName: \"kubernetes.io/projected/5f996e1f-73f5-464c-803c-3959db7a320a-kube-api-access-6tm85\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.763509 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.763492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f996e1f-73f5-464c-803c-3959db7a320a-tls-certs\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.763636 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.763537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-tmp-dir\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.763636 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.763601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-dshm\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864369 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-dshm\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864537 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-home\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864537 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-model-cache\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864537 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tm85\" (UniqueName: \"kubernetes.io/projected/5f996e1f-73f5-464c-803c-3959db7a320a-kube-api-access-6tm85\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864537 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f996e1f-73f5-464c-803c-3959db7a320a-tls-certs\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864537 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-tmp-dir\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864784 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-home\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864916 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-tmp-dir\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.864967 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.864904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-model-cache\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.866781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.866758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-dshm\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.867014 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.866996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f996e1f-73f5-464c-803c-3959db7a320a-tls-certs\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:07.871837 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:07.871819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tm85\" (UniqueName: \"kubernetes.io/projected/5f996e1f-73f5-464c-803c-3959db7a320a-kube-api-access-6tm85\") pod \"test-model-4d9536-kserve-7b9648f5-5rkst\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") " pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:08.040347 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:08.040254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:08.167518 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:08.167492    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"]
Jul 29 19:51:08.170008 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:51:08.169982    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f996e1f_73f5_464c_803c_3959db7a320a.slice/crio-3daa45602c5e1a531fc6bac7a62ab655cb9840274ac0429176f11ff0a879f510 WatchSource:0}: Error finding container 3daa45602c5e1a531fc6bac7a62ab655cb9840274ac0429176f11ff0a879f510: Status 404 returned error can't find the container with id 3daa45602c5e1a531fc6bac7a62ab655cb9840274ac0429176f11ff0a879f510
Jul 29 19:51:08.722749 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:08.722713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst" event={"ID":"5f996e1f-73f5-464c-803c-3959db7a320a","Type":"ContainerStarted","Data":"455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9"}
Jul 29 19:51:08.722749 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:08.722753    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst" event={"ID":"5f996e1f-73f5-464c-803c-3959db7a320a","Type":"ContainerStarted","Data":"3daa45602c5e1a531fc6bac7a62ab655cb9840274ac0429176f11ff0a879f510"}
Jul 29 19:51:08.737485 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:08.737287    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst" podStartSLOduration=1.737268268 podStartE2EDuration="1.737268268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:51:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:51:08.736909227 +0000 UTC m=+2162.653858815" watchObservedRunningTime="2026-07-29 19:51:08.737268268 +0000 UTC m=+2162.654217856"
Jul 29 19:51:18.041098 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:18.041050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:18.041847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:18.041149    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:18.053688 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:18.053660    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:18.783740 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:18.783712    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:51:46.832716 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.832678    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"]
Jul 29 19:51:46.836435 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.836418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:46.839125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.839097    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5c1453\"/\"openshift-service-ca.crt\""
Jul 29 19:51:46.839258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.839153    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5c1453\"/\"kube-root-ca.crt\""
Jul 29 19:51:46.839258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.839225    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5c1453\"/\"test-model-5c1453-kserve-self-signed-certs\""
Jul 29 19:51:46.839258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.839252    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5c1453\"/\"default-dockercfg-6xwjl\""
Jul 29 19:51:46.848298 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.848273    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"]
Jul 29 19:51:46.915258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.915225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77e76d60-18ed-4060-ad8c-90d7350d8142-tls-certs\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:46.915258 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.915259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-home\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:46.915482 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.915297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-model-cache\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:46.915482 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.915329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-tmp-dir\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:46.915482 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.915361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n7tl\" (UniqueName: \"kubernetes.io/projected/77e76d60-18ed-4060-ad8c-90d7350d8142-kube-api-access-9n7tl\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:46.915482 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:46.915414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-dshm\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n7tl\" (UniqueName: \"kubernetes.io/projected/77e76d60-18ed-4060-ad8c-90d7350d8142-kube-api-access-9n7tl\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-dshm\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77e76d60-18ed-4060-ad8c-90d7350d8142-tls-certs\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-home\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-model-cache\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016625 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-tmp-dir\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.016990 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.016960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-model-cache\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.017137 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.017011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-tmp-dir\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.017137 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.017051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-home\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.018804 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.018778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-dshm\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.019076 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.019058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77e76d60-18ed-4060-ad8c-90d7350d8142-tls-certs\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.025113 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.025082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n7tl\" (UniqueName: \"kubernetes.io/projected/77e76d60-18ed-4060-ad8c-90d7350d8142-kube-api-access-9n7tl\") pod \"test-model-5c1453-kserve-775bbb475-rlbbp\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") " pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.146589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.146502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:47.290564 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.290531    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"]
Jul 29 19:51:47.293766 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:51:47.293736    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77e76d60_18ed_4060_ad8c_90d7350d8142.slice/crio-9167d74b245957f6e782c52f3d4db194d5c45ddb417952661e169ffc41b6d268 WatchSource:0}: Error finding container 9167d74b245957f6e782c52f3d4db194d5c45ddb417952661e169ffc41b6d268: Status 404 returned error can't find the container with id 9167d74b245957f6e782c52f3d4db194d5c45ddb417952661e169ffc41b6d268
Jul 29 19:51:47.908614 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.908575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp" event={"ID":"77e76d60-18ed-4060-ad8c-90d7350d8142","Type":"ContainerStarted","Data":"bc6df692b64af6b09b5525d0d10777c9b6692abdf9b2f1c1e0057223de1844dc"}
Jul 29 19:51:47.908614 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.908620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp" event={"ID":"77e76d60-18ed-4060-ad8c-90d7350d8142","Type":"ContainerStarted","Data":"9167d74b245957f6e782c52f3d4db194d5c45ddb417952661e169ffc41b6d268"}
Jul 29 19:51:47.926263 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:47.926219    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp" podStartSLOduration=1.926204364 podStartE2EDuration="1.926204364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:51:47.924695847 +0000 UTC m=+2201.841645433" watchObservedRunningTime="2026-07-29 19:51:47.926204364 +0000 UTC m=+2201.843153951"
Jul 29 19:51:57.146847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:57.146815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:57.147323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:57.146941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:57.158879 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:57.158854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:51:57.966850 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:51:57.966821    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:52:26.065887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:26.065846    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"]
Jul 29 19:52:27.020345 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:27.020308    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"]
Jul 29 19:52:37.629698 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.629662    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"]
Jul 29 19:52:37.630336 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.630306    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s" podUID="5ed476fb-941a-4d82-9cec-2cc90c80b7d9" containerName="payload-processing" containerID="cri-o://0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e" gracePeriod=30
Jul 29 19:52:37.632552 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.632520    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"]
Jul 29 19:52:37.633037 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.632968    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn" podUID="b42e8f99-0415-4a7c-927f-7f59ae33cd83" containerName="payload-pre-processing" containerID="cri-o://c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841" gracePeriod=30
Jul 29 19:52:37.915877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.915853    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:52:37.919834 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.919815    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:52:37.983613 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.983582    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79mbf\" (UniqueName: \"kubernetes.io/projected/b42e8f99-0415-4a7c-927f-7f59ae33cd83-kube-api-access-79mbf\") pod \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") "
Jul 29 19:52:37.983796 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.983626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-plugins-config-volume\") pod \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") "
Jul 29 19:52:37.983796 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.983653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42e8f99-0415-4a7c-927f-7f59ae33cd83-plugins-config-volume\") pod \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\" (UID: \"b42e8f99-0415-4a7c-927f-7f59ae33cd83\") "
Jul 29 19:52:37.983796 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.983690    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q42lk\" (UniqueName: \"kubernetes.io/projected/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-kube-api-access-q42lk\") pod \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\" (UID: \"5ed476fb-941a-4d82-9cec-2cc90c80b7d9\") "
Jul 29 19:52:37.983999 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.983972    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ed476fb-941a-4d82-9cec-2cc90c80b7d9" (UID: "5ed476fb-941a-4d82-9cec-2cc90c80b7d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:37.984083 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.983994    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b42e8f99-0415-4a7c-927f-7f59ae33cd83-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b42e8f99-0415-4a7c-927f-7f59ae33cd83" (UID: "b42e8f99-0415-4a7c-927f-7f59ae33cd83"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:37.985836 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.985809    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-kube-api-access-q42lk" (OuterVolumeSpecName: "kube-api-access-q42lk") pod "5ed476fb-941a-4d82-9cec-2cc90c80b7d9" (UID: "5ed476fb-941a-4d82-9cec-2cc90c80b7d9"). InnerVolumeSpecName "kube-api-access-q42lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:37.985933 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:37.985838    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b42e8f99-0415-4a7c-927f-7f59ae33cd83-kube-api-access-79mbf" (OuterVolumeSpecName: "kube-api-access-79mbf") pod "b42e8f99-0415-4a7c-927f-7f59ae33cd83" (UID: "b42e8f99-0415-4a7c-927f-7f59ae33cd83"). InnerVolumeSpecName "kube-api-access-79mbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:38.084927 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.084892    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q42lk\" (UniqueName: \"kubernetes.io/projected/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-kube-api-access-q42lk\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.084927 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.084920    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79mbf\" (UniqueName: \"kubernetes.io/projected/b42e8f99-0415-4a7c-927f-7f59ae33cd83-kube-api-access-79mbf\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.084927 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.084929    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed476fb-941a-4d82-9cec-2cc90c80b7d9-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.085182 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.084938    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42e8f99-0415-4a7c-927f-7f59ae33cd83-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.148522 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.148434    2576 generic.go:356] "Generic (PLEG): container finished" podID="5ed476fb-941a-4d82-9cec-2cc90c80b7d9" containerID="0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e" exitCode=0
Jul 29 19:52:38.148522 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.148482    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"
Jul 29 19:52:38.148522 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.148481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s" event={"ID":"5ed476fb-941a-4d82-9cec-2cc90c80b7d9","Type":"ContainerDied","Data":"0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e"}
Jul 29 19:52:38.148760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.148534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s" event={"ID":"5ed476fb-941a-4d82-9cec-2cc90c80b7d9","Type":"ContainerDied","Data":"77b5d48e42b550309190197ca9715fe81ec6db6257adf8347d8c6dc9a0132d6e"}
Jul 29 19:52:38.148760 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.148555    2576 scope.go:117] "RemoveContainer" containerID="0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e"
Jul 29 19:52:38.149781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.149753    2576 generic.go:356] "Generic (PLEG): container finished" podID="b42e8f99-0415-4a7c-927f-7f59ae33cd83" containerID="c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841" exitCode=0
Jul 29 19:52:38.149891 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.149787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn" event={"ID":"b42e8f99-0415-4a7c-927f-7f59ae33cd83","Type":"ContainerDied","Data":"c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841"}
Jul 29 19:52:38.149891 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.149802    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"
Jul 29 19:52:38.149891 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.149833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn" event={"ID":"b42e8f99-0415-4a7c-927f-7f59ae33cd83","Type":"ContainerDied","Data":"304c4f510989c7dd09c0ba10a585f815705964f4c5e49f6df36779f69d7f8196"}
Jul 29 19:52:38.157688 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.157584    2576 scope.go:117] "RemoveContainer" containerID="0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e"
Jul 29 19:52:38.158040 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:52:38.157986    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e\": container with ID starting with 0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e not found: ID does not exist" containerID="0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e"
Jul 29 19:52:38.158156 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.158035    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e"} err="failed to get container status \"0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e\": rpc error: code = NotFound desc = could not find container \"0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e\": container with ID starting with 0afa5d8a4f101a00706417fac834e2139eedad255f801eda5ed29d26672c3e9e not found: ID does not exist"
Jul 29 19:52:38.158156 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.158063    2576 scope.go:117] "RemoveContainer" containerID="c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841"
Jul 29 19:52:38.166471 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.166458    2576 scope.go:117] "RemoveContainer" containerID="c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841"
Jul 29 19:52:38.166706 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:52:38.166688    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841\": container with ID starting with c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841 not found: ID does not exist" containerID="c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841"
Jul 29 19:52:38.166768 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.166715    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841"} err="failed to get container status \"c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841\": rpc error: code = NotFound desc = could not find container \"c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841\": container with ID starting with c56e4cd301e23877b6db603c5c3857e3a9b674019238695f618e7b774717d841 not found: ID does not exist"
Jul 29 19:52:38.172587 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.172566    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"]
Jul 29 19:52:38.176359 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.176339    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4d9536-6cd98cc99b-l7h9s"]
Jul 29 19:52:38.185325 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.185302    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"]
Jul 29 19:52:38.188001 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.187983    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4d9536-7ffb776bd4-p26dn"]
Jul 29 19:52:38.671925 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.671882    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed476fb-941a-4d82-9cec-2cc90c80b7d9" path="/var/lib/kubelet/pods/5ed476fb-941a-4d82-9cec-2cc90c80b7d9/volumes"
Jul 29 19:52:38.672430 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:38.672408    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b42e8f99-0415-4a7c-927f-7f59ae33cd83" path="/var/lib/kubelet/pods/b42e8f99-0415-4a7c-927f-7f59ae33cd83/volumes"
Jul 29 19:52:41.085057 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.084999    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst" podUID="5f996e1f-73f5-464c-803c-3959db7a320a" containerName="main" containerID="cri-o://455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9" gracePeriod=45
Jul 29 19:52:41.336311 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.336253    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:52:41.412986 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.412950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-home\") pod \"5f996e1f-73f5-464c-803c-3959db7a320a\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") "
Jul 29 19:52:41.412986 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.412989    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tm85\" (UniqueName: \"kubernetes.io/projected/5f996e1f-73f5-464c-803c-3959db7a320a-kube-api-access-6tm85\") pod \"5f996e1f-73f5-464c-803c-3959db7a320a\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") "
Jul 29 19:52:41.413254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413056    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f996e1f-73f5-464c-803c-3959db7a320a-tls-certs\") pod \"5f996e1f-73f5-464c-803c-3959db7a320a\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") "
Jul 29 19:52:41.413254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-tmp-dir\") pod \"5f996e1f-73f5-464c-803c-3959db7a320a\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") "
Jul 29 19:52:41.413254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-dshm\") pod \"5f996e1f-73f5-464c-803c-3959db7a320a\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") "
Jul 29 19:52:41.413254 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413213    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-model-cache\") pod \"5f996e1f-73f5-464c-803c-3959db7a320a\" (UID: \"5f996e1f-73f5-464c-803c-3959db7a320a\") "
Jul 29 19:52:41.413405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413270    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-home" (OuterVolumeSpecName: "home") pod "5f996e1f-73f5-464c-803c-3959db7a320a" (UID: "5f996e1f-73f5-464c-803c-3959db7a320a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:41.413405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f996e1f-73f5-464c-803c-3959db7a320a" (UID: "5f996e1f-73f5-464c-803c-3959db7a320a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:41.413542 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f996e1f-73f5-464c-803c-3959db7a320a" (UID: "5f996e1f-73f5-464c-803c-3959db7a320a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:41.413689 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413578    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:41.413689 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413611    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:41.413689 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.413622    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:41.415396 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.415365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f996e1f-73f5-464c-803c-3959db7a320a-kube-api-access-6tm85" (OuterVolumeSpecName: "kube-api-access-6tm85") pod "5f996e1f-73f5-464c-803c-3959db7a320a" (UID: "5f996e1f-73f5-464c-803c-3959db7a320a"). InnerVolumeSpecName "kube-api-access-6tm85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:41.415524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.415449    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-dshm" (OuterVolumeSpecName: "dshm") pod "5f996e1f-73f5-464c-803c-3959db7a320a" (UID: "5f996e1f-73f5-464c-803c-3959db7a320a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:41.415524 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.415495    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f996e1f-73f5-464c-803c-3959db7a320a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f996e1f-73f5-464c-803c-3959db7a320a" (UID: "5f996e1f-73f5-464c-803c-3959db7a320a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:52:41.514980 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.514950    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tm85\" (UniqueName: \"kubernetes.io/projected/5f996e1f-73f5-464c-803c-3959db7a320a-kube-api-access-6tm85\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:41.514980 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.514977    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f996e1f-73f5-464c-803c-3959db7a320a-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:41.514980 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:41.514986    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f996e1f-73f5-464c-803c-3959db7a320a-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.039492 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.039443    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp" podUID="77e76d60-18ed-4060-ad8c-90d7350d8142" containerName="main" containerID="cri-o://bc6df692b64af6b09b5525d0d10777c9b6692abdf9b2f1c1e0057223de1844dc" gracePeriod=45
Jul 29 19:52:42.174652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.174624    2576 generic.go:356] "Generic (PLEG): container finished" podID="77e76d60-18ed-4060-ad8c-90d7350d8142" containerID="bc6df692b64af6b09b5525d0d10777c9b6692abdf9b2f1c1e0057223de1844dc" exitCode=0
Jul 29 19:52:42.175087 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.174698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp" event={"ID":"77e76d60-18ed-4060-ad8c-90d7350d8142","Type":"ContainerDied","Data":"bc6df692b64af6b09b5525d0d10777c9b6692abdf9b2f1c1e0057223de1844dc"}
Jul 29 19:52:42.176055 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.176034    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f996e1f-73f5-464c-803c-3959db7a320a" containerID="455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9" exitCode=0
Jul 29 19:52:42.176144 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.176091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"
Jul 29 19:52:42.176188 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.176093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst" event={"ID":"5f996e1f-73f5-464c-803c-3959db7a320a","Type":"ContainerDied","Data":"455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9"}
Jul 29 19:52:42.176228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.176195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst" event={"ID":"5f996e1f-73f5-464c-803c-3959db7a320a","Type":"ContainerDied","Data":"3daa45602c5e1a531fc6bac7a62ab655cb9840274ac0429176f11ff0a879f510"}
Jul 29 19:52:42.176228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.176212    2576 scope.go:117] "RemoveContainer" containerID="455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9"
Jul 29 19:52:42.186231 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.186192    2576 scope.go:117] "RemoveContainer" containerID="455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9"
Jul 29 19:52:42.186549 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:52:42.186521    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9\": container with ID starting with 455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9 not found: ID does not exist" containerID="455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9"
Jul 29 19:52:42.186652 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.186555    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9"} err="failed to get container status \"455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9\": rpc error: code = NotFound desc = could not find container \"455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9\": container with ID starting with 455000de5c14eb1316b76c1abbd8bbd83bdd6308c1b6110e63e74a65d4dd2ee9 not found: ID does not exist"
Jul 29 19:52:42.201876 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.201850    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"]
Jul 29 19:52:42.205511 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.205489    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4d9536/test-model-4d9536-kserve-7b9648f5-5rkst"]
Jul 29 19:52:42.295860 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.295802    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:52:42.422271 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422232    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-dshm\") pod \"77e76d60-18ed-4060-ad8c-90d7350d8142\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") "
Jul 29 19:52:42.422271 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422281    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-home\") pod \"77e76d60-18ed-4060-ad8c-90d7350d8142\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") "
Jul 29 19:52:42.422510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422324    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-tmp-dir\") pod \"77e76d60-18ed-4060-ad8c-90d7350d8142\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") "
Jul 29 19:52:42.422510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422370    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77e76d60-18ed-4060-ad8c-90d7350d8142-tls-certs\") pod \"77e76d60-18ed-4060-ad8c-90d7350d8142\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") "
Jul 29 19:52:42.422510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422387    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-model-cache\") pod \"77e76d60-18ed-4060-ad8c-90d7350d8142\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") "
Jul 29 19:52:42.422510 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n7tl\" (UniqueName: \"kubernetes.io/projected/77e76d60-18ed-4060-ad8c-90d7350d8142-kube-api-access-9n7tl\") pod \"77e76d60-18ed-4060-ad8c-90d7350d8142\" (UID: \"77e76d60-18ed-4060-ad8c-90d7350d8142\") "
Jul 29 19:52:42.422717 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422639    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-home" (OuterVolumeSpecName: "home") pod "77e76d60-18ed-4060-ad8c-90d7350d8142" (UID: "77e76d60-18ed-4060-ad8c-90d7350d8142"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:42.422717 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422682    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77e76d60-18ed-4060-ad8c-90d7350d8142" (UID: "77e76d60-18ed-4060-ad8c-90d7350d8142"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:42.422717 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.422693    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-model-cache" (OuterVolumeSpecName: "model-cache") pod "77e76d60-18ed-4060-ad8c-90d7350d8142" (UID: "77e76d60-18ed-4060-ad8c-90d7350d8142"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:42.424565 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.424540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-dshm" (OuterVolumeSpecName: "dshm") pod "77e76d60-18ed-4060-ad8c-90d7350d8142" (UID: "77e76d60-18ed-4060-ad8c-90d7350d8142"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:42.424565 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.424551    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e76d60-18ed-4060-ad8c-90d7350d8142-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77e76d60-18ed-4060-ad8c-90d7350d8142" (UID: "77e76d60-18ed-4060-ad8c-90d7350d8142"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:52:42.424705 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.424632    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e76d60-18ed-4060-ad8c-90d7350d8142-kube-api-access-9n7tl" (OuterVolumeSpecName: "kube-api-access-9n7tl") pod "77e76d60-18ed-4060-ad8c-90d7350d8142" (UID: "77e76d60-18ed-4060-ad8c-90d7350d8142"). InnerVolumeSpecName "kube-api-access-9n7tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:42.523892 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.523855    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.523892 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.523886    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77e76d60-18ed-4060-ad8c-90d7350d8142-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.523892 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.523895    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.524137 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.523904    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n7tl\" (UniqueName: \"kubernetes.io/projected/77e76d60-18ed-4060-ad8c-90d7350d8142-kube-api-access-9n7tl\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.524137 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.523912    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.524137 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.523920    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77e76d60-18ed-4060-ad8c-90d7350d8142-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:42.671832 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:42.671801    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f996e1f-73f5-464c-803c-3959db7a320a" path="/var/lib/kubelet/pods/5f996e1f-73f5-464c-803c-3959db7a320a/volumes"
Jul 29 19:52:43.182114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:43.182056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp" event={"ID":"77e76d60-18ed-4060-ad8c-90d7350d8142","Type":"ContainerDied","Data":"9167d74b245957f6e782c52f3d4db194d5c45ddb417952661e169ffc41b6d268"}
Jul 29 19:52:43.182114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:43.182128    2576 scope.go:117] "RemoveContainer" containerID="bc6df692b64af6b09b5525d0d10777c9b6692abdf9b2f1c1e0057223de1844dc"
Jul 29 19:52:43.182618 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:43.182066    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"
Jul 29 19:52:43.201482 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:43.198862    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"]
Jul 29 19:52:43.204304 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:43.204275    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5c1453/test-model-5c1453-kserve-775bbb475-rlbbp"]
Jul 29 19:52:44.584400 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584365    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"]
Jul 29 19:52:44.584782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584729    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b42e8f99-0415-4a7c-927f-7f59ae33cd83" containerName="payload-pre-processing"
Jul 29 19:52:44.584782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584739    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b42e8f99-0415-4a7c-927f-7f59ae33cd83" containerName="payload-pre-processing"
Jul 29 19:52:44.584782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584754    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e76d60-18ed-4060-ad8c-90d7350d8142" containerName="main"
Jul 29 19:52:44.584782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584760    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e76d60-18ed-4060-ad8c-90d7350d8142" containerName="main"
Jul 29 19:52:44.584782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584769    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed476fb-941a-4d82-9cec-2cc90c80b7d9" containerName="payload-processing"
Jul 29 19:52:44.584782 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584774    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed476fb-941a-4d82-9cec-2cc90c80b7d9" containerName="payload-processing"
Jul 29 19:52:44.584989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584788    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f996e1f-73f5-464c-803c-3959db7a320a" containerName="main"
Jul 29 19:52:44.584989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584793    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f996e1f-73f5-464c-803c-3959db7a320a" containerName="main"
Jul 29 19:52:44.584989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584843    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f996e1f-73f5-464c-803c-3959db7a320a" containerName="main"
Jul 29 19:52:44.584989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584851    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b42e8f99-0415-4a7c-927f-7f59ae33cd83" containerName="payload-pre-processing"
Jul 29 19:52:44.584989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584859    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77e76d60-18ed-4060-ad8c-90d7350d8142" containerName="main"
Jul 29 19:52:44.584989 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.584865    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed476fb-941a-4d82-9cec-2cc90c80b7d9" containerName="payload-processing"
Jul 29 19:52:44.589122 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.589098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:44.590848 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.590819    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:52:44.590984 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.590934    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:52:44.593653 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.593636    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"]
Jul 29 19:52:44.644479 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.644451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd34852-14ea-498a-89f7-4341a05365d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5c1453-26skr\" (UID: \"ffd34852-14ea-498a-89f7-4341a05365d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:44.671952 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.671922    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e76d60-18ed-4060-ad8c-90d7350d8142" path="/var/lib/kubelet/pods/77e76d60-18ed-4060-ad8c-90d7350d8142/volumes"
Jul 29 19:52:44.745159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.745121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd34852-14ea-498a-89f7-4341a05365d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5c1453-26skr\" (UID: \"ffd34852-14ea-498a-89f7-4341a05365d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:44.745781 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.745761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd34852-14ea-498a-89f7-4341a05365d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5c1453-26skr\" (UID: \"ffd34852-14ea-498a-89f7-4341a05365d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:44.900159 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:44.900069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:45.048049 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:45.047972    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"]
Jul 29 19:52:45.052996 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:52:45.052954    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd34852_14ea_498a_89f7_4341a05365d7.slice/crio-416b576351954233f7e44ce8c3f4fa02281111d4574f56292c499ca1fac4c0c4 WatchSource:0}: Error finding container 416b576351954233f7e44ce8c3f4fa02281111d4574f56292c499ca1fac4c0c4: Status 404 returned error can't find the container with id 416b576351954233f7e44ce8c3f4fa02281111d4574f56292c499ca1fac4c0c4
Jul 29 19:52:45.194456 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:45.194423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr" event={"ID":"ffd34852-14ea-498a-89f7-4341a05365d7","Type":"ContainerStarted","Data":"416b576351954233f7e44ce8c3f4fa02281111d4574f56292c499ca1fac4c0c4"}
Jul 29 19:52:46.201038 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:46.200996    2576 generic.go:356] "Generic (PLEG): container finished" podID="ffd34852-14ea-498a-89f7-4341a05365d7" containerID="1890d929d8a54b4f28ca8706d4c11d5f9cd48bc1740f468489d3edabd05a0763" exitCode=0
Jul 29 19:52:46.201444 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:46.201085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr" event={"ID":"ffd34852-14ea-498a-89f7-4341a05365d7","Type":"ContainerDied","Data":"1890d929d8a54b4f28ca8706d4c11d5f9cd48bc1740f468489d3edabd05a0763"}
Jul 29 19:52:47.331576 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:47.331554    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:47.471349 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:47.471260    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd34852-14ea-498a-89f7-4341a05365d7-maas-api-service-ca\") pod \"ffd34852-14ea-498a-89f7-4341a05365d7\" (UID: \"ffd34852-14ea-498a-89f7-4341a05365d7\") "
Jul 29 19:52:47.471704 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:47.471678    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd34852-14ea-498a-89f7-4341a05365d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ffd34852-14ea-498a-89f7-4341a05365d7" (UID: "ffd34852-14ea-498a-89f7-4341a05365d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:47.572408 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:47.572372    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd34852-14ea-498a-89f7-4341a05365d7-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:48.214413 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:48.214376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr" event={"ID":"ffd34852-14ea-498a-89f7-4341a05365d7","Type":"ContainerDied","Data":"416b576351954233f7e44ce8c3f4fa02281111d4574f56292c499ca1fac4c0c4"}
Jul 29 19:52:48.214559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:48.214430    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="416b576351954233f7e44ce8c3f4fa02281111d4574f56292c499ca1fac4c0c4"
Jul 29 19:52:48.214559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:48.214392    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"
Jul 29 19:52:55.049485 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.049447    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"]
Jul 29 19:52:55.050194 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.049715    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb" podUID="040199a2-b867-45e0-8137-f2a43f5add11" containerName="payload-processing" containerID="cri-o://b5a981c47d0dbd2cf18309e6d6fb346ba48644429473e07e2b2861b60c55836e" gracePeriod=30
Jul 29 19:52:55.060169 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.060137    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"]
Jul 29 19:52:55.060428 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.060375    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k" podUID="f6d18cde-a07a-4eac-8c44-9ba8f4c39191" containerName="payload-pre-processing" containerID="cri-o://c0270d13bb39b8cad5f2e7848fb0d385a997c1cb5969b07660e1b5b5dd364340" gracePeriod=30
Jul 29 19:52:55.197865 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.197831    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"]
Jul 29 19:52:55.202133 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.202103    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c1453-26skr"]
Jul 29 19:52:55.250806 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.250773    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6d18cde-a07a-4eac-8c44-9ba8f4c39191" containerID="c0270d13bb39b8cad5f2e7848fb0d385a997c1cb5969b07660e1b5b5dd364340" exitCode=0
Jul 29 19:52:55.251006 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.250847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k" event={"ID":"f6d18cde-a07a-4eac-8c44-9ba8f4c39191","Type":"ContainerDied","Data":"c0270d13bb39b8cad5f2e7848fb0d385a997c1cb5969b07660e1b5b5dd364340"}
Jul 29 19:52:55.253613 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.253575    2576 generic.go:356] "Generic (PLEG): container finished" podID="040199a2-b867-45e0-8137-f2a43f5add11" containerID="b5a981c47d0dbd2cf18309e6d6fb346ba48644429473e07e2b2861b60c55836e" exitCode=0
Jul 29 19:52:55.253761 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.253618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb" event={"ID":"040199a2-b867-45e0-8137-f2a43f5add11","Type":"ContainerDied","Data":"b5a981c47d0dbd2cf18309e6d6fb346ba48644429473e07e2b2861b60c55836e"}
Jul 29 19:52:55.327041 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.327001    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:52:55.330118 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.330096    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:52:55.441922 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.441886    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd4pg\" (UniqueName: \"kubernetes.io/projected/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-kube-api-access-dd4pg\") pod \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") "
Jul 29 19:52:55.442150 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.441963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-plugins-config-volume\") pod \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\" (UID: \"f6d18cde-a07a-4eac-8c44-9ba8f4c39191\") "
Jul 29 19:52:55.442150 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.441997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ztcw\" (UniqueName: \"kubernetes.io/projected/040199a2-b867-45e0-8137-f2a43f5add11-kube-api-access-9ztcw\") pod \"040199a2-b867-45e0-8137-f2a43f5add11\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") "
Jul 29 19:52:55.442150 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.442017    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040199a2-b867-45e0-8137-f2a43f5add11-plugins-config-volume\") pod \"040199a2-b867-45e0-8137-f2a43f5add11\" (UID: \"040199a2-b867-45e0-8137-f2a43f5add11\") "
Jul 29 19:52:55.442360 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.442325    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6d18cde-a07a-4eac-8c44-9ba8f4c39191" (UID: "f6d18cde-a07a-4eac-8c44-9ba8f4c39191"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:55.442439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.442391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/040199a2-b867-45e0-8137-f2a43f5add11-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "040199a2-b867-45e0-8137-f2a43f5add11" (UID: "040199a2-b867-45e0-8137-f2a43f5add11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:55.443975 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.443955    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040199a2-b867-45e0-8137-f2a43f5add11-kube-api-access-9ztcw" (OuterVolumeSpecName: "kube-api-access-9ztcw") pod "040199a2-b867-45e0-8137-f2a43f5add11" (UID: "040199a2-b867-45e0-8137-f2a43f5add11"). InnerVolumeSpecName "kube-api-access-9ztcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:55.444093 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.443984    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-kube-api-access-dd4pg" (OuterVolumeSpecName: "kube-api-access-dd4pg") pod "f6d18cde-a07a-4eac-8c44-9ba8f4c39191" (UID: "f6d18cde-a07a-4eac-8c44-9ba8f4c39191"). InnerVolumeSpecName "kube-api-access-dd4pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:55.543114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.543080    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:55.543114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.543109    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ztcw\" (UniqueName: \"kubernetes.io/projected/040199a2-b867-45e0-8137-f2a43f5add11-kube-api-access-9ztcw\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:55.543114 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.543119    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040199a2-b867-45e0-8137-f2a43f5add11-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:55.543344 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:55.543127    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd4pg\" (UniqueName: \"kubernetes.io/projected/f6d18cde-a07a-4eac-8c44-9ba8f4c39191-kube-api-access-dd4pg\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:52:56.259722 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.259692    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"
Jul 29 19:52:56.260228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.259693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k" event={"ID":"f6d18cde-a07a-4eac-8c44-9ba8f4c39191","Type":"ContainerDied","Data":"1221288b99d5b97961d775b92000dba1eddfab3be34ce0ff97ca70d338660692"}
Jul 29 19:52:56.260228 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.259832    2576 scope.go:117] "RemoveContainer" containerID="c0270d13bb39b8cad5f2e7848fb0d385a997c1cb5969b07660e1b5b5dd364340"
Jul 29 19:52:56.261194 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.260951    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"
Jul 29 19:52:56.261194 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.260951    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb" event={"ID":"040199a2-b867-45e0-8137-f2a43f5add11","Type":"ContainerDied","Data":"8b24250a6ede9d41cb874fa40d6afeedbd796fedab87d843c757a2873d336b61"}
Jul 29 19:52:56.269555 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.269515    2576 scope.go:117] "RemoveContainer" containerID="b5a981c47d0dbd2cf18309e6d6fb346ba48644429473e07e2b2861b60c55836e"
Jul 29 19:52:56.283096 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.283071    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"]
Jul 29 19:52:56.289994 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.289972    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5c1453-f467c8458-z9nrb"]
Jul 29 19:52:56.299129 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.299105    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"]
Jul 29 19:52:56.302592 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.302572    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5c1453-76d96bbb76-7pc2k"]
Jul 29 19:52:56.671504 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.671474    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="040199a2-b867-45e0-8137-f2a43f5add11" path="/var/lib/kubelet/pods/040199a2-b867-45e0-8137-f2a43f5add11/volumes"
Jul 29 19:52:56.671824 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.671812    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d18cde-a07a-4eac-8c44-9ba8f4c39191" path="/var/lib/kubelet/pods/f6d18cde-a07a-4eac-8c44-9ba8f4c39191/volumes"
Jul 29 19:52:56.672112 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:52:56.672100    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd34852-14ea-498a-89f7-4341a05365d7" path="/var/lib/kubelet/pods/ffd34852-14ea-498a-89f7-4341a05365d7/volumes"
Jul 29 19:53:06.787650 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.787613    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"]
Jul 29 19:53:06.788002 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.787960    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040199a2-b867-45e0-8137-f2a43f5add11" containerName="payload-processing"
Jul 29 19:53:06.788002 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.787971    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="040199a2-b867-45e0-8137-f2a43f5add11" containerName="payload-processing"
Jul 29 19:53:06.788002 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.787983    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d18cde-a07a-4eac-8c44-9ba8f4c39191" containerName="payload-pre-processing"
Jul 29 19:53:06.788002 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.787990    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d18cde-a07a-4eac-8c44-9ba8f4c39191" containerName="payload-pre-processing"
Jul 29 19:53:06.788227 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.788007    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd34852-14ea-498a-89f7-4341a05365d7" containerName="revoke-keys"
Jul 29 19:53:06.788227 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.788012    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd34852-14ea-498a-89f7-4341a05365d7" containerName="revoke-keys"
Jul 29 19:53:06.788227 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.788107    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d18cde-a07a-4eac-8c44-9ba8f4c39191" containerName="payload-pre-processing"
Jul 29 19:53:06.788227 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.788117    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="040199a2-b867-45e0-8137-f2a43f5add11" containerName="payload-processing"
Jul 29 19:53:06.788227 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.788126    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffd34852-14ea-498a-89f7-4341a05365d7" containerName="revoke-keys"
Jul 29 19:53:06.792320 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.792302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:06.794261 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.794238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a62265-dockercfg-mddgh\""
Jul 29 19:53:06.794353 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.794289    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a62265\""
Jul 29 19:53:06.797210 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.797193    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"]
Jul 29 19:53:06.801433 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.801400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:06.801827 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.801803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"]
Jul 29 19:53:06.810355 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.810334    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"]
Jul 29 19:53:06.817519 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.817498    2576 scope.go:117] "RemoveContainer" containerID="d94c319e1aa793c74eba0ae7179152512da7d147f64db95b7d8124feb2a09ec1"
Jul 29 19:53:06.935623 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.935590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a02495e-8e18-4692-90f8-400185d19ff1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") " pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:06.935774 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.935638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4a5ec3-8624-4c7d-a865-b46415d719bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:06.935774 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.935691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbhlk\" (UniqueName: \"kubernetes.io/projected/6a02495e-8e18-4692-90f8-400185d19ff1-kube-api-access-jbhlk\") pod \"payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") " pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:06.935880 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:06.935790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptgfb\" (UniqueName: \"kubernetes.io/projected/8e4a5ec3-8624-4c7d-a865-b46415d719bf-kube-api-access-ptgfb\") pod \"payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:07.036275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.036243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptgfb\" (UniqueName: \"kubernetes.io/projected/8e4a5ec3-8624-4c7d-a865-b46415d719bf-kube-api-access-ptgfb\") pod \"payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:07.036469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.036311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a02495e-8e18-4692-90f8-400185d19ff1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") " pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:07.036469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.036341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4a5ec3-8624-4c7d-a865-b46415d719bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:07.036469 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.036363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbhlk\" (UniqueName: \"kubernetes.io/projected/6a02495e-8e18-4692-90f8-400185d19ff1-kube-api-access-jbhlk\") pod \"payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") " pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:07.036979 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.036960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4a5ec3-8624-4c7d-a865-b46415d719bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:07.037050 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.037036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a02495e-8e18-4692-90f8-400185d19ff1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") " pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:07.044676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.044617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptgfb\" (UniqueName: \"kubernetes.io/projected/8e4a5ec3-8624-4c7d-a865-b46415d719bf-kube-api-access-ptgfb\") pod \"payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:07.044768 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.044691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbhlk\" (UniqueName: \"kubernetes.io/projected/6a02495e-8e18-4692-90f8-400185d19ff1-kube-api-access-jbhlk\") pod \"payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") " pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:07.104322 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.104288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:07.114607 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.114583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:07.269000 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.268974    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"]
Jul 29 19:53:07.271276 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:53:07.271247    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a02495e_8e18_4692_90f8_400185d19ff1.slice/crio-115c47d9164927a31736a6e9851ff2bf6cdca2db50dbfbd6d6b2817a1f5f5b43 WatchSource:0}: Error finding container 115c47d9164927a31736a6e9851ff2bf6cdca2db50dbfbd6d6b2817a1f5f5b43: Status 404 returned error can't find the container with id 115c47d9164927a31736a6e9851ff2bf6cdca2db50dbfbd6d6b2817a1f5f5b43
Jul 29 19:53:07.322200 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.322176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx" event={"ID":"6a02495e-8e18-4692-90f8-400185d19ff1","Type":"ContainerStarted","Data":"115c47d9164927a31736a6e9851ff2bf6cdca2db50dbfbd6d6b2817a1f5f5b43"}
Jul 29 19:53:07.449362 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:07.449336    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"]
Jul 29 19:53:07.451198 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:53:07.451172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4a5ec3_8624_4c7d_a865_b46415d719bf.slice/crio-f290d577406077bd542acac6f9039741f5c1e929cd701ea7a78d4c14e1113e07 WatchSource:0}: Error finding container f290d577406077bd542acac6f9039741f5c1e929cd701ea7a78d4c14e1113e07: Status 404 returned error can't find the container with id f290d577406077bd542acac6f9039741f5c1e929cd701ea7a78d4c14e1113e07
Jul 29 19:53:08.327886 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:08.327850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx" event={"ID":"6a02495e-8e18-4692-90f8-400185d19ff1","Type":"ContainerStarted","Data":"40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a"}
Jul 29 19:53:08.328343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:08.328032    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:08.329362 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:08.329334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w" event={"ID":"8e4a5ec3-8624-4c7d-a865-b46415d719bf","Type":"ContainerStarted","Data":"4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4"}
Jul 29 19:53:08.329494 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:08.329378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w" event={"ID":"8e4a5ec3-8624-4c7d-a865-b46415d719bf","Type":"ContainerStarted","Data":"f290d577406077bd542acac6f9039741f5c1e929cd701ea7a78d4c14e1113e07"}
Jul 29 19:53:08.329494 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:08.329427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:08.343648 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:08.343611    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx" podStartSLOduration=2.343599409 podStartE2EDuration="2.343599409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:08.341776401 +0000 UTC m=+2282.258725987" watchObservedRunningTime="2026-07-29 19:53:08.343599409 +0000 UTC m=+2282.260549041"
Jul 29 19:53:19.335559 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:19.335530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:53:19.336127 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:19.335657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:53:19.352694 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:19.352652    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w" podStartSLOduration=13.352639068 podStartE2EDuration="13.352639068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:08.355892342 +0000 UTC m=+2282.272841931" watchObservedRunningTime="2026-07-29 19:53:19.352639068 +0000 UTC m=+2293.269588678"
Jul 29 19:53:36.129823 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.129780    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"]
Jul 29 19:53:36.132637 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.132620    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.137840 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.137819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-3adaab-dockercfg-wmkzm\""
Jul 29 19:53:36.137979 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.137930    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-3adaab\""
Jul 29 19:53:36.149274 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.149249    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"]
Jul 29 19:53:36.152248 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.152225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.152805 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.152784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"]
Jul 29 19:53:36.167184 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.167158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"]
Jul 29 19:53:36.172243 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.172214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hh6l\" (UniqueName: \"kubernetes.io/projected/a626ad06-68f4-4928-b80d-8830be95728e-kube-api-access-2hh6l\") pod \"payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.172468 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.172448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a626ad06-68f4-4928-b80d-8830be95728e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.273336 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.273300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh6l\" (UniqueName: \"kubernetes.io/projected/a626ad06-68f4-4928-b80d-8830be95728e-kube-api-access-2hh6l\") pod \"payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.273517 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.273351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqclv\" (UniqueName: \"kubernetes.io/projected/795c953e-c6de-4025-80e5-e71e2206d0f7-kube-api-access-bqclv\") pod \"payload-processing-e2e-api-b-3adaab-8566476754-tv72x\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.273517 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.273373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a626ad06-68f4-4928-b80d-8830be95728e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.273517 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.273481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/795c953e-c6de-4025-80e5-e71e2206d0f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3adaab-8566476754-tv72x\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.273997 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.273980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a626ad06-68f4-4928-b80d-8830be95728e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.281776 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.281750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hh6l\" (UniqueName: \"kubernetes.io/projected/a626ad06-68f4-4928-b80d-8830be95728e-kube-api-access-2hh6l\") pod \"payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.374102 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.374064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqclv\" (UniqueName: \"kubernetes.io/projected/795c953e-c6de-4025-80e5-e71e2206d0f7-kube-api-access-bqclv\") pod \"payload-processing-e2e-api-b-3adaab-8566476754-tv72x\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.374275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.374154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/795c953e-c6de-4025-80e5-e71e2206d0f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3adaab-8566476754-tv72x\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.374787 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.374770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/795c953e-c6de-4025-80e5-e71e2206d0f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3adaab-8566476754-tv72x\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.381899 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.381839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqclv\" (UniqueName: \"kubernetes.io/projected/795c953e-c6de-4025-80e5-e71e2206d0f7-kube-api-access-bqclv\") pod \"payload-processing-e2e-api-b-3adaab-8566476754-tv72x\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.443599 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.443569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:36.462905 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.462878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:36.583512 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.583467    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"]
Jul 29 19:53:36.586434 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:53:36.586404    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda626ad06_68f4_4928_b80d_8830be95728e.slice/crio-450be182f31ed1cbe49f263ca6237908eb8d093d61d5c83630d60bed19a6d4a0 WatchSource:0}: Error finding container 450be182f31ed1cbe49f263ca6237908eb8d093d61d5c83630d60bed19a6d4a0: Status 404 returned error can't find the container with id 450be182f31ed1cbe49f263ca6237908eb8d093d61d5c83630d60bed19a6d4a0
Jul 29 19:53:36.814631 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:36.814604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"]
Jul 29 19:53:36.817240 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:53:36.817214    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795c953e_c6de_4025_80e5_e71e2206d0f7.slice/crio-675eaba2540a0c803140df84ae5162c84fd20add3ffc6919bde2897756d3506a WatchSource:0}: Error finding container 675eaba2540a0c803140df84ae5162c84fd20add3ffc6919bde2897756d3506a: Status 404 returned error can't find the container with id 675eaba2540a0c803140df84ae5162c84fd20add3ffc6919bde2897756d3506a
Jul 29 19:53:37.467981 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.467944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x" event={"ID":"795c953e-c6de-4025-80e5-e71e2206d0f7","Type":"ContainerStarted","Data":"f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5"}
Jul 29 19:53:37.468448 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.468008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x" event={"ID":"795c953e-c6de-4025-80e5-e71e2206d0f7","Type":"ContainerStarted","Data":"675eaba2540a0c803140df84ae5162c84fd20add3ffc6919bde2897756d3506a"}
Jul 29 19:53:37.468448 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.468150    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:37.469589 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.469564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5" event={"ID":"a626ad06-68f4-4928-b80d-8830be95728e","Type":"ContainerStarted","Data":"eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd"}
Jul 29 19:53:37.469724 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.469601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5" event={"ID":"a626ad06-68f4-4928-b80d-8830be95728e","Type":"ContainerStarted","Data":"450be182f31ed1cbe49f263ca6237908eb8d093d61d5c83630d60bed19a6d4a0"}
Jul 29 19:53:37.469724 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.469642    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:53:37.485814 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.485771    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x" podStartSLOduration=1.4857572860000001 podStartE2EDuration="1.485757286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:37.483338622 +0000 UTC m=+2311.400288213" watchObservedRunningTime="2026-07-29 19:53:37.485757286 +0000 UTC m=+2311.402706852"
Jul 29 19:53:37.501791 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:37.501746    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5" podStartSLOduration=1.5017327630000001 podStartE2EDuration="1.501732763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:37.500556759 +0000 UTC m=+2311.417506347" watchObservedRunningTime="2026-07-29 19:53:37.501732763 +0000 UTC m=+2311.418682350"
Jul 29 19:53:48.477979 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:48.477944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:53:48.478439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:53:48.478042    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:54:03.379436 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.379365    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"]
Jul 29 19:54:03.382724 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.382704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:03.384646 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.384628    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:54:03.384707 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.384629    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:54:03.389726 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.389703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"]
Jul 29 19:54:03.509887 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.509863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a62265-4q4lv\" (UID: \"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:03.611105 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.611082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a62265-4q4lv\" (UID: \"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:03.611620 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.611601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a62265-4q4lv\" (UID: \"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:03.694209 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.694151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:03.818264 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:03.818071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"]
Jul 29 19:54:03.820951 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:54:03.820924    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67d8aca_83ef_4a5c_a0bb_cdda16ee2c50.slice/crio-416f610a28d2bc789caa26fdb26101ee44cd3c8aad2277a7c9fe99cfd09474e0 WatchSource:0}: Error finding container 416f610a28d2bc789caa26fdb26101ee44cd3c8aad2277a7c9fe99cfd09474e0: Status 404 returned error can't find the container with id 416f610a28d2bc789caa26fdb26101ee44cd3c8aad2277a7c9fe99cfd09474e0
Jul 29 19:54:04.601694 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:04.601661    2576 generic.go:356] "Generic (PLEG): container finished" podID="c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50" containerID="1188971fe38902f4b23c99de1d222f16890c36081e23bb24076e4be7e0e81d0d" exitCode=0
Jul 29 19:54:04.602014 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:04.601708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv" event={"ID":"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50","Type":"ContainerDied","Data":"1188971fe38902f4b23c99de1d222f16890c36081e23bb24076e4be7e0e81d0d"}
Jul 29 19:54:04.602014 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:04.601765    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv" event={"ID":"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50","Type":"ContainerStarted","Data":"416f610a28d2bc789caa26fdb26101ee44cd3c8aad2277a7c9fe99cfd09474e0"}
Jul 29 19:54:05.736628 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:05.736604    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:05.831129 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:05.831103    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50-maas-api-service-ca\") pod \"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50\" (UID: \"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50\") "
Jul 29 19:54:05.831428 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:05.831406    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50" (UID: "c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:05.932667 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:05.932599    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:06.612613 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:06.612582    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"
Jul 29 19:54:06.612783 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:06.612632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv" event={"ID":"c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50","Type":"ContainerDied","Data":"416f610a28d2bc789caa26fdb26101ee44cd3c8aad2277a7c9fe99cfd09474e0"}
Jul 29 19:54:06.612783 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:06.612677    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="416f610a28d2bc789caa26fdb26101ee44cd3c8aad2277a7c9fe99cfd09474e0"
Jul 29 19:54:06.858250 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:06.858222    2576 scope.go:117] "RemoveContainer" containerID="ded39531e75e0f144fac423c39367ce3dc5efca161ff6efe31efa45080c5e0c9"
Jul 29 19:54:18.865719 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:18.865675    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"]
Jul 29 19:54:18.866176 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:18.865933    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx" podUID="6a02495e-8e18-4692-90f8-400185d19ff1" containerName="payload-processing" containerID="cri-o://40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a" gracePeriod=30
Jul 29 19:54:18.873494 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:18.873463    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"]
Jul 29 19:54:18.874033 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:18.873992    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w" podUID="8e4a5ec3-8624-4c7d-a865-b46415d719bf" containerName="payload-pre-processing" containerID="cri-o://4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4" gracePeriod=30
Jul 29 19:54:19.006609 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.006536    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"]
Jul 29 19:54:19.008636 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.008612    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a62265-4q4lv"]
Jul 29 19:54:19.140103 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.138148    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:54:19.146089 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.146069    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:54:19.233108 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.233079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbhlk\" (UniqueName: \"kubernetes.io/projected/6a02495e-8e18-4692-90f8-400185d19ff1-kube-api-access-jbhlk\") pod \"6a02495e-8e18-4692-90f8-400185d19ff1\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") "
Jul 29 19:54:19.233243 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.233170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4a5ec3-8624-4c7d-a865-b46415d719bf-plugins-config-volume\") pod \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") "
Jul 29 19:54:19.233243 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.233199    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a02495e-8e18-4692-90f8-400185d19ff1-plugins-config-volume\") pod \"6a02495e-8e18-4692-90f8-400185d19ff1\" (UID: \"6a02495e-8e18-4692-90f8-400185d19ff1\") "
Jul 29 19:54:19.233363 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.233243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptgfb\" (UniqueName: \"kubernetes.io/projected/8e4a5ec3-8624-4c7d-a865-b46415d719bf-kube-api-access-ptgfb\") pod \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\" (UID: \"8e4a5ec3-8624-4c7d-a865-b46415d719bf\") "
Jul 29 19:54:19.233529 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.233505    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e4a5ec3-8624-4c7d-a865-b46415d719bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e4a5ec3-8624-4c7d-a865-b46415d719bf" (UID: "8e4a5ec3-8624-4c7d-a865-b46415d719bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:19.233579 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.233556    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a02495e-8e18-4692-90f8-400185d19ff1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a02495e-8e18-4692-90f8-400185d19ff1" (UID: "6a02495e-8e18-4692-90f8-400185d19ff1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:19.235242 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.235215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a02495e-8e18-4692-90f8-400185d19ff1-kube-api-access-jbhlk" (OuterVolumeSpecName: "kube-api-access-jbhlk") pod "6a02495e-8e18-4692-90f8-400185d19ff1" (UID: "6a02495e-8e18-4692-90f8-400185d19ff1"). InnerVolumeSpecName "kube-api-access-jbhlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:19.235335 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.235242    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4a5ec3-8624-4c7d-a865-b46415d719bf-kube-api-access-ptgfb" (OuterVolumeSpecName: "kube-api-access-ptgfb") pod "8e4a5ec3-8624-4c7d-a865-b46415d719bf" (UID: "8e4a5ec3-8624-4c7d-a865-b46415d719bf"). InnerVolumeSpecName "kube-api-access-ptgfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:19.334807 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.334785    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbhlk\" (UniqueName: \"kubernetes.io/projected/6a02495e-8e18-4692-90f8-400185d19ff1-kube-api-access-jbhlk\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.334807 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.334806    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4a5ec3-8624-4c7d-a865-b46415d719bf-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.334952 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.334816    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a02495e-8e18-4692-90f8-400185d19ff1-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.334952 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.334824    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptgfb\" (UniqueName: \"kubernetes.io/projected/8e4a5ec3-8624-4c7d-a865-b46415d719bf-kube-api-access-ptgfb\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.676816 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.676788    2576 generic.go:356] "Generic (PLEG): container finished" podID="8e4a5ec3-8624-4c7d-a865-b46415d719bf" containerID="4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4" exitCode=0
Jul 29 19:54:19.677099 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.676822    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"
Jul 29 19:54:19.677099 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.676877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w" event={"ID":"8e4a5ec3-8624-4c7d-a865-b46415d719bf","Type":"ContainerDied","Data":"4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4"}
Jul 29 19:54:19.677099 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.676932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w" event={"ID":"8e4a5ec3-8624-4c7d-a865-b46415d719bf","Type":"ContainerDied","Data":"f290d577406077bd542acac6f9039741f5c1e929cd701ea7a78d4c14e1113e07"}
Jul 29 19:54:19.677099 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.676963    2576 scope.go:117] "RemoveContainer" containerID="4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4"
Jul 29 19:54:19.678187 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.678170    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a02495e-8e18-4692-90f8-400185d19ff1" containerID="40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a" exitCode=0
Jul 29 19:54:19.678275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.678195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx" event={"ID":"6a02495e-8e18-4692-90f8-400185d19ff1","Type":"ContainerDied","Data":"40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a"}
Jul 29 19:54:19.678275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.678211    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"
Jul 29 19:54:19.678275 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.678239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx" event={"ID":"6a02495e-8e18-4692-90f8-400185d19ff1","Type":"ContainerDied","Data":"115c47d9164927a31736a6e9851ff2bf6cdca2db50dbfbd6d6b2817a1f5f5b43"}
Jul 29 19:54:19.685310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.685291    2576 scope.go:117] "RemoveContainer" containerID="4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4"
Jul 29 19:54:19.685597 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:54:19.685573    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4\": container with ID starting with 4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4 not found: ID does not exist" containerID="4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4"
Jul 29 19:54:19.685654 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.685608    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4"} err="failed to get container status \"4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4\": rpc error: code = NotFound desc = could not find container \"4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4\": container with ID starting with 4fc6344641b460f2fd6dbb579d8326f45d99f47550a5551dfca6b963fae1ecf4 not found: ID does not exist"
Jul 29 19:54:19.685654 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.685631    2576 scope.go:117] "RemoveContainer" containerID="40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a"
Jul 29 19:54:19.693084 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.693068    2576 scope.go:117] "RemoveContainer" containerID="40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a"
Jul 29 19:54:19.693308 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:54:19.693291    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a\": container with ID starting with 40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a not found: ID does not exist" containerID="40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a"
Jul 29 19:54:19.693359 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.693314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a"} err="failed to get container status \"40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a\": rpc error: code = NotFound desc = could not find container \"40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a\": container with ID starting with 40746956c3a3dd7a92a585c56b5d0700a95f2a8816c04244746905f72a806f0a not found: ID does not exist"
Jul 29 19:54:19.700425 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.700403    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"]
Jul 29 19:54:19.706127 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.706109    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a62265-687f4f58d4-4rt8w"]
Jul 29 19:54:19.714930 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.714912    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"]
Jul 29 19:54:19.718017 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:19.717995    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a62265-8cf98b75b-gx5tx"]
Jul 29 19:54:20.672123 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:20.672096    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a02495e-8e18-4692-90f8-400185d19ff1" path="/var/lib/kubelet/pods/6a02495e-8e18-4692-90f8-400185d19ff1/volumes"
Jul 29 19:54:20.672474 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:20.672431    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4a5ec3-8624-4c7d-a865-b46415d719bf" path="/var/lib/kubelet/pods/8e4a5ec3-8624-4c7d-a865-b46415d719bf/volumes"
Jul 29 19:54:20.672704 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:20.672691    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50" path="/var/lib/kubelet/pods/c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50/volumes"
Jul 29 19:54:25.775310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775279    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"]
Jul 29 19:54:25.775662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775608    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4a5ec3-8624-4c7d-a865-b46415d719bf" containerName="payload-pre-processing"
Jul 29 19:54:25.775662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775618    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4a5ec3-8624-4c7d-a865-b46415d719bf" containerName="payload-pre-processing"
Jul 29 19:54:25.775662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775638    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50" containerName="revoke-keys"
Jul 29 19:54:25.775662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775643    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50" containerName="revoke-keys"
Jul 29 19:54:25.775662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775653    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a02495e-8e18-4692-90f8-400185d19ff1" containerName="payload-processing"
Jul 29 19:54:25.775662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775659    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a02495e-8e18-4692-90f8-400185d19ff1" containerName="payload-processing"
Jul 29 19:54:25.775847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775713    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4a5ec3-8624-4c7d-a865-b46415d719bf" containerName="payload-pre-processing"
Jul 29 19:54:25.775847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775721    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a02495e-8e18-4692-90f8-400185d19ff1" containerName="payload-processing"
Jul 29 19:54:25.775847 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.775728    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c67d8aca-83ef-4a5c-a0bb-cdda16ee2c50" containerName="revoke-keys"
Jul 29 19:54:25.780380 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.780364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:25.782260 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.782242    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:54:25.782373 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.782275    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:54:25.785463 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.785441    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"]
Jul 29 19:54:25.886132 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.886105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3adaab-44ghd\" (UID: \"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:25.987186 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.987161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3adaab-44ghd\" (UID: \"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:25.987688 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:25.987670    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3adaab-44ghd\" (UID: \"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:26.091651 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:26.091632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:26.214013 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:26.213985    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"]
Jul 29 19:54:26.217090 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:54:26.217062    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16ce8ee_1517_480a_a1a7_99d02c5fbc8f.slice/crio-aa5bb239a0783e38a83872b5f41eeba63461979a45d15e3a05edd84e7a3b0998 WatchSource:0}: Error finding container aa5bb239a0783e38a83872b5f41eeba63461979a45d15e3a05edd84e7a3b0998: Status 404 returned error can't find the container with id aa5bb239a0783e38a83872b5f41eeba63461979a45d15e3a05edd84e7a3b0998
Jul 29 19:54:26.718868 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:26.718798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd" event={"ID":"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f","Type":"ContainerStarted","Data":"286af9c822d9a7af8b66b3112bb250d240387bf90f844d9d26b8ccd92c0ff94f"}
Jul 29 19:54:26.718868 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:26.718844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd" event={"ID":"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f","Type":"ContainerStarted","Data":"aa5bb239a0783e38a83872b5f41eeba63461979a45d15e3a05edd84e7a3b0998"}
Jul 29 19:54:26.734164 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:26.734119    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd" podStartSLOduration=1.734105654 podStartE2EDuration="1.734105654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:26.732128869 +0000 UTC m=+2360.649078446" watchObservedRunningTime="2026-07-29 19:54:26.734105654 +0000 UTC m=+2360.651055239"
Jul 29 19:54:27.725941 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:27.725912    2576 generic.go:356] "Generic (PLEG): container finished" podID="f16ce8ee-1517-480a-a1a7-99d02c5fbc8f" containerID="286af9c822d9a7af8b66b3112bb250d240387bf90f844d9d26b8ccd92c0ff94f" exitCode=0
Jul 29 19:54:27.726348 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:27.725972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd" event={"ID":"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f","Type":"ContainerDied","Data":"286af9c822d9a7af8b66b3112bb250d240387bf90f844d9d26b8ccd92c0ff94f"}
Jul 29 19:54:28.849572 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:28.849550    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:28.911685 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:28.911659    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f-maas-api-service-ca\") pod \"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f\" (UID: \"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f\") "
Jul 29 19:54:28.911965 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:28.911947    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f16ce8ee-1517-480a-a1a7-99d02c5fbc8f" (UID: "f16ce8ee-1517-480a-a1a7-99d02c5fbc8f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:29.012889 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:29.012840    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:29.734976 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:29.734945    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"
Jul 29 19:54:29.735150 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:29.734973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd" event={"ID":"f16ce8ee-1517-480a-a1a7-99d02c5fbc8f","Type":"ContainerDied","Data":"aa5bb239a0783e38a83872b5f41eeba63461979a45d15e3a05edd84e7a3b0998"}
Jul 29 19:54:29.735150 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:29.735017    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa5bb239a0783e38a83872b5f41eeba63461979a45d15e3a05edd84e7a3b0998"
Jul 29 19:54:41.288072 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.288039    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"]
Jul 29 19:54:41.288487 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.288270    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x" podUID="795c953e-c6de-4025-80e5-e71e2206d0f7" containerName="payload-processing" containerID="cri-o://f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5" gracePeriod=30
Jul 29 19:54:41.295095 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.295005    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"]
Jul 29 19:54:41.295648 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.295268    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5" podUID="a626ad06-68f4-4928-b80d-8830be95728e" containerName="payload-pre-processing" containerID="cri-o://eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd" gracePeriod=30
Jul 29 19:54:41.486523 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.486488    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"]
Jul 29 19:54:41.494405 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.494357    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3adaab-44ghd"]
Jul 29 19:54:41.556877 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.556855    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:54:41.559328 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.559310    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:54:41.613440 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.613415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a626ad06-68f4-4928-b80d-8830be95728e-plugins-config-volume\") pod \"a626ad06-68f4-4928-b80d-8830be95728e\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") "
Jul 29 19:54:41.613553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.613461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/795c953e-c6de-4025-80e5-e71e2206d0f7-plugins-config-volume\") pod \"795c953e-c6de-4025-80e5-e71e2206d0f7\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") "
Jul 29 19:54:41.613553 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.613533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqclv\" (UniqueName: \"kubernetes.io/projected/795c953e-c6de-4025-80e5-e71e2206d0f7-kube-api-access-bqclv\") pod \"795c953e-c6de-4025-80e5-e71e2206d0f7\" (UID: \"795c953e-c6de-4025-80e5-e71e2206d0f7\") "
Jul 29 19:54:41.613675 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.613554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hh6l\" (UniqueName: \"kubernetes.io/projected/a626ad06-68f4-4928-b80d-8830be95728e-kube-api-access-2hh6l\") pod \"a626ad06-68f4-4928-b80d-8830be95728e\" (UID: \"a626ad06-68f4-4928-b80d-8830be95728e\") "
Jul 29 19:54:41.613872 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.613840    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a626ad06-68f4-4928-b80d-8830be95728e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a626ad06-68f4-4928-b80d-8830be95728e" (UID: "a626ad06-68f4-4928-b80d-8830be95728e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:41.613872 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.613866    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795c953e-c6de-4025-80e5-e71e2206d0f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "795c953e-c6de-4025-80e5-e71e2206d0f7" (UID: "795c953e-c6de-4025-80e5-e71e2206d0f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:41.615518 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.615494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795c953e-c6de-4025-80e5-e71e2206d0f7-kube-api-access-bqclv" (OuterVolumeSpecName: "kube-api-access-bqclv") pod "795c953e-c6de-4025-80e5-e71e2206d0f7" (UID: "795c953e-c6de-4025-80e5-e71e2206d0f7"). InnerVolumeSpecName "kube-api-access-bqclv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:41.615616 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.615570    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a626ad06-68f4-4928-b80d-8830be95728e-kube-api-access-2hh6l" (OuterVolumeSpecName: "kube-api-access-2hh6l") pod "a626ad06-68f4-4928-b80d-8830be95728e" (UID: "a626ad06-68f4-4928-b80d-8830be95728e"). InnerVolumeSpecName "kube-api-access-2hh6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:41.714301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.714278    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqclv\" (UniqueName: \"kubernetes.io/projected/795c953e-c6de-4025-80e5-e71e2206d0f7-kube-api-access-bqclv\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.714301 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.714300    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hh6l\" (UniqueName: \"kubernetes.io/projected/a626ad06-68f4-4928-b80d-8830be95728e-kube-api-access-2hh6l\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.714461 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.714310    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a626ad06-68f4-4928-b80d-8830be95728e-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.714461 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.714320    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/795c953e-c6de-4025-80e5-e71e2206d0f7-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.792662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.792599    2576 generic.go:356] "Generic (PLEG): container finished" podID="a626ad06-68f4-4928-b80d-8830be95728e" containerID="eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd" exitCode=0
Jul 29 19:54:41.792662 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.792641    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"
Jul 29 19:54:41.792813 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.792688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5" event={"ID":"a626ad06-68f4-4928-b80d-8830be95728e","Type":"ContainerDied","Data":"eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd"}
Jul 29 19:54:41.792813 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.792742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5" event={"ID":"a626ad06-68f4-4928-b80d-8830be95728e","Type":"ContainerDied","Data":"450be182f31ed1cbe49f263ca6237908eb8d093d61d5c83630d60bed19a6d4a0"}
Jul 29 19:54:41.792813 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.792765    2576 scope.go:117] "RemoveContainer" containerID="eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd"
Jul 29 19:54:41.794063 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.794041    2576 generic.go:356] "Generic (PLEG): container finished" podID="795c953e-c6de-4025-80e5-e71e2206d0f7" containerID="f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5" exitCode=0
Jul 29 19:54:41.794184 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.794079    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"
Jul 29 19:54:41.794184 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.794086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x" event={"ID":"795c953e-c6de-4025-80e5-e71e2206d0f7","Type":"ContainerDied","Data":"f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5"}
Jul 29 19:54:41.794184 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.794125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x" event={"ID":"795c953e-c6de-4025-80e5-e71e2206d0f7","Type":"ContainerDied","Data":"675eaba2540a0c803140df84ae5162c84fd20add3ffc6919bde2897756d3506a"}
Jul 29 19:54:41.803891 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.803876    2576 scope.go:117] "RemoveContainer" containerID="eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd"
Jul 29 19:54:41.804238 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:54:41.804214    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd\": container with ID starting with eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd not found: ID does not exist" containerID="eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd"
Jul 29 19:54:41.804323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.804249    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd"} err="failed to get container status \"eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd\": rpc error: code = NotFound desc = could not find container \"eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd\": container with ID starting with eab1b1f60a918ba397a5ecf13af0b99998a149a82a725b4cf29909cbc89db0fd not found: ID does not exist"
Jul 29 19:54:41.804323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.804272    2576 scope.go:117] "RemoveContainer" containerID="f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5"
Jul 29 19:54:41.811757 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.811740    2576 scope.go:117] "RemoveContainer" containerID="f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5"
Jul 29 19:54:41.811999 ip-10-0-130-131 kubenswrapper[2576]: E0729 19:54:41.811983    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5\": container with ID starting with f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5 not found: ID does not exist" containerID="f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5"
Jul 29 19:54:41.812091 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.812006    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5"} err="failed to get container status \"f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5\": rpc error: code = NotFound desc = could not find container \"f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5\": container with ID starting with f5cad7c737830b4150d5ea6335c140227a3f093e819fd639e7b30055153ae7f5 not found: ID does not exist"
Jul 29 19:54:41.813071 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.813053    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"]
Jul 29 19:54:41.816138 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.816119    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3adaab-678dfc95bd-kj6f5"]
Jul 29 19:54:41.827030 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.827001    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"]
Jul 29 19:54:41.829952 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:41.829934    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3adaab-8566476754-tv72x"]
Jul 29 19:54:42.672442 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:42.672408    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="795c953e-c6de-4025-80e5-e71e2206d0f7" path="/var/lib/kubelet/pods/795c953e-c6de-4025-80e5-e71e2206d0f7/volumes"
Jul 29 19:54:42.672913 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:42.672891    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a626ad06-68f4-4928-b80d-8830be95728e" path="/var/lib/kubelet/pods/a626ad06-68f4-4928-b80d-8830be95728e/volumes"
Jul 29 19:54:42.673267 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:42.673248    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16ce8ee-1517-480a-a1a7-99d02c5fbc8f" path="/var/lib/kubelet/pods/f16ce8ee-1517-480a-a1a7-99d02c5fbc8f/volumes"
Jul 29 19:54:52.515224 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515190    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"]
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515542    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="795c953e-c6de-4025-80e5-e71e2206d0f7" containerName="payload-processing"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515554    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="795c953e-c6de-4025-80e5-e71e2206d0f7" containerName="payload-processing"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515566    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16ce8ee-1517-480a-a1a7-99d02c5fbc8f" containerName="revoke-keys"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515571    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16ce8ee-1517-480a-a1a7-99d02c5fbc8f" containerName="revoke-keys"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515579    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a626ad06-68f4-4928-b80d-8830be95728e" containerName="payload-pre-processing"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515585    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a626ad06-68f4-4928-b80d-8830be95728e" containerName="payload-pre-processing"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515637    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="795c953e-c6de-4025-80e5-e71e2206d0f7" containerName="payload-processing"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515647    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a626ad06-68f4-4928-b80d-8830be95728e" containerName="payload-pre-processing"
Jul 29 19:54:52.515676 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.515654    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16ce8ee-1517-480a-a1a7-99d02c5fbc8f" containerName="revoke-keys"
Jul 29 19:54:52.520125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.520107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.522065 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.522044    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-9a3702\""
Jul 29 19:54:52.527334 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.527079    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"]
Jul 29 19:54:52.544491 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.544463    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"]
Jul 29 19:54:52.547905 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.547883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.549751 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.549731    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-9a3702-dockercfg-mgvx7\""
Jul 29 19:54:52.558942 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.558918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"]
Jul 29 19:54:52.606670 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.606643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.606813 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.606691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lhtj\" (UniqueName: \"kubernetes.io/projected/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-kube-api-access-9lhtj\") pod \"payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.708135 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.708101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.708305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.708162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lhtj\" (UniqueName: \"kubernetes.io/projected/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-kube-api-access-9lhtj\") pod \"payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.708305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.708209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0730dcd-632a-4fee-8be6-b801b9b5eed7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.708305 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.708261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknwl\" (UniqueName: \"kubernetes.io/projected/f0730dcd-632a-4fee-8be6-b801b9b5eed7-kube-api-access-gknwl\") pod \"payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.708741 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.708723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.715506 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.715483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lhtj\" (UniqueName: \"kubernetes.io/projected/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-kube-api-access-9lhtj\") pod \"payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.809777 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.809754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknwl\" (UniqueName: \"kubernetes.io/projected/f0730dcd-632a-4fee-8be6-b801b9b5eed7-kube-api-access-gknwl\") pod \"payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.809943 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.809829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0730dcd-632a-4fee-8be6-b801b9b5eed7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.810502 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.810482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0730dcd-632a-4fee-8be6-b801b9b5eed7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.817162 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.817142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknwl\" (UniqueName: \"kubernetes.io/projected/f0730dcd-632a-4fee-8be6-b801b9b5eed7-kube-api-access-gknwl\") pod \"payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.831125 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.831103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:52.857732 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.857709    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:52.968323 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.968295    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"]
Jul 29 19:54:52.971400 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:54:52.971349    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab56e34_2116_4cc1_a85f_ec2fc60a3646.slice/crio-7b8c1d1c8b567e3d33231c1007627ac309e8ea6a50420c6991f4d0af82bc4fb1 WatchSource:0}: Error finding container 7b8c1d1c8b567e3d33231c1007627ac309e8ea6a50420c6991f4d0af82bc4fb1: Status 404 returned error can't find the container with id 7b8c1d1c8b567e3d33231c1007627ac309e8ea6a50420c6991f4d0af82bc4fb1
Jul 29 19:54:52.997160 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:52.997138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"]
Jul 29 19:54:53.005016 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:54:53.004995    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0730dcd_632a_4fee_8be6_b801b9b5eed7.slice/crio-3bba0955a31469b7aa36ff791b59a8060c527720f33b05fc7b0287b3c40bf319 WatchSource:0}: Error finding container 3bba0955a31469b7aa36ff791b59a8060c527720f33b05fc7b0287b3c40bf319: Status 404 returned error can't find the container with id 3bba0955a31469b7aa36ff791b59a8060c527720f33b05fc7b0287b3c40bf319
Jul 29 19:54:53.862557 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.862517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2" event={"ID":"2ab56e34-2116-4cc1-a85f-ec2fc60a3646","Type":"ContainerStarted","Data":"0609c0be03a4fcb8faee575062cb00ced245493edb9fbe2d7dab4b207556a4bb"}
Jul 29 19:54:53.862994 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.862614    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:54:53.862994 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.862638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2" event={"ID":"2ab56e34-2116-4cc1-a85f-ec2fc60a3646","Type":"ContainerStarted","Data":"7b8c1d1c8b567e3d33231c1007627ac309e8ea6a50420c6991f4d0af82bc4fb1"}
Jul 29 19:54:53.864085 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.864058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4" event={"ID":"f0730dcd-632a-4fee-8be6-b801b9b5eed7","Type":"ContainerStarted","Data":"8ac763023e3caf400545232dc286dd59841621e95d3b0ec97ca2c776e9960a32"}
Jul 29 19:54:53.864174 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.864107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4" event={"ID":"f0730dcd-632a-4fee-8be6-b801b9b5eed7","Type":"ContainerStarted","Data":"3bba0955a31469b7aa36ff791b59a8060c527720f33b05fc7b0287b3c40bf319"}
Jul 29 19:54:53.864174 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.864151    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:54:53.879130 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.879082    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2" podStartSLOduration=1.879064707 podStartE2EDuration="1.879064707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:53.876039363 +0000 UTC m=+2387.792988943" watchObservedRunningTime="2026-07-29 19:54:53.879064707 +0000 UTC m=+2387.796014298"
Jul 29 19:54:53.894161 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:54:53.894114    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4" podStartSLOduration=1.894097632 podStartE2EDuration="1.894097632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:53.891283357 +0000 UTC m=+2387.808232943" watchObservedRunningTime="2026-07-29 19:54:53.894097632 +0000 UTC m=+2387.811047219"
Jul 29 19:55:04.870736 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:04.870710    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 19:55:04.871214 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:04.870783    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 19:55:06.676997 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:06.676967    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:55:06.678397 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:06.678371    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 19:55:20.672206 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.672176    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"]
Jul 29 19:55:20.675558 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.675541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.677536 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.677517    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-8ef216-dockercfg-jcc7c\""
Jul 29 19:55:20.677638 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.677550    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-8ef216\""
Jul 29 19:55:20.685050 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.685011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"]
Jul 29 19:55:20.715272 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.715239    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"]
Jul 29 19:55:20.718495 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.718474    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.727233 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.727210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"]
Jul 29 19:55:20.745995 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.745963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7znw7\" (UniqueName: \"kubernetes.io/projected/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-kube-api-access-7znw7\") pod \"payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.746190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.745999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q79xg\" (UniqueName: \"kubernetes.io/projected/d912d499-49e5-460a-923e-6273b752d46b-kube-api-access-q79xg\") pod \"payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.746190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.746049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.746190 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.746179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d912d499-49e5-460a-923e-6273b752d46b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.846870 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.846820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7znw7\" (UniqueName: \"kubernetes.io/projected/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-kube-api-access-7znw7\") pod \"payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.846870 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.846867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q79xg\" (UniqueName: \"kubernetes.io/projected/d912d499-49e5-460a-923e-6273b752d46b-kube-api-access-q79xg\") pod \"payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.846870 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.846887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.847268 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.846933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d912d499-49e5-460a-923e-6273b752d46b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.847641 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.847621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d912d499-49e5-460a-923e-6273b752d46b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.847685 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.847624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.854706 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.854680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q79xg\" (UniqueName: \"kubernetes.io/projected/d912d499-49e5-460a-923e-6273b752d46b-kube-api-access-q79xg\") pod \"payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:20.854811 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.854789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7znw7\" (UniqueName: \"kubernetes.io/projected/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-kube-api-access-7znw7\") pod \"payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:20.986064 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:20.985966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:21.029876 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.029846    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:21.120786 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.120750    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"]
Jul 29 19:55:21.123044 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:55:21.122987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd912d499_49e5_460a_923e_6273b752d46b.slice/crio-178d5e4eda4eeb16b3ac4f9534216359ea3d28fcc3e32988ddb8a4753da6edc4 WatchSource:0}: Error finding container 178d5e4eda4eeb16b3ac4f9534216359ea3d28fcc3e32988ddb8a4753da6edc4: Status 404 returned error can't find the container with id 178d5e4eda4eeb16b3ac4f9534216359ea3d28fcc3e32988ddb8a4753da6edc4
Jul 29 19:55:21.171229 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.171209    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"]
Jul 29 19:55:21.183965 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:55:21.183940    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb5b2d4_3de1_4b87_b24b_1f78308ddd1d.slice/crio-6794050b45fd7ea3e7e45df58f59fcea46c93c9b91f3aa740d5eeaad060a3a38 WatchSource:0}: Error finding container 6794050b45fd7ea3e7e45df58f59fcea46c93c9b91f3aa740d5eeaad060a3a38: Status 404 returned error can't find the container with id 6794050b45fd7ea3e7e45df58f59fcea46c93c9b91f3aa740d5eeaad060a3a38
Jul 29 19:55:21.995993 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.995958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65" event={"ID":"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d","Type":"ContainerStarted","Data":"539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07"}
Jul 29 19:55:21.996439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.996041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:21.996439 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.996067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65" event={"ID":"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d","Type":"ContainerStarted","Data":"6794050b45fd7ea3e7e45df58f59fcea46c93c9b91f3aa740d5eeaad060a3a38"}
Jul 29 19:55:21.997463 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.997442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd" event={"ID":"d912d499-49e5-460a-923e-6273b752d46b","Type":"ContainerStarted","Data":"b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31"}
Jul 29 19:55:21.997566 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.997478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd" event={"ID":"d912d499-49e5-460a-923e-6273b752d46b","Type":"ContainerStarted","Data":"178d5e4eda4eeb16b3ac4f9534216359ea3d28fcc3e32988ddb8a4753da6edc4"}
Jul 29 19:55:21.997566 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:21.997502    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:22.013504 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:22.013457    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65" podStartSLOduration=2.013439353 podStartE2EDuration="2.013439353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:22.012975875 +0000 UTC m=+2415.929925462" watchObservedRunningTime="2026-07-29 19:55:22.013439353 +0000 UTC m=+2415.930388942"
Jul 29 19:55:22.027204 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:22.027164    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd" podStartSLOduration=2.027153584 podStartE2EDuration="2.027153584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:22.027082408 +0000 UTC m=+2415.944031994" watchObservedRunningTime="2026-07-29 19:55:22.027153584 +0000 UTC m=+2415.944103184"
Jul 29 19:55:33.004310 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:33.004222    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 19:55:33.004854 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:33.004481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 19:55:55.917410 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.917366    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"]
Jul 29 19:55:55.921338 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.921317    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:55.924330 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.924307    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"auth-test-model-9a3702-kserve-self-signed-certs\""
Jul 29 19:55:55.924484 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.924347    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"openshift-service-ca.crt\""
Jul 29 19:55:55.924484 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.924311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"default-dockercfg-n8trl\""
Jul 29 19:55:55.924484 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.924413    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"kube-root-ca.crt\""
Jul 29 19:55:55.928881 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.928835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"]
Jul 29 19:55:55.975573 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.975537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tls-certs\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:55.975738 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.975592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-dshm\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:55.975738 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.975620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-model-cache\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:55.975738 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.975656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9vfm\" (UniqueName: \"kubernetes.io/projected/ea603b36-5e5b-4bf5-b6da-e63350e225a4-kube-api-access-n9vfm\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:55.975738 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.975728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tmp-dir\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:55.975874 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:55.975763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-home\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.076707 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.076676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-dshm\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.076707 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.076708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-model-cache\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.076929 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.076737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9vfm\" (UniqueName: \"kubernetes.io/projected/ea603b36-5e5b-4bf5-b6da-e63350e225a4-kube-api-access-n9vfm\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.076929 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.076773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tmp-dir\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.076929 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.076794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-home\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.076929 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.076821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tls-certs\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.077224 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.077200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tmp-dir\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.077312 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.077210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-model-cache\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.077312 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.077251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-home\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.078883 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.078866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-dshm\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.079239 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.079218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tls-certs\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.084843 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.084821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9vfm\" (UniqueName: \"kubernetes.io/projected/ea603b36-5e5b-4bf5-b6da-e63350e225a4-kube-api-access-n9vfm\") pod \"auth-test-model-9a3702-kserve-67b98744c-gj7gb\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") " pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.232903 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.232825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:55:56.366564 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:56.366532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"]
Jul 29 19:55:56.370558 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:55:56.370529    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea603b36_5e5b_4bf5_b6da_e63350e225a4.slice/crio-7e7deec637c7529b6deaf27bb6cde83b24687cf14ba652148ac59c7a9f789ab3 WatchSource:0}: Error finding container 7e7deec637c7529b6deaf27bb6cde83b24687cf14ba652148ac59c7a9f789ab3: Status 404 returned error can't find the container with id 7e7deec637c7529b6deaf27bb6cde83b24687cf14ba652148ac59c7a9f789ab3
Jul 29 19:55:57.177770 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:57.177734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb" event={"ID":"ea603b36-5e5b-4bf5-b6da-e63350e225a4","Type":"ContainerStarted","Data":"5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05"}
Jul 29 19:55:57.178260 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:57.177781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb" event={"ID":"ea603b36-5e5b-4bf5-b6da-e63350e225a4","Type":"ContainerStarted","Data":"7e7deec637c7529b6deaf27bb6cde83b24687cf14ba652148ac59c7a9f789ab3"}
Jul 29 19:55:57.193164 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:55:57.193112    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb" podStartSLOduration=2.193087108 podStartE2EDuration="2.193087108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:57.192158449 +0000 UTC m=+2451.109108061" watchObservedRunningTime="2026-07-29 19:55:57.193087108 +0000 UTC m=+2451.110036695"
Jul 29 19:56:06.233401 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:06.233365    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:56:06.233794 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:06.233422    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:56:06.246006 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:06.245983    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:56:07.236241 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:07.236208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 19:56:24.634349 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.634316    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"]
Jul 29 19:56:24.637765 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.637744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.639863 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.639843    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"kube-root-ca.crt\""
Jul 29 19:56:24.639982 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.639939    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"openshift-service-ca.crt\""
Jul 29 19:56:24.640297 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.640281    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"default-dockercfg-2zwvh\""
Jul 29 19:56:24.640458 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.640440    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"auth-test-model-8ef216-kserve-self-signed-certs\""
Jul 29 19:56:24.647967 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.647941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"]
Jul 29 19:56:24.743879 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.743838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b71de7a-df23-40f0-b8fd-c4553c15474c-tls-certs\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.744097 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.743942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-model-cache\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.744097 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.743990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-tmp-dir\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.744097 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.744039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2pt\" (UniqueName: \"kubernetes.io/projected/3b71de7a-df23-40f0-b8fd-c4553c15474c-kube-api-access-nm2pt\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.744244 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.744153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-home\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.744244 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.744233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-dshm\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845268 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2pt\" (UniqueName: \"kubernetes.io/projected/3b71de7a-df23-40f0-b8fd-c4553c15474c-kube-api-access-nm2pt\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845453 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-home\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845453 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-dshm\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845453 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b71de7a-df23-40f0-b8fd-c4553c15474c-tls-certs\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845453 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-model-cache\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845677 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-tmp-dir\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845804 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-home\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845863 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-model-cache\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.845900 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.845876    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-tmp-dir\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.847764 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.847744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-dshm\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.847945 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.847927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b71de7a-df23-40f0-b8fd-c4553c15474c-tls-certs\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.853343 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.853321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2pt\" (UniqueName: \"kubernetes.io/projected/3b71de7a-df23-40f0-b8fd-c4553c15474c-kube-api-access-nm2pt\") pod \"auth-test-model-8ef216-kserve-675b6d9767-6np76\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") " pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:24.948241 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:24.948159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:25.084083 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:25.084057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"]
Jul 29 19:56:25.086945 ip-10-0-130-131 kubenswrapper[2576]: W0729 19:56:25.086908    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b71de7a_df23_40f0_b8fd_c4553c15474c.slice/crio-559b288c40c4bcc8e862ba2c819003caea3ed34876710eda99b6d244dde5101f WatchSource:0}: Error finding container 559b288c40c4bcc8e862ba2c819003caea3ed34876710eda99b6d244dde5101f: Status 404 returned error can't find the container with id 559b288c40c4bcc8e862ba2c819003caea3ed34876710eda99b6d244dde5101f
Jul 29 19:56:25.313321 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:25.313292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76" event={"ID":"3b71de7a-df23-40f0-b8fd-c4553c15474c","Type":"ContainerStarted","Data":"2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562"}
Jul 29 19:56:25.313497 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:25.313331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76" event={"ID":"3b71de7a-df23-40f0-b8fd-c4553c15474c","Type":"ContainerStarted","Data":"559b288c40c4bcc8e862ba2c819003caea3ed34876710eda99b6d244dde5101f"}
Jul 29 19:56:25.331945 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:25.331881    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76" podStartSLOduration=1.331861842 podStartE2EDuration="1.331861842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:56:25.33117481 +0000 UTC m=+2479.248124399" watchObservedRunningTime="2026-07-29 19:56:25.331861842 +0000 UTC m=+2479.248811430"
Jul 29 19:56:34.948908 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:34.948872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:34.949387 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:34.948930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:34.961183 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:34.961157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:56:35.376994 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:56:35.376967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 19:59:06.922392 ip-10-0-130-131 kubenswrapper[2576]: I0729 19:59:06.922302    2576 scope.go:117] "RemoveContainer" containerID="1890d929d8a54b4f28ca8706d4c11d5f9cd48bc1740f468489d3edabd05a0763"
Jul 29 20:00:06.706749 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:00:06.706681    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 20:00:06.709694 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:00:06.709668    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 20:00:06.943170 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:00:06.943141    2576 scope.go:117] "RemoveContainer" containerID="1188971fe38902f4b23c99de1d222f16890c36081e23bb24076e4be7e0e81d0d"
Jul 29 20:00:50.214839 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:00:50.214803    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"]
Jul 29 20:00:51.311510 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:00:51.311472    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"]
Jul 29 20:01:05.233983 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.233937    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb" podUID="ea603b36-5e5b-4bf5-b6da-e63350e225a4" containerName="main" containerID="cri-o://5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05" gracePeriod=45
Jul 29 20:01:05.480659 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.480632    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 20:01:05.564000 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.563974    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-home\") pod \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") "
Jul 29 20:01:05.564172 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564065    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-dshm\") pod \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") "
Jul 29 20:01:05.564172 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tmp-dir\") pod \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") "
Jul 29 20:01:05.564172 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564118    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9vfm\" (UniqueName: \"kubernetes.io/projected/ea603b36-5e5b-4bf5-b6da-e63350e225a4-kube-api-access-n9vfm\") pod \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") "
Jul 29 20:01:05.564292 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564181    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-model-cache\") pod \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") "
Jul 29 20:01:05.564292 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-home" (OuterVolumeSpecName: "home") pod "ea603b36-5e5b-4bf5-b6da-e63350e225a4" (UID: "ea603b36-5e5b-4bf5-b6da-e63350e225a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:05.564292 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tls-certs\") pod \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\" (UID: \"ea603b36-5e5b-4bf5-b6da-e63350e225a4\") "
Jul 29 20:01:05.564409 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564359    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea603b36-5e5b-4bf5-b6da-e63350e225a4" (UID: "ea603b36-5e5b-4bf5-b6da-e63350e225a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:05.564479 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564444    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea603b36-5e5b-4bf5-b6da-e63350e225a4" (UID: "ea603b36-5e5b-4bf5-b6da-e63350e225a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:05.564620 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564602    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:05.564699 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564622    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:05.564699 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.564634    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:05.566349 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.566320    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-dshm" (OuterVolumeSpecName: "dshm") pod "ea603b36-5e5b-4bf5-b6da-e63350e225a4" (UID: "ea603b36-5e5b-4bf5-b6da-e63350e225a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:05.566462 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.566412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea603b36-5e5b-4bf5-b6da-e63350e225a4" (UID: "ea603b36-5e5b-4bf5-b6da-e63350e225a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:01:05.566504 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.566470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea603b36-5e5b-4bf5-b6da-e63350e225a4-kube-api-access-n9vfm" (OuterVolumeSpecName: "kube-api-access-n9vfm") pod "ea603b36-5e5b-4bf5-b6da-e63350e225a4" (UID: "ea603b36-5e5b-4bf5-b6da-e63350e225a4"). InnerVolumeSpecName "kube-api-access-n9vfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:01:05.665881 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.665830    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea603b36-5e5b-4bf5-b6da-e63350e225a4-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:05.665881 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.665873    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea603b36-5e5b-4bf5-b6da-e63350e225a4-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:05.665881 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.665884    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9vfm\" (UniqueName: \"kubernetes.io/projected/ea603b36-5e5b-4bf5-b6da-e63350e225a4-kube-api-access-n9vfm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:05.696863 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.696830    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea603b36-5e5b-4bf5-b6da-e63350e225a4" containerID="5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05" exitCode=0
Jul 29 20:01:05.697060 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.696874    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"
Jul 29 20:01:05.697060 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.696912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb" event={"ID":"ea603b36-5e5b-4bf5-b6da-e63350e225a4","Type":"ContainerDied","Data":"5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05"}
Jul 29 20:01:05.697060 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.696955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb" event={"ID":"ea603b36-5e5b-4bf5-b6da-e63350e225a4","Type":"ContainerDied","Data":"7e7deec637c7529b6deaf27bb6cde83b24687cf14ba652148ac59c7a9f789ab3"}
Jul 29 20:01:05.697060 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.696971    2576 scope.go:117] "RemoveContainer" containerID="5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05"
Jul 29 20:01:05.706470 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.706454    2576 scope.go:117] "RemoveContainer" containerID="5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05"
Jul 29 20:01:05.706728 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:01:05.706708    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05\": container with ID starting with 5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05 not found: ID does not exist" containerID="5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05"
Jul 29 20:01:05.706770 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.706738    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05"} err="failed to get container status \"5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05\": rpc error: code = NotFound desc = could not find container \"5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05\": container with ID starting with 5d1ce3f5f3eab70479aba9ea52263d05f1498d218f6415be91d3619bb7bc8b05 not found: ID does not exist"
Jul 29 20:01:05.723780 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.723739    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"]
Jul 29 20:01:05.725867 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:05.725848    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/auth-test-model-9a3702-kserve-67b98744c-gj7gb"]
Jul 29 20:01:06.337718 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.337650    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76" podUID="3b71de7a-df23-40f0-b8fd-c4553c15474c" containerName="main" containerID="cri-o://2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562" gracePeriod=45
Jul 29 20:01:06.581495 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.581468    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 20:01:06.672797 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.672718    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea603b36-5e5b-4bf5-b6da-e63350e225a4" path="/var/lib/kubelet/pods/ea603b36-5e5b-4bf5-b6da-e63350e225a4/volumes"
Jul 29 20:01:06.675630 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675610    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-model-cache\") pod \"3b71de7a-df23-40f0-b8fd-c4553c15474c\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") "
Jul 29 20:01:06.675764 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675651    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm2pt\" (UniqueName: \"kubernetes.io/projected/3b71de7a-df23-40f0-b8fd-c4553c15474c-kube-api-access-nm2pt\") pod \"3b71de7a-df23-40f0-b8fd-c4553c15474c\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") "
Jul 29 20:01:06.675764 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675691    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-tmp-dir\") pod \"3b71de7a-df23-40f0-b8fd-c4553c15474c\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") "
Jul 29 20:01:06.675764 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675727    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-home\") pod \"3b71de7a-df23-40f0-b8fd-c4553c15474c\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") "
Jul 29 20:01:06.675935 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b71de7a-df23-40f0-b8fd-c4553c15474c-tls-certs\") pod \"3b71de7a-df23-40f0-b8fd-c4553c15474c\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") "
Jul 29 20:01:06.675935 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-dshm\") pod \"3b71de7a-df23-40f0-b8fd-c4553c15474c\" (UID: \"3b71de7a-df23-40f0-b8fd-c4553c15474c\") "
Jul 29 20:01:06.675935 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675859    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b71de7a-df23-40f0-b8fd-c4553c15474c" (UID: "3b71de7a-df23-40f0-b8fd-c4553c15474c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:06.676105 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.675943    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b71de7a-df23-40f0-b8fd-c4553c15474c" (UID: "3b71de7a-df23-40f0-b8fd-c4553c15474c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:06.676105 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.676035    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-home" (OuterVolumeSpecName: "home") pod "3b71de7a-df23-40f0-b8fd-c4553c15474c" (UID: "3b71de7a-df23-40f0-b8fd-c4553c15474c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:06.676212 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.676191    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:06.676262 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.676213    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:06.676262 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.676223    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:06.677812 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.677782    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b71de7a-df23-40f0-b8fd-c4553c15474c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b71de7a-df23-40f0-b8fd-c4553c15474c" (UID: "3b71de7a-df23-40f0-b8fd-c4553c15474c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:01:06.677910 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.677828    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-dshm" (OuterVolumeSpecName: "dshm") pod "3b71de7a-df23-40f0-b8fd-c4553c15474c" (UID: "3b71de7a-df23-40f0-b8fd-c4553c15474c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:01:06.677910 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.677852    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b71de7a-df23-40f0-b8fd-c4553c15474c-kube-api-access-nm2pt" (OuterVolumeSpecName: "kube-api-access-nm2pt") pod "3b71de7a-df23-40f0-b8fd-c4553c15474c" (UID: "3b71de7a-df23-40f0-b8fd-c4553c15474c"). InnerVolumeSpecName "kube-api-access-nm2pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:01:06.704328 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.704293    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b71de7a-df23-40f0-b8fd-c4553c15474c" containerID="2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562" exitCode=0
Jul 29 20:01:06.704453 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.704342    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"
Jul 29 20:01:06.704453 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.704375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76" event={"ID":"3b71de7a-df23-40f0-b8fd-c4553c15474c","Type":"ContainerDied","Data":"2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562"}
Jul 29 20:01:06.704453 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.704417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76" event={"ID":"3b71de7a-df23-40f0-b8fd-c4553c15474c","Type":"ContainerDied","Data":"559b288c40c4bcc8e862ba2c819003caea3ed34876710eda99b6d244dde5101f"}
Jul 29 20:01:06.704453 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.704437    2576 scope.go:117] "RemoveContainer" containerID="2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562"
Jul 29 20:01:06.713523 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.713505    2576 scope.go:117] "RemoveContainer" containerID="2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562"
Jul 29 20:01:06.713788 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:01:06.713771    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562\": container with ID starting with 2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562 not found: ID does not exist" containerID="2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562"
Jul 29 20:01:06.713853 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.713797    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562"} err="failed to get container status \"2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562\": rpc error: code = NotFound desc = could not find container \"2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562\": container with ID starting with 2d490a39f5095f4abdd476e31d8bd15ae96d41934e2a1d6eca7be5c3e00fd562 not found: ID does not exist"
Jul 29 20:01:06.725454 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.725427    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"]
Jul 29 20:01:06.728398 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.728379    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/auth-test-model-8ef216-kserve-675b6d9767-6np76"]
Jul 29 20:01:06.776664 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.776636    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm2pt\" (UniqueName: \"kubernetes.io/projected/3b71de7a-df23-40f0-b8fd-c4553c15474c-kube-api-access-nm2pt\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:06.776664 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.776660    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b71de7a-df23-40f0-b8fd-c4553c15474c-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:06.776664 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.776670    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b71de7a-df23-40f0-b8fd-c4553c15474c-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:01:06.964266 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:06.964188    2576 scope.go:117] "RemoveContainer" containerID="286af9c822d9a7af8b66b3112bb250d240387bf90f844d9d26b8ccd92c0ff94f"
Jul 29 20:01:08.672685 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:08.672648    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b71de7a-df23-40f0-b8fd-c4553c15474c" path="/var/lib/kubelet/pods/3b71de7a-df23-40f0-b8fd-c4553c15474c/volumes"
Jul 29 20:01:35.139388 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139312    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"]
Jul 29 20:01:35.139830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139684    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b71de7a-df23-40f0-b8fd-c4553c15474c" containerName="main"
Jul 29 20:01:35.139830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139696    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b71de7a-df23-40f0-b8fd-c4553c15474c" containerName="main"
Jul 29 20:01:35.139830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139708    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea603b36-5e5b-4bf5-b6da-e63350e225a4" containerName="main"
Jul 29 20:01:35.139830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139714    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea603b36-5e5b-4bf5-b6da-e63350e225a4" containerName="main"
Jul 29 20:01:35.139830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139786    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea603b36-5e5b-4bf5-b6da-e63350e225a4" containerName="main"
Jul 29 20:01:35.139830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.139798    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b71de7a-df23-40f0-b8fd-c4553c15474c" containerName="main"
Jul 29 20:01:35.142632 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.142617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.145196 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.145173    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"kube-root-ca.crt\""
Jul 29 20:01:35.145196 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.145189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"default-dockercfg-2zwvh\""
Jul 29 20:01:35.145382 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.145189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"sub-test-model-8ef216-kserve-self-signed-certs\""
Jul 29 20:01:35.145382 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.145239    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"openshift-service-ca.crt\""
Jul 29 20:01:35.151302 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.151283    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"]
Jul 29 20:01:35.236581 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.236551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f9d900-97df-4265-afee-6716e26fe33d-tls-certs\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.236750 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.236586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-tmp-dir\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.236750 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.236625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-model-cache\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.236750 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.236729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-home\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.236917 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.236765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv59b\" (UniqueName: \"kubernetes.io/projected/d7f9d900-97df-4265-afee-6716e26fe33d-kube-api-access-kv59b\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.236917 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.236798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-dshm\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337359 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f9d900-97df-4265-afee-6716e26fe33d-tls-certs\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337487 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-tmp-dir\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337487 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-model-cache\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337487 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-home\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337487 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv59b\" (UniqueName: \"kubernetes.io/projected/d7f9d900-97df-4265-afee-6716e26fe33d-kube-api-access-kv59b\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337487 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-dshm\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337803 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-tmp-dir\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337875 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-home\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.337926 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.337870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-model-cache\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.339684 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.339667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-dshm\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.339843 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.339826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f9d900-97df-4265-afee-6716e26fe33d-tls-certs\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.344900 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.344875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv59b\" (UniqueName: \"kubernetes.io/projected/d7f9d900-97df-4265-afee-6716e26fe33d-kube-api-access-kv59b\") pod \"sub-test-model-8ef216-kserve-5b7d89448c-nm65f\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") " pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.451780 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.451722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:35.580571 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.580547    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"]
Jul 29 20:01:35.582837 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:01:35.582811    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7f9d900_97df_4265_afee_6716e26fe33d.slice/crio-07cf3037f041684fecb8dc0f33cf2cae255badf139dee2e5534aea0dd4dbef95 WatchSource:0}: Error finding container 07cf3037f041684fecb8dc0f33cf2cae255badf139dee2e5534aea0dd4dbef95: Status 404 returned error can't find the container with id 07cf3037f041684fecb8dc0f33cf2cae255badf139dee2e5534aea0dd4dbef95
Jul 29 20:01:35.841049 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.841003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f" event={"ID":"d7f9d900-97df-4265-afee-6716e26fe33d","Type":"ContainerStarted","Data":"16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286"}
Jul 29 20:01:35.841224 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.841059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f" event={"ID":"d7f9d900-97df-4265-afee-6716e26fe33d","Type":"ContainerStarted","Data":"07cf3037f041684fecb8dc0f33cf2cae255badf139dee2e5534aea0dd4dbef95"}
Jul 29 20:01:35.858360 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:35.858314    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f" podStartSLOduration=0.858299863 podStartE2EDuration="858.299863ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:01:35.856655362 +0000 UTC m=+2789.773604949" watchObservedRunningTime="2026-07-29 20:01:35.858299863 +0000 UTC m=+2789.775249458"
Jul 29 20:01:45.452508 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:45.452468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:45.452508 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:45.452513    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:45.464876 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:45.464844    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:01:45.897485 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:01:45.897459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:02:41.308301 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:41.308269    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"]
Jul 29 20:02:48.933429 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.933390    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"]
Jul 29 20:02:48.936903 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.936882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:48.939122 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.939098    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"kube-root-ca.crt\""
Jul 29 20:02:48.939677 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.939649    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"rate-test-model-9a3702-kserve-self-signed-certs\""
Jul 29 20:02:48.939677 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.939653    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"openshift-service-ca.crt\""
Jul 29 20:02:48.939905 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.939653    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"default-dockercfg-n8trl\""
Jul 29 20:02:48.947259 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:48.947235    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"]
Jul 29 20:02:49.027890 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.027850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-dshm\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.027890 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.027895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-tmp-dir\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.028137 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.027978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxl9n\" (UniqueName: \"kubernetes.io/projected/bc9079d9-c671-493e-952f-df88e315b579-kube-api-access-bxl9n\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.028137 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.028077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-model-cache\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.028137 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.028118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc9079d9-c671-493e-952f-df88e315b579-tls-certs\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.028245 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.028150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-home\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.128830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.128789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxl9n\" (UniqueName: \"kubernetes.io/projected/bc9079d9-c671-493e-952f-df88e315b579-kube-api-access-bxl9n\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129075 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.128857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-model-cache\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129075 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.128896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc9079d9-c671-493e-952f-df88e315b579-tls-certs\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129075 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.128936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-home\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129075 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.128958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-dshm\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129075 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.128986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-tmp-dir\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129379 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.129355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-model-cache\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129428 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.129400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-home\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.129524 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.129491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-tmp-dir\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.131348 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.131320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-dshm\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.131534 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.131518    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc9079d9-c671-493e-952f-df88e315b579-tls-certs\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.136460 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.136437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxl9n\" (UniqueName: \"kubernetes.io/projected/bc9079d9-c671-493e-952f-df88e315b579-kube-api-access-bxl9n\") pod \"rate-test-model-9a3702-kserve-65887f7bcf-k545d\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") " pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.247455 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.247376    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:49.382991 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:49.382957    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"]
Jul 29 20:02:49.386427 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:02:49.386399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc9079d9_c671_493e_952f_df88e315b579.slice/crio-62d1ed79c29fde1db49c5c229d63c81ac862927d7f7b5bd300693811f674c97d WatchSource:0}: Error finding container 62d1ed79c29fde1db49c5c229d63c81ac862927d7f7b5bd300693811f674c97d: Status 404 returned error can't find the container with id 62d1ed79c29fde1db49c5c229d63c81ac862927d7f7b5bd300693811f674c97d
Jul 29 20:02:50.192240 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:50.192201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d" event={"ID":"bc9079d9-c671-493e-952f-df88e315b579","Type":"ContainerStarted","Data":"820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85"}
Jul 29 20:02:50.192240 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:50.192243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d" event={"ID":"bc9079d9-c671-493e-952f-df88e315b579","Type":"ContainerStarted","Data":"62d1ed79c29fde1db49c5c229d63c81ac862927d7f7b5bd300693811f674c97d"}
Jul 29 20:02:50.207978 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:50.207916    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d" podStartSLOduration=2.207897205 podStartE2EDuration="2.207897205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:02:50.20614299 +0000 UTC m=+2864.123092579" watchObservedRunningTime="2026-07-29 20:02:50.207897205 +0000 UTC m=+2864.124846792"
Jul 29 20:02:56.327712 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.327647    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f" podUID="d7f9d900-97df-4265-afee-6716e26fe33d" containerName="main" containerID="cri-o://16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286" gracePeriod=45
Jul 29 20:02:56.580610 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.580543    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:02:56.597931 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.597873    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-model-cache\") pod \"d7f9d900-97df-4265-afee-6716e26fe33d\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") "
Jul 29 20:02:56.598156 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.597958    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv59b\" (UniqueName: \"kubernetes.io/projected/d7f9d900-97df-4265-afee-6716e26fe33d-kube-api-access-kv59b\") pod \"d7f9d900-97df-4265-afee-6716e26fe33d\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") "
Jul 29 20:02:56.598156 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598046    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-dshm\") pod \"d7f9d900-97df-4265-afee-6716e26fe33d\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") "
Jul 29 20:02:56.598156 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-tmp-dir\") pod \"d7f9d900-97df-4265-afee-6716e26fe33d\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") "
Jul 29 20:02:56.598156 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598159    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-home\") pod \"d7f9d900-97df-4265-afee-6716e26fe33d\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") "
Jul 29 20:02:56.598528 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598213    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f9d900-97df-4265-afee-6716e26fe33d-tls-certs\") pod \"d7f9d900-97df-4265-afee-6716e26fe33d\" (UID: \"d7f9d900-97df-4265-afee-6716e26fe33d\") "
Jul 29 20:02:56.598528 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598382    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7f9d900-97df-4265-afee-6716e26fe33d" (UID: "d7f9d900-97df-4265-afee-6716e26fe33d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:56.598644 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598595    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:02:56.598773 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.598745    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-home" (OuterVolumeSpecName: "home") pod "d7f9d900-97df-4265-afee-6716e26fe33d" (UID: "d7f9d900-97df-4265-afee-6716e26fe33d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:56.599211 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.599160    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7f9d900-97df-4265-afee-6716e26fe33d" (UID: "d7f9d900-97df-4265-afee-6716e26fe33d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:56.601037 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.600968    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-dshm" (OuterVolumeSpecName: "dshm") pod "d7f9d900-97df-4265-afee-6716e26fe33d" (UID: "d7f9d900-97df-4265-afee-6716e26fe33d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:56.601304 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.601277    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7f9d900-97df-4265-afee-6716e26fe33d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7f9d900-97df-4265-afee-6716e26fe33d" (UID: "d7f9d900-97df-4265-afee-6716e26fe33d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:02:56.601408 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.601390    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f9d900-97df-4265-afee-6716e26fe33d-kube-api-access-kv59b" (OuterVolumeSpecName: "kube-api-access-kv59b") pod "d7f9d900-97df-4265-afee-6716e26fe33d" (UID: "d7f9d900-97df-4265-afee-6716e26fe33d"). InnerVolumeSpecName "kube-api-access-kv59b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:02:56.700342 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.700282    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:02:56.700342 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.700317    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:02:56.700546 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.700347    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f9d900-97df-4265-afee-6716e26fe33d-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:02:56.700546 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.700373    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f9d900-97df-4265-afee-6716e26fe33d-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:02:56.700546 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:56.700388    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv59b\" (UniqueName: \"kubernetes.io/projected/d7f9d900-97df-4265-afee-6716e26fe33d-kube-api-access-kv59b\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:02:57.227368 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.227332    2576 generic.go:356] "Generic (PLEG): container finished" podID="d7f9d900-97df-4265-afee-6716e26fe33d" containerID="16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286" exitCode=0
Jul 29 20:02:57.227553 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.227390    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"
Jul 29 20:02:57.227553 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.227405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f" event={"ID":"d7f9d900-97df-4265-afee-6716e26fe33d","Type":"ContainerDied","Data":"16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286"}
Jul 29 20:02:57.227553 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.227439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f" event={"ID":"d7f9d900-97df-4265-afee-6716e26fe33d","Type":"ContainerDied","Data":"07cf3037f041684fecb8dc0f33cf2cae255badf139dee2e5534aea0dd4dbef95"}
Jul 29 20:02:57.227553 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.227456    2576 scope.go:117] "RemoveContainer" containerID="16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286"
Jul 29 20:02:57.242440 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.242418    2576 scope.go:117] "RemoveContainer" containerID="16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286"
Jul 29 20:02:57.242750 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:02:57.242727    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286\": container with ID starting with 16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286 not found: ID does not exist" containerID="16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286"
Jul 29 20:02:57.242822 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.242763    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286"} err="failed to get container status \"16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286\": rpc error: code = NotFound desc = could not find container \"16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286\": container with ID starting with 16eb468780fab5338b8f78a2e83e9001dce8554bd2d51170ee8cd5df9489d286 not found: ID does not exist"
Jul 29 20:02:57.248459 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.248433    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"]
Jul 29 20:02:57.253334 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:57.253307    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/sub-test-model-8ef216-kserve-5b7d89448c-nm65f"]
Jul 29 20:02:58.672804 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:58.672717    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f9d900-97df-4265-afee-6716e26fe33d" path="/var/lib/kubelet/pods/d7f9d900-97df-4265-afee-6716e26fe33d/volumes"
Jul 29 20:02:59.248549 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:59.248517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:59.248714 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:59.248599    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:02:59.261148 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:02:59.261122    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:03:00.255757 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:03:00.255729    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:04:56.516685 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:04:56.516584    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"]
Jul 29 20:05:06.735869 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:06.735844    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 20:05:06.740713 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:06.740692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 20:05:11.539788 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.539741    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d" podUID="bc9079d9-c671-493e-952f-df88e315b579" containerName="main" containerID="cri-o://820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85" gracePeriod=45
Jul 29 20:05:11.797336 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.797265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:05:11.870793 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.870756    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-tmp-dir\") pod \"bc9079d9-c671-493e-952f-df88e315b579\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") "
Jul 29 20:05:11.870998 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.870864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxl9n\" (UniqueName: \"kubernetes.io/projected/bc9079d9-c671-493e-952f-df88e315b579-kube-api-access-bxl9n\") pod \"bc9079d9-c671-493e-952f-df88e315b579\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") "
Jul 29 20:05:11.870998 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.870961    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc9079d9-c671-493e-952f-df88e315b579-tls-certs\") pod \"bc9079d9-c671-493e-952f-df88e315b579\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") "
Jul 29 20:05:11.870998 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.870984    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-home\") pod \"bc9079d9-c671-493e-952f-df88e315b579\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") "
Jul 29 20:05:11.871213 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871005    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-model-cache\") pod \"bc9079d9-c671-493e-952f-df88e315b579\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") "
Jul 29 20:05:11.871213 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871066    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-dshm\") pod \"bc9079d9-c671-493e-952f-df88e315b579\" (UID: \"bc9079d9-c671-493e-952f-df88e315b579\") "
Jul 29 20:05:11.871213 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871086    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bc9079d9-c671-493e-952f-df88e315b579" (UID: "bc9079d9-c671-493e-952f-df88e315b579"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:11.871353 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871276    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-home" (OuterVolumeSpecName: "home") pod "bc9079d9-c671-493e-952f-df88e315b579" (UID: "bc9079d9-c671-493e-952f-df88e315b579"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:11.871353 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871281    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-model-cache" (OuterVolumeSpecName: "model-cache") pod "bc9079d9-c671-493e-952f-df88e315b579" (UID: "bc9079d9-c671-493e-952f-df88e315b579"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:11.871461 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871428    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:05:11.871461 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871447    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:05:11.871558 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.871461    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:05:11.873179 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.873155    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-dshm" (OuterVolumeSpecName: "dshm") pod "bc9079d9-c671-493e-952f-df88e315b579" (UID: "bc9079d9-c671-493e-952f-df88e315b579"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:11.873179 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.873161    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc9079d9-c671-493e-952f-df88e315b579-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bc9079d9-c671-493e-952f-df88e315b579" (UID: "bc9079d9-c671-493e-952f-df88e315b579"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:05:11.873341 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.873249    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc9079d9-c671-493e-952f-df88e315b579-kube-api-access-bxl9n" (OuterVolumeSpecName: "kube-api-access-bxl9n") pod "bc9079d9-c671-493e-952f-df88e315b579" (UID: "bc9079d9-c671-493e-952f-df88e315b579"). InnerVolumeSpecName "kube-api-access-bxl9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:05:11.881898 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.881873    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc9079d9-c671-493e-952f-df88e315b579" containerID="820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85" exitCode=0
Jul 29 20:05:11.881991 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.881917    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"
Jul 29 20:05:11.881991 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.881953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d" event={"ID":"bc9079d9-c671-493e-952f-df88e315b579","Type":"ContainerDied","Data":"820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85"}
Jul 29 20:05:11.882091 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.882002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d" event={"ID":"bc9079d9-c671-493e-952f-df88e315b579","Type":"ContainerDied","Data":"62d1ed79c29fde1db49c5c229d63c81ac862927d7f7b5bd300693811f674c97d"}
Jul 29 20:05:11.882091 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.882047    2576 scope.go:117] "RemoveContainer" containerID="820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85"
Jul 29 20:05:11.891990 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.891974    2576 scope.go:117] "RemoveContainer" containerID="820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85"
Jul 29 20:05:11.892317 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:05:11.892291    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85\": container with ID starting with 820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85 not found: ID does not exist" containerID="820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85"
Jul 29 20:05:11.892392 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.892329    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85"} err="failed to get container status \"820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85\": rpc error: code = NotFound desc = could not find container \"820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85\": container with ID starting with 820b5f94c130500f25ee04d1e8727eff4ddea032f1e71baca011badb68abbd85 not found: ID does not exist"
Jul 29 20:05:11.902288 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.902260    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"]
Jul 29 20:05:11.905831 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.905809    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/rate-test-model-9a3702-kserve-65887f7bcf-k545d"]
Jul 29 20:05:11.972204 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.972170    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxl9n\" (UniqueName: \"kubernetes.io/projected/bc9079d9-c671-493e-952f-df88e315b579-kube-api-access-bxl9n\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:05:11.972204 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.972195    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc9079d9-c671-493e-952f-df88e315b579-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:05:11.972204 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:11.972207    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc9079d9-c671-493e-952f-df88e315b579-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:05:12.672190 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:12.672160    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc9079d9-c671-493e-952f-df88e315b579" path="/var/lib/kubelet/pods/bc9079d9-c671-493e-952f-df88e315b579/volumes"
Jul 29 20:05:21.919419 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919375    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"]
Jul 29 20:05:21.919808 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919757    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc9079d9-c671-493e-952f-df88e315b579" containerName="main"
Jul 29 20:05:21.919808 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919767    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc9079d9-c671-493e-952f-df88e315b579" containerName="main"
Jul 29 20:05:21.919808 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919791    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f9d900-97df-4265-afee-6716e26fe33d" containerName="main"
Jul 29 20:05:21.919808 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919796    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f9d900-97df-4265-afee-6716e26fe33d" containerName="main"
Jul 29 20:05:21.919943 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919853    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f9d900-97df-4265-afee-6716e26fe33d" containerName="main"
Jul 29 20:05:21.919943 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.919863    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc9079d9-c671-493e-952f-df88e315b579" containerName="main"
Jul 29 20:05:21.922805 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.922788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:21.925076 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.925052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d722d0-dockercfg-ld9vh\""
Jul 29 20:05:21.925235 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.925111    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d722d0\""
Jul 29 20:05:21.931743 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.931270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"]
Jul 29 20:05:21.965967 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.965932    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"]
Jul 29 20:05:21.969426 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.969402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:21.980037 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:21.979990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"]
Jul 29 20:05:22.068890 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.068847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx27f\" (UniqueName: \"kubernetes.io/projected/13101a70-7ed6-4b47-bfb5-712e1b0f1151-kube-api-access-xx27f\") pod \"payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.069095 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.068908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvb9\" (UniqueName: \"kubernetes.io/projected/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-kube-api-access-6nvb9\") pod \"payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.069095 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.069057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13101a70-7ed6-4b47-bfb5-712e1b0f1151-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.069220 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.069121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.169964 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.169875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.169964 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.169934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx27f\" (UniqueName: \"kubernetes.io/projected/13101a70-7ed6-4b47-bfb5-712e1b0f1151-kube-api-access-xx27f\") pod \"payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.170217 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.169986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvb9\" (UniqueName: \"kubernetes.io/projected/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-kube-api-access-6nvb9\") pod \"payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.170217 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.170080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13101a70-7ed6-4b47-bfb5-712e1b0f1151-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.170663 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.170641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.170796 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.170777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13101a70-7ed6-4b47-bfb5-712e1b0f1151-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.181822 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.181786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx27f\" (UniqueName: \"kubernetes.io/projected/13101a70-7ed6-4b47-bfb5-712e1b0f1151-kube-api-access-xx27f\") pod \"payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.181976 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.181835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvb9\" (UniqueName: \"kubernetes.io/projected/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-kube-api-access-6nvb9\") pod \"payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.235213 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.235158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.280597 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.280564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.388889 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.388863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"]
Jul 29 20:05:22.391379 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:05:22.391347    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13101a70_7ed6_4b47_bfb5_712e1b0f1151.slice/crio-eeb48e89b254e5d04f783ce534173403a53c96169039e03dacfb10bbaf827d88 WatchSource:0}: Error finding container eeb48e89b254e5d04f783ce534173403a53c96169039e03dacfb10bbaf827d88: Status 404 returned error can't find the container with id eeb48e89b254e5d04f783ce534173403a53c96169039e03dacfb10bbaf827d88
Jul 29 20:05:22.446731 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.446705    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"]
Jul 29 20:05:22.449333 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:05:22.449305    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79ec88e_e995_4780_98d6_7dfdb5bf01ae.slice/crio-752945c9b9eb409e908240bf09cd2362e277b989094f4f7fa5cfb266aa7f4184 WatchSource:0}: Error finding container 752945c9b9eb409e908240bf09cd2362e277b989094f4f7fa5cfb266aa7f4184: Status 404 returned error can't find the container with id 752945c9b9eb409e908240bf09cd2362e277b989094f4f7fa5cfb266aa7f4184
Jul 29 20:05:22.938443 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.938396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws" event={"ID":"c79ec88e-e995-4780-98d6-7dfdb5bf01ae","Type":"ContainerStarted","Data":"3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2"}
Jul 29 20:05:22.938949 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.938462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws" event={"ID":"c79ec88e-e995-4780-98d6-7dfdb5bf01ae","Type":"ContainerStarted","Data":"752945c9b9eb409e908240bf09cd2362e277b989094f4f7fa5cfb266aa7f4184"}
Jul 29 20:05:22.938949 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.938587    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:22.940086 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.940059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr" event={"ID":"13101a70-7ed6-4b47-bfb5-712e1b0f1151","Type":"ContainerStarted","Data":"01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601"}
Jul 29 20:05:22.940233 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.940108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr" event={"ID":"13101a70-7ed6-4b47-bfb5-712e1b0f1151","Type":"ContainerStarted","Data":"eeb48e89b254e5d04f783ce534173403a53c96169039e03dacfb10bbaf827d88"}
Jul 29 20:05:22.940233 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.940152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:22.963658 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.963607    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws" podStartSLOduration=1.9635893279999999 podStartE2EDuration="1.963589328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:22.961015465 +0000 UTC m=+3016.877965053" watchObservedRunningTime="2026-07-29 20:05:22.963589328 +0000 UTC m=+3016.880538916"
Jul 29 20:05:22.980562 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:22.980505    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr" podStartSLOduration=1.980488247 podStartE2EDuration="1.980488247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:22.978294322 +0000 UTC m=+3016.895243913" watchObservedRunningTime="2026-07-29 20:05:22.980488247 +0000 UTC m=+3016.897437835"
Jul 29 20:05:33.957139 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:33.957106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:05:33.957675 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:33.957223    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:05:50.869533 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.869497    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"]
Jul 29 20:05:50.872992 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.872970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:50.875522 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.875443    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-5560c5\""
Jul 29 20:05:50.875522 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.875499    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-5560c5-dockercfg-cm8sk\""
Jul 29 20:05:50.883435 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.883414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"]
Jul 29 20:05:50.888396 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.888373    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"]
Jul 29 20:05:50.891712 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.891691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:50.900011 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.899986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"]
Jul 29 20:05:50.935104 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.935055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdqb\" (UniqueName: \"kubernetes.io/projected/bb424d8f-5855-4e98-8d9c-fe59d42b040e-kube-api-access-dtdqb\") pod \"payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:50.935288 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.935112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7qp\" (UniqueName: \"kubernetes.io/projected/ba7b9185-6905-4d37-b9fc-7ec956e3de19-kube-api-access-tz7qp\") pod \"payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:50.935288 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.935164    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb424d8f-5855-4e98-8d9c-fe59d42b040e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:50.935288 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:50.935241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba7b9185-6905-4d37-b9fc-7ec956e3de19-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:51.036504 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.036467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdqb\" (UniqueName: \"kubernetes.io/projected/bb424d8f-5855-4e98-8d9c-fe59d42b040e-kube-api-access-dtdqb\") pod \"payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:51.036504 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.036514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7qp\" (UniqueName: \"kubernetes.io/projected/ba7b9185-6905-4d37-b9fc-7ec956e3de19-kube-api-access-tz7qp\") pod \"payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:51.036759 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.036543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb424d8f-5855-4e98-8d9c-fe59d42b040e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:51.036759 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.036586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba7b9185-6905-4d37-b9fc-7ec956e3de19-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:51.037321 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.037298    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba7b9185-6905-4d37-b9fc-7ec956e3de19-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:51.037418 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.037316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb424d8f-5855-4e98-8d9c-fe59d42b040e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:51.044660 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.044635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7qp\" (UniqueName: \"kubernetes.io/projected/ba7b9185-6905-4d37-b9fc-7ec956e3de19-kube-api-access-tz7qp\") pod \"payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:51.045119 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.045097    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdqb\" (UniqueName: \"kubernetes.io/projected/bb424d8f-5855-4e98-8d9c-fe59d42b040e-kube-api-access-dtdqb\") pod \"payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:51.186384 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.186283    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:51.203634 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.203591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:51.536534 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.536480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"]
Jul 29 20:05:51.538885 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:05:51.538859    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7b9185_6905_4d37_b9fc_7ec956e3de19.slice/crio-5e5e1087bcb3479429924c5f3e7dcadb4c9900ac8b96b39f838e933d515ffbe3 WatchSource:0}: Error finding container 5e5e1087bcb3479429924c5f3e7dcadb4c9900ac8b96b39f838e933d515ffbe3: Status 404 returned error can't find the container with id 5e5e1087bcb3479429924c5f3e7dcadb4c9900ac8b96b39f838e933d515ffbe3
Jul 29 20:05:51.569009 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:51.568984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"]
Jul 29 20:05:51.571719 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:05:51.571680    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb424d8f_5855_4e98_8d9c_fe59d42b040e.slice/crio-f2f4446973fbf94e5b94e2e59674ad79eb82897d51a6d7e0b0b4c7e21cb3aef9 WatchSource:0}: Error finding container f2f4446973fbf94e5b94e2e59674ad79eb82897d51a6d7e0b0b4c7e21cb3aef9: Status 404 returned error can't find the container with id f2f4446973fbf94e5b94e2e59674ad79eb82897d51a6d7e0b0b4c7e21cb3aef9
Jul 29 20:05:52.096153 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.096116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674" event={"ID":"bb424d8f-5855-4e98-8d9c-fe59d42b040e","Type":"ContainerStarted","Data":"4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6"}
Jul 29 20:05:52.096598 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.096250    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:05:52.096598 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.096293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674" event={"ID":"bb424d8f-5855-4e98-8d9c-fe59d42b040e","Type":"ContainerStarted","Data":"f2f4446973fbf94e5b94e2e59674ad79eb82897d51a6d7e0b0b4c7e21cb3aef9"}
Jul 29 20:05:52.097693 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.097668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r" event={"ID":"ba7b9185-6905-4d37-b9fc-7ec956e3de19","Type":"ContainerStarted","Data":"d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c"}
Jul 29 20:05:52.097804 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.097715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r" event={"ID":"ba7b9185-6905-4d37-b9fc-7ec956e3de19","Type":"ContainerStarted","Data":"5e5e1087bcb3479429924c5f3e7dcadb4c9900ac8b96b39f838e933d515ffbe3"}
Jul 29 20:05:52.097804 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.097741    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:05:52.112669 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.112617    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674" podStartSLOduration=2.112603394 podStartE2EDuration="2.112603394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:52.110763195 +0000 UTC m=+3046.027712786" watchObservedRunningTime="2026-07-29 20:05:52.112603394 +0000 UTC m=+3046.029552960"
Jul 29 20:05:52.125331 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:05:52.125277    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r" podStartSLOduration=2.125258358 podStartE2EDuration="2.125258358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:52.123319956 +0000 UTC m=+3046.040269550" watchObservedRunningTime="2026-07-29 20:05:52.125258358 +0000 UTC m=+3046.042207945"
Jul 29 20:06:03.104279 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:03.104192    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:06:03.104651 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:03.104515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:06:11.591037 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:11.590995    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674_bb424d8f-5855-4e98-8d9c-fe59d42b040e/payload-processing/0.log"
Jul 29 20:06:25.736089 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.736047    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"]
Jul 29 20:06:25.739590 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.739571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.741758 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.741731    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-d722d0\"/\"openshift-service-ca.crt\""
Jul 29 20:06:25.742260 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.742238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-d722d0\"/\"kube-root-ca.crt\""
Jul 29 20:06:25.742372 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.742277    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-d722d0\"/\"ipp-route-d722d0-kserve-self-signed-certs\""
Jul 29 20:06:25.742372 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.742326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-d722d0\"/\"default-dockercfg-7ljsv\""
Jul 29 20:06:25.749498 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.749474    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"]
Jul 29 20:06:25.775349 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.775310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-dshm\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.775349 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.775344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-model-cache\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.775565 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.775370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-home\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.775565 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.775507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tmp-dir\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.775565 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.775534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tls-certs\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.775683 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.775581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7jp\" (UniqueName: \"kubernetes.io/projected/e4ed66f9-54eb-4939-8428-e7e475af7dfa-kube-api-access-dz7jp\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.876385 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.876344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7jp\" (UniqueName: \"kubernetes.io/projected/e4ed66f9-54eb-4939-8428-e7e475af7dfa-kube-api-access-dz7jp\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.876784 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.876750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-dshm\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.876907 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.876863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-model-cache\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.876950 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.876911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-home\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.877086 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.877069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tmp-dir\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.877158 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.877111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tls-certs\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.877331 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.877305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-model-cache\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.877423 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.877332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-home\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.877423 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.877403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tmp-dir\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.879035 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.878991    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-dshm\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.879425 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.879408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tls-certs\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:25.885514 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:25.885487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7jp\" (UniqueName: \"kubernetes.io/projected/e4ed66f9-54eb-4939-8428-e7e475af7dfa-kube-api-access-dz7jp\") pod \"ipp-route-d722d0-kserve-5559fdf4dc-gmvdb\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") " pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:26.050048 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:26.049939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:26.191006 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:26.190955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"]
Jul 29 20:06:26.193544 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:06:26.193495    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4ed66f9_54eb_4939_8428_e7e475af7dfa.slice/crio-f31e11cc538bfd4feaefe59be860b378fce2bdf573dcc161b8df92dd38235c71 WatchSource:0}: Error finding container f31e11cc538bfd4feaefe59be860b378fce2bdf573dcc161b8df92dd38235c71: Status 404 returned error can't find the container with id f31e11cc538bfd4feaefe59be860b378fce2bdf573dcc161b8df92dd38235c71
Jul 29 20:06:26.272889 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:26.272853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb" event={"ID":"e4ed66f9-54eb-4939-8428-e7e475af7dfa","Type":"ContainerStarted","Data":"1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6"}
Jul 29 20:06:26.272889 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:26.272903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb" event={"ID":"e4ed66f9-54eb-4939-8428-e7e475af7dfa","Type":"ContainerStarted","Data":"f31e11cc538bfd4feaefe59be860b378fce2bdf573dcc161b8df92dd38235c71"}
Jul 29 20:06:26.289525 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:26.289473    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb" podStartSLOduration=1.289451194 podStartE2EDuration="1.289451194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:06:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:06:26.288308189 +0000 UTC m=+3080.205257860" watchObservedRunningTime="2026-07-29 20:06:26.289451194 +0000 UTC m=+3080.206400785"
Jul 29 20:06:36.050437 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:36.050400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:36.050818 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:36.050450    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:36.063438 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:36.063407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:06:36.334167 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:06:36.334140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:07:06.688013 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:06.687970    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws_c79ec88e-e995-4780-98d6-7dfdb5bf01ae/payload-processing/0.log"
Jul 29 20:07:06.941523 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:06.941443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674_bb424d8f-5855-4e98-8d9c-fe59d42b040e/payload-processing/0.log"
Jul 29 20:07:11.929441 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:11.929408    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"]
Jul 29 20:07:11.933383 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:11.933357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:11.936713 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:11.936688    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-ebceb0\""
Jul 29 20:07:11.936845 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:11.936722    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-ebceb0-dockercfg-lg86k\""
Jul 29 20:07:11.958057 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:11.958015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"]
Jul 29 20:07:12.001152 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.001118    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"]
Jul 29 20:07:12.004590 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.004572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.024566 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.024532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"]
Jul 29 20:07:12.033092 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.033057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c28c22-faa3-4ec3-99a6-7941b0fcb344-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.033232 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.033201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47zbf\" (UniqueName: \"kubernetes.io/projected/59c28c22-faa3-4ec3-99a6-7941b0fcb344-kube-api-access-47zbf\") pod \"payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.134249 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.134217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c28c22-faa3-4ec3-99a6-7941b0fcb344-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.134407 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.134298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck548\" (UniqueName: \"kubernetes.io/projected/9424e701-02fa-40f7-be5e-a3e3789baa4c-kube-api-access-ck548\") pod \"payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.134407 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.134319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47zbf\" (UniqueName: \"kubernetes.io/projected/59c28c22-faa3-4ec3-99a6-7941b0fcb344-kube-api-access-47zbf\") pod \"payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.134407 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.134388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9424e701-02fa-40f7-be5e-a3e3789baa4c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.134907 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.134887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c28c22-faa3-4ec3-99a6-7941b0fcb344-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.141812 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.141789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47zbf\" (UniqueName: \"kubernetes.io/projected/59c28c22-faa3-4ec3-99a6-7941b0fcb344-kube-api-access-47zbf\") pod \"payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.235674 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.235576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck548\" (UniqueName: \"kubernetes.io/projected/9424e701-02fa-40f7-be5e-a3e3789baa4c-kube-api-access-ck548\") pod \"payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.235833 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.235686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9424e701-02fa-40f7-be5e-a3e3789baa4c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.236389 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.236371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9424e701-02fa-40f7-be5e-a3e3789baa4c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.242981 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.242956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck548\" (UniqueName: \"kubernetes.io/projected/9424e701-02fa-40f7-be5e-a3e3789baa4c-kube-api-access-ck548\") pod \"payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.244791 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.244774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.315364 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.315067    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:12.406197 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.406167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"]
Jul 29 20:07:12.409073 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:07:12.409039    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c28c22_faa3_4ec3_99a6_7941b0fcb344.slice/crio-a32cf4deb1187b34e0a1fb7d375d08593a6721d6b18032a59eb8b27a3143b40c WatchSource:0}: Error finding container a32cf4deb1187b34e0a1fb7d375d08593a6721d6b18032a59eb8b27a3143b40c: Status 404 returned error can't find the container with id a32cf4deb1187b34e0a1fb7d375d08593a6721d6b18032a59eb8b27a3143b40c
Jul 29 20:07:12.467591 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.467564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"]
Jul 29 20:07:12.470824 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:07:12.470794    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9424e701_02fa_40f7_be5e_a3e3789baa4c.slice/crio-85f31a6e0e80de46b2e6f54d4b48efd55fa4e64ce04a2b185f66aaef99bb93a0 WatchSource:0}: Error finding container 85f31a6e0e80de46b2e6f54d4b48efd55fa4e64ce04a2b185f66aaef99bb93a0: Status 404 returned error can't find the container with id 85f31a6e0e80de46b2e6f54d4b48efd55fa4e64ce04a2b185f66aaef99bb93a0
Jul 29 20:07:12.505391 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.505359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw" event={"ID":"59c28c22-faa3-4ec3-99a6-7941b0fcb344","Type":"ContainerStarted","Data":"ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa"}
Jul 29 20:07:12.505564 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.505417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw" event={"ID":"59c28c22-faa3-4ec3-99a6-7941b0fcb344","Type":"ContainerStarted","Data":"a32cf4deb1187b34e0a1fb7d375d08593a6721d6b18032a59eb8b27a3143b40c"}
Jul 29 20:07:12.505564 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.505463    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:12.506669 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.506646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv" event={"ID":"9424e701-02fa-40f7-be5e-a3e3789baa4c","Type":"ContainerStarted","Data":"85f31a6e0e80de46b2e6f54d4b48efd55fa4e64ce04a2b185f66aaef99bb93a0"}
Jul 29 20:07:12.524055 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:12.523981    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw" podStartSLOduration=1.5239606860000001 podStartE2EDuration="1.523960686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:12.520788416 +0000 UTC m=+3126.437738005" watchObservedRunningTime="2026-07-29 20:07:12.523960686 +0000 UTC m=+3126.440910278"
Jul 29 20:07:13.513741 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:13.513697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv" event={"ID":"9424e701-02fa-40f7-be5e-a3e3789baa4c","Type":"ContainerStarted","Data":"477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6"}
Jul 29 20:07:13.514210 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:13.513765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:13.532088 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:13.532032    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv" podStartSLOduration=2.532005714 podStartE2EDuration="2.532005714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:13.529986073 +0000 UTC m=+3127.446935662" watchObservedRunningTime="2026-07-29 20:07:13.532005714 +0000 UTC m=+3127.448955302"
Jul 29 20:07:23.516110 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:23.516076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:24.522075 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:24.522013    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:35.698810 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:35.698722    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"]
Jul 29 20:07:35.699229 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:35.698952    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv" podUID="9424e701-02fa-40f7-be5e-a3e3789baa4c" containerName="payload-processing" containerID="cri-o://477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6" gracePeriod=30
Jul 29 20:07:35.716152 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:35.716113    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"]
Jul 29 20:07:35.716702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:35.716671    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw" podUID="59c28c22-faa3-4ec3-99a6-7941b0fcb344" containerName="payload-pre-processing" containerID="cri-o://ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa" gracePeriod=30
Jul 29 20:07:35.996883 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:35.996854    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:36.000255 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.000229    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:36.070247 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.070210    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9424e701-02fa-40f7-be5e-a3e3789baa4c-plugins-config-volume\") pod \"9424e701-02fa-40f7-be5e-a3e3789baa4c\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") "
Jul 29 20:07:36.070432 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.070329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c28c22-faa3-4ec3-99a6-7941b0fcb344-plugins-config-volume\") pod \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") "
Jul 29 20:07:36.070432 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.070395    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47zbf\" (UniqueName: \"kubernetes.io/projected/59c28c22-faa3-4ec3-99a6-7941b0fcb344-kube-api-access-47zbf\") pod \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\" (UID: \"59c28c22-faa3-4ec3-99a6-7941b0fcb344\") "
Jul 29 20:07:36.070550 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.070437    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck548\" (UniqueName: \"kubernetes.io/projected/9424e701-02fa-40f7-be5e-a3e3789baa4c-kube-api-access-ck548\") pod \"9424e701-02fa-40f7-be5e-a3e3789baa4c\" (UID: \"9424e701-02fa-40f7-be5e-a3e3789baa4c\") "
Jul 29 20:07:36.070678 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.070652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9424e701-02fa-40f7-be5e-a3e3789baa4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9424e701-02fa-40f7-be5e-a3e3789baa4c" (UID: "9424e701-02fa-40f7-be5e-a3e3789baa4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:36.070742 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.070681    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c28c22-faa3-4ec3-99a6-7941b0fcb344-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59c28c22-faa3-4ec3-99a6-7941b0fcb344" (UID: "59c28c22-faa3-4ec3-99a6-7941b0fcb344"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:36.072592 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.072550    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9424e701-02fa-40f7-be5e-a3e3789baa4c-kube-api-access-ck548" (OuterVolumeSpecName: "kube-api-access-ck548") pod "9424e701-02fa-40f7-be5e-a3e3789baa4c" (UID: "9424e701-02fa-40f7-be5e-a3e3789baa4c"). InnerVolumeSpecName "kube-api-access-ck548". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:36.072733 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.072654    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c28c22-faa3-4ec3-99a6-7941b0fcb344-kube-api-access-47zbf" (OuterVolumeSpecName: "kube-api-access-47zbf") pod "59c28c22-faa3-4ec3-99a6-7941b0fcb344" (UID: "59c28c22-faa3-4ec3-99a6-7941b0fcb344"). InnerVolumeSpecName "kube-api-access-47zbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:36.171338 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.171293    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9424e701-02fa-40f7-be5e-a3e3789baa4c-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.171338 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.171328    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c28c22-faa3-4ec3-99a6-7941b0fcb344-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.171338 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.171341    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47zbf\" (UniqueName: \"kubernetes.io/projected/59c28c22-faa3-4ec3-99a6-7941b0fcb344-kube-api-access-47zbf\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.171586 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.171353    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck548\" (UniqueName: \"kubernetes.io/projected/9424e701-02fa-40f7-be5e-a3e3789baa4c-kube-api-access-ck548\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.630938 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.630895    2576 generic.go:356] "Generic (PLEG): container finished" podID="59c28c22-faa3-4ec3-99a6-7941b0fcb344" containerID="ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa" exitCode=0
Jul 29 20:07:36.631168 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.630965    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"
Jul 29 20:07:36.631168 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.630978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw" event={"ID":"59c28c22-faa3-4ec3-99a6-7941b0fcb344","Type":"ContainerDied","Data":"ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa"}
Jul 29 20:07:36.631168 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.631094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw" event={"ID":"59c28c22-faa3-4ec3-99a6-7941b0fcb344","Type":"ContainerDied","Data":"a32cf4deb1187b34e0a1fb7d375d08593a6721d6b18032a59eb8b27a3143b40c"}
Jul 29 20:07:36.631168 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.631129    2576 scope.go:117] "RemoveContainer" containerID="ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa"
Jul 29 20:07:36.632534 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.632507    2576 generic.go:356] "Generic (PLEG): container finished" podID="9424e701-02fa-40f7-be5e-a3e3789baa4c" containerID="477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6" exitCode=0
Jul 29 20:07:36.632629 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.632567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"
Jul 29 20:07:36.632629 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.632589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv" event={"ID":"9424e701-02fa-40f7-be5e-a3e3789baa4c","Type":"ContainerDied","Data":"477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6"}
Jul 29 20:07:36.632738 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.632655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv" event={"ID":"9424e701-02fa-40f7-be5e-a3e3789baa4c","Type":"ContainerDied","Data":"85f31a6e0e80de46b2e6f54d4b48efd55fa4e64ce04a2b185f66aaef99bb93a0"}
Jul 29 20:07:36.640869 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.640846    2576 scope.go:117] "RemoveContainer" containerID="ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa"
Jul 29 20:07:36.641239 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:07:36.641211    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa\": container with ID starting with ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa not found: ID does not exist" containerID="ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa"
Jul 29 20:07:36.641347 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.641248    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa"} err="failed to get container status \"ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa\": rpc error: code = NotFound desc = could not find container \"ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa\": container with ID starting with ebb78c323f17904f11d925b95c76f845f3e3c266501af4a6a66388fe9c5504aa not found: ID does not exist"
Jul 29 20:07:36.641347 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.641268    2576 scope.go:117] "RemoveContainer" containerID="477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6"
Jul 29 20:07:36.649880 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.649863    2576 scope.go:117] "RemoveContainer" containerID="477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6"
Jul 29 20:07:36.650185 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:07:36.650164    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6\": container with ID starting with 477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6 not found: ID does not exist" containerID="477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6"
Jul 29 20:07:36.650251 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.650193    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6"} err="failed to get container status \"477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6\": rpc error: code = NotFound desc = could not find container \"477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6\": container with ID starting with 477ccefedc873a243ee5658caeeb7953623a6dc80c33d768a2cd697ca4cc51b6 not found: ID does not exist"
Jul 29 20:07:36.657994 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.657966    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"]
Jul 29 20:07:36.673006 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.672975    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebceb0-866dddddf6-rgspw"]
Jul 29 20:07:36.685960 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.685920    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"]
Jul 29 20:07:36.690520 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:36.690489    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ebceb0-769d468c86-4fzgv"]
Jul 29 20:07:38.673347 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:38.673309    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c28c22-faa3-4ec3-99a6-7941b0fcb344" path="/var/lib/kubelet/pods/59c28c22-faa3-4ec3-99a6-7941b0fcb344/volumes"
Jul 29 20:07:38.673824 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:38.673736    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9424e701-02fa-40f7-be5e-a3e3789baa4c" path="/var/lib/kubelet/pods/9424e701-02fa-40f7-be5e-a3e3789baa4c/volumes"
Jul 29 20:07:46.168650 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.168612    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"]
Jul 29 20:07:46.171067 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.169044    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c28c22-faa3-4ec3-99a6-7941b0fcb344" containerName="payload-pre-processing"
Jul 29 20:07:46.171067 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.169061    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c28c22-faa3-4ec3-99a6-7941b0fcb344" containerName="payload-pre-processing"
Jul 29 20:07:46.171067 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.169074    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9424e701-02fa-40f7-be5e-a3e3789baa4c" containerName="payload-processing"
Jul 29 20:07:46.171067 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.169079    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9424e701-02fa-40f7-be5e-a3e3789baa4c" containerName="payload-processing"
Jul 29 20:07:46.171067 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.169149    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9424e701-02fa-40f7-be5e-a3e3789baa4c" containerName="payload-processing"
Jul 29 20:07:46.171067 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.169160    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c28c22-faa3-4ec3-99a6-7941b0fcb344" containerName="payload-pre-processing"
Jul 29 20:07:46.172052 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.172011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:46.173924 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.173890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:07:46.174090 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.173938    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 20:07:46.178256 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.178233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"]
Jul 29 20:07:46.271203 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.271173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d96705-920a-4efd-be03-7f27ec9e3f1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v\" (UID: \"a4d96705-920a-4efd-be03-7f27ec9e3f1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:46.372543 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.372506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d96705-920a-4efd-be03-7f27ec9e3f1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v\" (UID: \"a4d96705-920a-4efd-be03-7f27ec9e3f1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:46.373262 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.373238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d96705-920a-4efd-be03-7f27ec9e3f1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v\" (UID: \"a4d96705-920a-4efd-be03-7f27ec9e3f1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:46.484892 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.484807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:46.615809 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.615773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"]
Jul 29 20:07:46.619282 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:07:46.619247    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d96705_920a_4efd_be03_7f27ec9e3f1b.slice/crio-c81a40b259aa47412302af814ec7a822538ffd7270e49541f9de17151aa3f3e8 WatchSource:0}: Error finding container c81a40b259aa47412302af814ec7a822538ffd7270e49541f9de17151aa3f3e8: Status 404 returned error can't find the container with id c81a40b259aa47412302af814ec7a822538ffd7270e49541f9de17151aa3f3e8
Jul 29 20:07:46.687375 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:46.687345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v" event={"ID":"a4d96705-920a-4efd-be03-7f27ec9e3f1b","Type":"ContainerStarted","Data":"c81a40b259aa47412302af814ec7a822538ffd7270e49541f9de17151aa3f3e8"}
Jul 29 20:07:47.693754 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:47.693713    2576 generic.go:356] "Generic (PLEG): container finished" podID="a4d96705-920a-4efd-be03-7f27ec9e3f1b" containerID="33b323141b9835d0aed231250fbfe063e2b8aa71a9cd20363904afb9d2f03264" exitCode=0
Jul 29 20:07:47.694138 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:47.693790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v" event={"ID":"a4d96705-920a-4efd-be03-7f27ec9e3f1b","Type":"ContainerDied","Data":"33b323141b9835d0aed231250fbfe063e2b8aa71a9cd20363904afb9d2f03264"}
Jul 29 20:07:48.830407 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:48.830383    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:48.898720 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:48.898691    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d96705-920a-4efd-be03-7f27ec9e3f1b-maas-api-service-ca\") pod \"a4d96705-920a-4efd-be03-7f27ec9e3f1b\" (UID: \"a4d96705-920a-4efd-be03-7f27ec9e3f1b\") "
Jul 29 20:07:48.899137 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:48.899117    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d96705-920a-4efd-be03-7f27ec9e3f1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4d96705-920a-4efd-be03-7f27ec9e3f1b" (UID: "a4d96705-920a-4efd-be03-7f27ec9e3f1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:49.000326 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:49.000246    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d96705-920a-4efd-be03-7f27ec9e3f1b-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:49.705443 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:49.705415    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"
Jul 29 20:07:49.705443 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:49.705434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v" event={"ID":"a4d96705-920a-4efd-be03-7f27ec9e3f1b","Type":"ContainerDied","Data":"c81a40b259aa47412302af814ec7a822538ffd7270e49541f9de17151aa3f3e8"}
Jul 29 20:07:49.705702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:49.705477    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c81a40b259aa47412302af814ec7a822538ffd7270e49541f9de17151aa3f3e8"
Jul 29 20:07:58.837412 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:58.837372    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"]
Jul 29 20:07:58.837838 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:58.837677    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws" podUID="c79ec88e-e995-4780-98d6-7dfdb5bf01ae" containerName="payload-processing" containerID="cri-o://3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2" gracePeriod=30
Jul 29 20:07:58.846361 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:58.846319    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"]
Jul 29 20:07:58.847433 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:58.846600    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr" podUID="13101a70-7ed6-4b47-bfb5-712e1b0f1151" containerName="payload-pre-processing" containerID="cri-o://01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601" gracePeriod=30
Jul 29 20:07:59.072852 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.072814    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"]
Jul 29 20:07:59.079373 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.079340    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d722d0-mwm8v"]
Jul 29 20:07:59.138166 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.138140    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:07:59.141528 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.141502    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:07:59.302497 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.302462    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13101a70-7ed6-4b47-bfb5-712e1b0f1151-plugins-config-volume\") pod \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") "
Jul 29 20:07:59.302703 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.302513    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nvb9\" (UniqueName: \"kubernetes.io/projected/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-kube-api-access-6nvb9\") pod \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") "
Jul 29 20:07:59.302703 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.302591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-plugins-config-volume\") pod \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\" (UID: \"c79ec88e-e995-4780-98d6-7dfdb5bf01ae\") "
Jul 29 20:07:59.302703 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.302623    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx27f\" (UniqueName: \"kubernetes.io/projected/13101a70-7ed6-4b47-bfb5-712e1b0f1151-kube-api-access-xx27f\") pod \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\" (UID: \"13101a70-7ed6-4b47-bfb5-712e1b0f1151\") "
Jul 29 20:07:59.302963 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.302934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13101a70-7ed6-4b47-bfb5-712e1b0f1151-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13101a70-7ed6-4b47-bfb5-712e1b0f1151" (UID: "13101a70-7ed6-4b47-bfb5-712e1b0f1151"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:59.303100 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.302974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c79ec88e-e995-4780-98d6-7dfdb5bf01ae" (UID: "c79ec88e-e995-4780-98d6-7dfdb5bf01ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:59.304847 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.304823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13101a70-7ed6-4b47-bfb5-712e1b0f1151-kube-api-access-xx27f" (OuterVolumeSpecName: "kube-api-access-xx27f") pod "13101a70-7ed6-4b47-bfb5-712e1b0f1151" (UID: "13101a70-7ed6-4b47-bfb5-712e1b0f1151"). InnerVolumeSpecName "kube-api-access-xx27f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:59.304957 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.304938    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-kube-api-access-6nvb9" (OuterVolumeSpecName: "kube-api-access-6nvb9") pod "c79ec88e-e995-4780-98d6-7dfdb5bf01ae" (UID: "c79ec88e-e995-4780-98d6-7dfdb5bf01ae"). InnerVolumeSpecName "kube-api-access-6nvb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:59.404094 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.403997    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13101a70-7ed6-4b47-bfb5-712e1b0f1151-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:59.404094 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.404057    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nvb9\" (UniqueName: \"kubernetes.io/projected/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-kube-api-access-6nvb9\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:59.404094 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.404068    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c79ec88e-e995-4780-98d6-7dfdb5bf01ae-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:59.404094 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.404077    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx27f\" (UniqueName: \"kubernetes.io/projected/13101a70-7ed6-4b47-bfb5-712e1b0f1151-kube-api-access-xx27f\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:07:59.757579 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.757484    2576 generic.go:356] "Generic (PLEG): container finished" podID="13101a70-7ed6-4b47-bfb5-712e1b0f1151" containerID="01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601" exitCode=0
Jul 29 20:07:59.757579 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.757532    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"
Jul 29 20:07:59.757836 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.757580    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr" event={"ID":"13101a70-7ed6-4b47-bfb5-712e1b0f1151","Type":"ContainerDied","Data":"01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601"}
Jul 29 20:07:59.757836 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.757632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr" event={"ID":"13101a70-7ed6-4b47-bfb5-712e1b0f1151","Type":"ContainerDied","Data":"eeb48e89b254e5d04f783ce534173403a53c96169039e03dacfb10bbaf827d88"}
Jul 29 20:07:59.757836 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.757659    2576 scope.go:117] "RemoveContainer" containerID="01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601"
Jul 29 20:07:59.759015 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.758989    2576 generic.go:356] "Generic (PLEG): container finished" podID="c79ec88e-e995-4780-98d6-7dfdb5bf01ae" containerID="3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2" exitCode=0
Jul 29 20:07:59.759142 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.759046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws" event={"ID":"c79ec88e-e995-4780-98d6-7dfdb5bf01ae","Type":"ContainerDied","Data":"3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2"}
Jul 29 20:07:59.759142 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.759062    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"
Jul 29 20:07:59.759142 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.759097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws" event={"ID":"c79ec88e-e995-4780-98d6-7dfdb5bf01ae","Type":"ContainerDied","Data":"752945c9b9eb409e908240bf09cd2362e277b989094f4f7fa5cfb266aa7f4184"}
Jul 29 20:07:59.767084 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.767057    2576 scope.go:117] "RemoveContainer" containerID="01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601"
Jul 29 20:07:59.767433 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:07:59.767414    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601\": container with ID starting with 01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601 not found: ID does not exist" containerID="01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601"
Jul 29 20:07:59.767560 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.767443    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601"} err="failed to get container status \"01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601\": rpc error: code = NotFound desc = could not find container \"01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601\": container with ID starting with 01b1a6d29bbcf73d35b187d5ee7729410ccdd655501f54c725ebd10b4d7db601 not found: ID does not exist"
Jul 29 20:07:59.767560 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.767460    2576 scope.go:117] "RemoveContainer" containerID="3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2"
Jul 29 20:07:59.775983 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.775965    2576 scope.go:117] "RemoveContainer" containerID="3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2"
Jul 29 20:07:59.776305 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:07:59.776282    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2\": container with ID starting with 3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2 not found: ID does not exist" containerID="3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2"
Jul 29 20:07:59.776364 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.776314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2"} err="failed to get container status \"3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2\": rpc error: code = NotFound desc = could not find container \"3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2\": container with ID starting with 3c9553d3731f080b477eff78f6f1dd168f03b83b9068c561d0787a66a326d3b2 not found: ID does not exist"
Jul 29 20:07:59.784431 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.784407    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"]
Jul 29 20:07:59.789708 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.789687    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d722d0-d7879bc5b-kvqws"]
Jul 29 20:07:59.803612 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.803584    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"]
Jul 29 20:07:59.807283 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:07:59.807259    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d722d0-6f7849bf6-jd4wr"]
Jul 29 20:08:00.672716 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:00.672680    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13101a70-7ed6-4b47-bfb5-712e1b0f1151" path="/var/lib/kubelet/pods/13101a70-7ed6-4b47-bfb5-712e1b0f1151/volumes"
Jul 29 20:08:00.673117 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:00.673044    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d96705-920a-4efd-be03-7f27ec9e3f1b" path="/var/lib/kubelet/pods/a4d96705-920a-4efd-be03-7f27ec9e3f1b/volumes"
Jul 29 20:08:00.673392 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:00.673377    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c79ec88e-e995-4780-98d6-7dfdb5bf01ae" path="/var/lib/kubelet/pods/c79ec88e-e995-4780-98d6-7dfdb5bf01ae/volumes"
Jul 29 20:08:04.444527 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:04.444494    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"]
Jul 29 20:08:19.464177 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.464124    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb" podUID="e4ed66f9-54eb-4939-8428-e7e475af7dfa" containerName="main" containerID="cri-o://1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6" gracePeriod=45
Jul 29 20:08:19.717963 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.717898    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:08:19.796987 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.796945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tls-certs\") pod \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") "
Jul 29 20:08:19.796987 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.796985    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-home\") pod \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") "
Jul 29 20:08:19.797243 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tmp-dir\") pod \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") "
Jul 29 20:08:19.797243 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797092    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz7jp\" (UniqueName: \"kubernetes.io/projected/e4ed66f9-54eb-4939-8428-e7e475af7dfa-kube-api-access-dz7jp\") pod \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") "
Jul 29 20:08:19.797243 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797137    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-model-cache\") pod \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") "
Jul 29 20:08:19.797243 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797189    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-dshm\") pod \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\" (UID: \"e4ed66f9-54eb-4939-8428-e7e475af7dfa\") "
Jul 29 20:08:19.797467 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797316    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-home" (OuterVolumeSpecName: "home") pod "e4ed66f9-54eb-4939-8428-e7e475af7dfa" (UID: "e4ed66f9-54eb-4939-8428-e7e475af7dfa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:19.797467 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797329    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4ed66f9-54eb-4939-8428-e7e475af7dfa" (UID: "e4ed66f9-54eb-4939-8428-e7e475af7dfa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:19.797578 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797466    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4ed66f9-54eb-4939-8428-e7e475af7dfa" (UID: "e4ed66f9-54eb-4939-8428-e7e475af7dfa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:19.797644 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797623    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:19.797698 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797651    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:19.797698 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.797668    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:19.799385 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.799360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-dshm" (OuterVolumeSpecName: "dshm") pod "e4ed66f9-54eb-4939-8428-e7e475af7dfa" (UID: "e4ed66f9-54eb-4939-8428-e7e475af7dfa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:19.799509 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.799389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ed66f9-54eb-4939-8428-e7e475af7dfa-kube-api-access-dz7jp" (OuterVolumeSpecName: "kube-api-access-dz7jp") pod "e4ed66f9-54eb-4939-8428-e7e475af7dfa" (UID: "e4ed66f9-54eb-4939-8428-e7e475af7dfa"). InnerVolumeSpecName "kube-api-access-dz7jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:19.799509 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.799410    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4ed66f9-54eb-4939-8428-e7e475af7dfa" (UID: "e4ed66f9-54eb-4939-8428-e7e475af7dfa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:08:19.865505 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.865462    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4ed66f9-54eb-4939-8428-e7e475af7dfa" containerID="1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6" exitCode=0
Jul 29 20:08:19.865702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.865527    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"
Jul 29 20:08:19.865702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.865515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb" event={"ID":"e4ed66f9-54eb-4939-8428-e7e475af7dfa","Type":"ContainerDied","Data":"1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6"}
Jul 29 20:08:19.865702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.865658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb" event={"ID":"e4ed66f9-54eb-4939-8428-e7e475af7dfa","Type":"ContainerDied","Data":"f31e11cc538bfd4feaefe59be860b378fce2bdf573dcc161b8df92dd38235c71"}
Jul 29 20:08:19.865702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.865683    2576 scope.go:117] "RemoveContainer" containerID="1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6"
Jul 29 20:08:19.875324 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.875302    2576 scope.go:117] "RemoveContainer" containerID="1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6"
Jul 29 20:08:19.875656 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:08:19.875634    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6\": container with ID starting with 1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6 not found: ID does not exist" containerID="1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6"
Jul 29 20:08:19.875704 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.875668    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6"} err="failed to get container status \"1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6\": rpc error: code = NotFound desc = could not find container \"1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6\": container with ID starting with 1e7f0c651bee97db78791cf6032b61fe86096ab4bbaae96a91cd51e24e1029b6 not found: ID does not exist"
Jul 29 20:08:19.885399 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.885369    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"]
Jul 29 20:08:19.888750 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.888722    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-d722d0/ipp-route-d722d0-kserve-5559fdf4dc-gmvdb"]
Jul 29 20:08:19.899050 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.898985    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ed66f9-54eb-4939-8428-e7e475af7dfa-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:19.899050 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.899017    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz7jp\" (UniqueName: \"kubernetes.io/projected/e4ed66f9-54eb-4939-8428-e7e475af7dfa-kube-api-access-dz7jp\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:19.899050 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:19.899041    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ed66f9-54eb-4939-8428-e7e475af7dfa-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:20.673202 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:20.673168    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ed66f9-54eb-4939-8428-e7e475af7dfa" path="/var/lib/kubelet/pods/e4ed66f9-54eb-4939-8428-e7e475af7dfa/volumes"
Jul 29 20:08:48.222148 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222108    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"]
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222550    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79ec88e-e995-4780-98d6-7dfdb5bf01ae" containerName="payload-processing"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222562    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79ec88e-e995-4780-98d6-7dfdb5bf01ae" containerName="payload-processing"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222570    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ed66f9-54eb-4939-8428-e7e475af7dfa" containerName="main"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222575    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ed66f9-54eb-4939-8428-e7e475af7dfa" containerName="main"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222600    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13101a70-7ed6-4b47-bfb5-712e1b0f1151" containerName="payload-pre-processing"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222605    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13101a70-7ed6-4b47-bfb5-712e1b0f1151" containerName="payload-pre-processing"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222611    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d96705-920a-4efd-be03-7f27ec9e3f1b" containerName="revoke-keys"
Jul 29 20:08:48.222661 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222617    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d96705-920a-4efd-be03-7f27ec9e3f1b" containerName="revoke-keys"
Jul 29 20:08:48.222945 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222672    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="13101a70-7ed6-4b47-bfb5-712e1b0f1151" containerName="payload-pre-processing"
Jul 29 20:08:48.222945 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222680    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c79ec88e-e995-4780-98d6-7dfdb5bf01ae" containerName="payload-processing"
Jul 29 20:08:48.222945 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222687    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d96705-920a-4efd-be03-7f27ec9e3f1b" containerName="revoke-keys"
Jul 29 20:08:48.222945 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.222696    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ed66f9-54eb-4939-8428-e7e475af7dfa" containerName="main"
Jul 29 20:08:48.225558 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.225541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:48.227676 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.227657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 20:08:48.227767 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.227693    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:08:48.231309 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.231281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"]
Jul 29 20:08:48.368673 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.368635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb985cec-b23f-456a-b469-26761c67c145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm\" (UID: \"eb985cec-b23f-456a-b469-26761c67c145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:48.469563 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.469527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb985cec-b23f-456a-b469-26761c67c145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm\" (UID: \"eb985cec-b23f-456a-b469-26761c67c145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:48.470155 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.470135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb985cec-b23f-456a-b469-26761c67c145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm\" (UID: \"eb985cec-b23f-456a-b469-26761c67c145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:48.538143 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.538051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:48.674796 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:48.674719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"]
Jul 29 20:08:48.677666 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:08:48.677637    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb985cec_b23f_456a_b469_26761c67c145.slice/crio-7b7a792974ee8a94f6f565e02cbc141d20a0b06b543a0f61d52c0bbe3c537fdb WatchSource:0}: Error finding container 7b7a792974ee8a94f6f565e02cbc141d20a0b06b543a0f61d52c0bbe3c537fdb: Status 404 returned error can't find the container with id 7b7a792974ee8a94f6f565e02cbc141d20a0b06b543a0f61d52c0bbe3c537fdb
Jul 29 20:08:49.026519 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:49.026487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm" event={"ID":"eb985cec-b23f-456a-b469-26761c67c145","Type":"ContainerStarted","Data":"81e5abdad11406b779ed1798ea409219999fbb8b9e67a39b60e1dc61a75c160b"}
Jul 29 20:08:49.026698 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:49.026541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm" event={"ID":"eb985cec-b23f-456a-b469-26761c67c145","Type":"ContainerStarted","Data":"7b7a792974ee8a94f6f565e02cbc141d20a0b06b543a0f61d52c0bbe3c537fdb"}
Jul 29 20:08:49.041506 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:49.041450    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm" podStartSLOduration=1.041434878 podStartE2EDuration="1.041434878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:08:49.039989582 +0000 UTC m=+3222.956939170" watchObservedRunningTime="2026-07-29 20:08:49.041434878 +0000 UTC m=+3222.958384466"
Jul 29 20:08:50.033677 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:50.033640    2576 generic.go:356] "Generic (PLEG): container finished" podID="eb985cec-b23f-456a-b469-26761c67c145" containerID="81e5abdad11406b779ed1798ea409219999fbb8b9e67a39b60e1dc61a75c160b" exitCode=0
Jul 29 20:08:50.034088 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:50.033717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm" event={"ID":"eb985cec-b23f-456a-b469-26761c67c145","Type":"ContainerDied","Data":"81e5abdad11406b779ed1798ea409219999fbb8b9e67a39b60e1dc61a75c160b"}
Jul 29 20:08:51.172946 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:51.172920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:51.297944 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:51.297845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb985cec-b23f-456a-b469-26761c67c145-maas-api-service-ca\") pod \"eb985cec-b23f-456a-b469-26761c67c145\" (UID: \"eb985cec-b23f-456a-b469-26761c67c145\") "
Jul 29 20:08:51.298319 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:51.298281    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb985cec-b23f-456a-b469-26761c67c145-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb985cec-b23f-456a-b469-26761c67c145" (UID: "eb985cec-b23f-456a-b469-26761c67c145"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:08:51.398510 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:51.398476    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb985cec-b23f-456a-b469-26761c67c145-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:52.044678 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:52.044649    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"
Jul 29 20:08:52.044678 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:52.044671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm" event={"ID":"eb985cec-b23f-456a-b469-26761c67c145","Type":"ContainerDied","Data":"7b7a792974ee8a94f6f565e02cbc141d20a0b06b543a0f61d52c0bbe3c537fdb"}
Jul 29 20:08:52.044942 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:52.044713    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b7a792974ee8a94f6f565e02cbc141d20a0b06b543a0f61d52c0bbe3c537fdb"
Jul 29 20:08:54.289581 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.289547    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"]
Jul 29 20:08:54.290098 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.289779    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674" podUID="bb424d8f-5855-4e98-8d9c-fe59d42b040e" containerName="payload-processing" containerID="cri-o://4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6" gracePeriod=30
Jul 29 20:08:54.301079 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.301045    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"]
Jul 29 20:08:54.301368 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.301310    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r" podUID="ba7b9185-6905-4d37-b9fc-7ec956e3de19" containerName="payload-pre-processing" containerID="cri-o://d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c" gracePeriod=30
Jul 29 20:08:54.463399 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.463321    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"]
Jul 29 20:08:54.466151 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.466071    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5560c5-krchm"]
Jul 29 20:08:54.579147 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.579117    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:08:54.582497 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.582469    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:08:54.622359 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.622332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba7b9185-6905-4d37-b9fc-7ec956e3de19-plugins-config-volume\") pod \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") "
Jul 29 20:08:54.622521 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.622439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb424d8f-5855-4e98-8d9c-fe59d42b040e-plugins-config-volume\") pod \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") "
Jul 29 20:08:54.622521 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.622481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz7qp\" (UniqueName: \"kubernetes.io/projected/ba7b9185-6905-4d37-b9fc-7ec956e3de19-kube-api-access-tz7qp\") pod \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\" (UID: \"ba7b9185-6905-4d37-b9fc-7ec956e3de19\") "
Jul 29 20:08:54.622611 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.622533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtdqb\" (UniqueName: \"kubernetes.io/projected/bb424d8f-5855-4e98-8d9c-fe59d42b040e-kube-api-access-dtdqb\") pod \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\" (UID: \"bb424d8f-5855-4e98-8d9c-fe59d42b040e\") "
Jul 29 20:08:54.622834 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.622807    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba7b9185-6905-4d37-b9fc-7ec956e3de19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba7b9185-6905-4d37-b9fc-7ec956e3de19" (UID: "ba7b9185-6905-4d37-b9fc-7ec956e3de19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:08:54.622872 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.622853    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb424d8f-5855-4e98-8d9c-fe59d42b040e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb424d8f-5855-4e98-8d9c-fe59d42b040e" (UID: "bb424d8f-5855-4e98-8d9c-fe59d42b040e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:08:54.624726 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.624702    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb424d8f-5855-4e98-8d9c-fe59d42b040e-kube-api-access-dtdqb" (OuterVolumeSpecName: "kube-api-access-dtdqb") pod "bb424d8f-5855-4e98-8d9c-fe59d42b040e" (UID: "bb424d8f-5855-4e98-8d9c-fe59d42b040e"). InnerVolumeSpecName "kube-api-access-dtdqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:54.624788 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.624718    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7b9185-6905-4d37-b9fc-7ec956e3de19-kube-api-access-tz7qp" (OuterVolumeSpecName: "kube-api-access-tz7qp") pod "ba7b9185-6905-4d37-b9fc-7ec956e3de19" (UID: "ba7b9185-6905-4d37-b9fc-7ec956e3de19"). InnerVolumeSpecName "kube-api-access-tz7qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:54.673218 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.673185    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb985cec-b23f-456a-b469-26761c67c145" path="/var/lib/kubelet/pods/eb985cec-b23f-456a-b469-26761c67c145/volumes"
Jul 29 20:08:54.723416 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.723384    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtdqb\" (UniqueName: \"kubernetes.io/projected/bb424d8f-5855-4e98-8d9c-fe59d42b040e-kube-api-access-dtdqb\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:54.723416 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.723417    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba7b9185-6905-4d37-b9fc-7ec956e3de19-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:54.723619 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.723434    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb424d8f-5855-4e98-8d9c-fe59d42b040e-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:54.723619 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:54.723447    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz7qp\" (UniqueName: \"kubernetes.io/projected/ba7b9185-6905-4d37-b9fc-7ec956e3de19-kube-api-access-tz7qp\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:08:55.060838 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.060801    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb424d8f-5855-4e98-8d9c-fe59d42b040e" containerID="4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6" exitCode=0
Jul 29 20:08:55.061073 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.060851    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"
Jul 29 20:08:55.061073 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.060885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674" event={"ID":"bb424d8f-5855-4e98-8d9c-fe59d42b040e","Type":"ContainerDied","Data":"4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6"}
Jul 29 20:08:55.061073 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.060943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674" event={"ID":"bb424d8f-5855-4e98-8d9c-fe59d42b040e","Type":"ContainerDied","Data":"f2f4446973fbf94e5b94e2e59674ad79eb82897d51a6d7e0b0b4c7e21cb3aef9"}
Jul 29 20:08:55.061073 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.060977    2576 scope.go:117] "RemoveContainer" containerID="4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6"
Jul 29 20:08:55.062166 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.062137    2576 generic.go:356] "Generic (PLEG): container finished" podID="ba7b9185-6905-4d37-b9fc-7ec956e3de19" containerID="d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c" exitCode=0
Jul 29 20:08:55.062253 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.062173    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"
Jul 29 20:08:55.062253 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.062186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r" event={"ID":"ba7b9185-6905-4d37-b9fc-7ec956e3de19","Type":"ContainerDied","Data":"d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c"}
Jul 29 20:08:55.062253 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.062232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r" event={"ID":"ba7b9185-6905-4d37-b9fc-7ec956e3de19","Type":"ContainerDied","Data":"5e5e1087bcb3479429924c5f3e7dcadb4c9900ac8b96b39f838e933d515ffbe3"}
Jul 29 20:08:55.071954 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.071934    2576 scope.go:117] "RemoveContainer" containerID="4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6"
Jul 29 20:08:55.072229 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:08:55.072211    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6\": container with ID starting with 4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6 not found: ID does not exist" containerID="4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6"
Jul 29 20:08:55.072290 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.072237    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6"} err="failed to get container status \"4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6\": rpc error: code = NotFound desc = could not find container \"4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6\": container with ID starting with 4132a0661cce09eeb4e825862d684930d0737cd08802cfbbce08aad10101e1b6 not found: ID does not exist"
Jul 29 20:08:55.072290 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.072253    2576 scope.go:117] "RemoveContainer" containerID="d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c"
Jul 29 20:08:55.080459 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.080441    2576 scope.go:117] "RemoveContainer" containerID="d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c"
Jul 29 20:08:55.080779 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:08:55.080749    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c\": container with ID starting with d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c not found: ID does not exist" containerID="d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c"
Jul 29 20:08:55.080870 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.080786    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c"} err="failed to get container status \"d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c\": rpc error: code = NotFound desc = could not find container \"d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c\": container with ID starting with d6848b48e6ad1df9e0155dbdb86d1f96c3fb2f92b1c02fd94091629b7e80ba7c not found: ID does not exist"
Jul 29 20:08:55.082733 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.082714    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"]
Jul 29 20:08:55.084575 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.084556    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5560c5-6b6c586588-ndv4r"]
Jul 29 20:08:55.092821 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.092800    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"]
Jul 29 20:08:55.097202 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:55.097180    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5560c5-75b9958d8d-qz674"]
Jul 29 20:08:56.672679 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:56.672644    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7b9185-6905-4d37-b9fc-7ec956e3de19" path="/var/lib/kubelet/pods/ba7b9185-6905-4d37-b9fc-7ec956e3de19/volumes"
Jul 29 20:08:56.673073 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:08:56.673002    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb424d8f-5855-4e98-8d9c-fe59d42b040e" path="/var/lib/kubelet/pods/bb424d8f-5855-4e98-8d9c-fe59d42b040e/volumes"
Jul 29 20:09:06.893590 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:06.893496    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"]
Jul 29 20:09:06.894113 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:06.893780    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4" podUID="f0730dcd-632a-4fee-8be6-b801b9b5eed7" containerName="payload-processing" containerID="cri-o://8ac763023e3caf400545232dc286dd59841621e95d3b0ec97ca2c776e9960a32" gracePeriod=30
Jul 29 20:09:06.903527 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:06.903492    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"]
Jul 29 20:09:06.903757 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:06.903727    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2" podUID="2ab56e34-2116-4cc1-a85f-ec2fc60a3646" containerName="payload-pre-processing" containerID="cri-o://0609c0be03a4fcb8faee575062cb00ced245493edb9fbe2d7dab4b207556a4bb" gracePeriod=30
Jul 29 20:09:07.140347 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.140296    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0730dcd-632a-4fee-8be6-b801b9b5eed7" containerID="8ac763023e3caf400545232dc286dd59841621e95d3b0ec97ca2c776e9960a32" exitCode=0
Jul 29 20:09:07.140826 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.140797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4" event={"ID":"f0730dcd-632a-4fee-8be6-b801b9b5eed7","Type":"ContainerDied","Data":"8ac763023e3caf400545232dc286dd59841621e95d3b0ec97ca2c776e9960a32"}
Jul 29 20:09:07.142895 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.142871    2576 generic.go:356] "Generic (PLEG): container finished" podID="2ab56e34-2116-4cc1-a85f-ec2fc60a3646" containerID="0609c0be03a4fcb8faee575062cb00ced245493edb9fbe2d7dab4b207556a4bb" exitCode=0
Jul 29 20:09:07.143052 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.142937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2" event={"ID":"2ab56e34-2116-4cc1-a85f-ec2fc60a3646","Type":"ContainerDied","Data":"0609c0be03a4fcb8faee575062cb00ced245493edb9fbe2d7dab4b207556a4bb"}
Jul 29 20:09:07.182116 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.182089    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 20:09:07.184230 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.184213    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 20:09:07.240040 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.239999    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0730dcd-632a-4fee-8be6-b801b9b5eed7-plugins-config-volume\") pod \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") "
Jul 29 20:09:07.240226 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.240069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-plugins-config-volume\") pod \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") "
Jul 29 20:09:07.240226 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.240090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gknwl\" (UniqueName: \"kubernetes.io/projected/f0730dcd-632a-4fee-8be6-b801b9b5eed7-kube-api-access-gknwl\") pod \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\" (UID: \"f0730dcd-632a-4fee-8be6-b801b9b5eed7\") "
Jul 29 20:09:07.240226 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.240121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lhtj\" (UniqueName: \"kubernetes.io/projected/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-kube-api-access-9lhtj\") pod \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\" (UID: \"2ab56e34-2116-4cc1-a85f-ec2fc60a3646\") "
Jul 29 20:09:07.240459 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.240428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0730dcd-632a-4fee-8be6-b801b9b5eed7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0730dcd-632a-4fee-8be6-b801b9b5eed7" (UID: "f0730dcd-632a-4fee-8be6-b801b9b5eed7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:07.240514 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.240442    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ab56e34-2116-4cc1-a85f-ec2fc60a3646" (UID: "2ab56e34-2116-4cc1-a85f-ec2fc60a3646"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:07.242203 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.242183    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0730dcd-632a-4fee-8be6-b801b9b5eed7-kube-api-access-gknwl" (OuterVolumeSpecName: "kube-api-access-gknwl") pod "f0730dcd-632a-4fee-8be6-b801b9b5eed7" (UID: "f0730dcd-632a-4fee-8be6-b801b9b5eed7"). InnerVolumeSpecName "kube-api-access-gknwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:07.242283 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.242213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-kube-api-access-9lhtj" (OuterVolumeSpecName: "kube-api-access-9lhtj") pod "2ab56e34-2116-4cc1-a85f-ec2fc60a3646" (UID: "2ab56e34-2116-4cc1-a85f-ec2fc60a3646"). InnerVolumeSpecName "kube-api-access-9lhtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:07.341646 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.341601    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0730dcd-632a-4fee-8be6-b801b9b5eed7-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:07.341646 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.341639    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:07.341646 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.341649    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gknwl\" (UniqueName: \"kubernetes.io/projected/f0730dcd-632a-4fee-8be6-b801b9b5eed7-kube-api-access-gknwl\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:07.341646 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:07.341657    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lhtj\" (UniqueName: \"kubernetes.io/projected/2ab56e34-2116-4cc1-a85f-ec2fc60a3646-kube-api-access-9lhtj\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:08.148777 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.148738    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"
Jul 29 20:09:08.148777 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.148771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2" event={"ID":"2ab56e34-2116-4cc1-a85f-ec2fc60a3646","Type":"ContainerDied","Data":"7b8c1d1c8b567e3d33231c1007627ac309e8ea6a50420c6991f4d0af82bc4fb1"}
Jul 29 20:09:08.149366 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.148835    2576 scope.go:117] "RemoveContainer" containerID="0609c0be03a4fcb8faee575062cb00ced245493edb9fbe2d7dab4b207556a4bb"
Jul 29 20:09:08.150236 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.150199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4" event={"ID":"f0730dcd-632a-4fee-8be6-b801b9b5eed7","Type":"ContainerDied","Data":"3bba0955a31469b7aa36ff791b59a8060c527720f33b05fc7b0287b3c40bf319"}
Jul 29 20:09:08.150236 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.150225    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"
Jul 29 20:09:08.159273 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.159231    2576 scope.go:117] "RemoveContainer" containerID="8ac763023e3caf400545232dc286dd59841621e95d3b0ec97ca2c776e9960a32"
Jul 29 20:09:08.173257 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.173228    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"]
Jul 29 20:09:08.177802 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.177777    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-9a3702-844489479b-4n6v2"]
Jul 29 20:09:08.185821 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.185795    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"]
Jul 29 20:09:08.191242 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.191220    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-9a3702-5455bf49d-gwbr4"]
Jul 29 20:09:08.671824 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.671791    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab56e34-2116-4cc1-a85f-ec2fc60a3646" path="/var/lib/kubelet/pods/2ab56e34-2116-4cc1-a85f-ec2fc60a3646/volumes"
Jul 29 20:09:08.672178 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:08.672165    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0730dcd-632a-4fee-8be6-b801b9b5eed7" path="/var/lib/kubelet/pods/f0730dcd-632a-4fee-8be6-b801b9b5eed7/volumes"
Jul 29 20:09:14.480818 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.480777    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"]
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481188    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0730dcd-632a-4fee-8be6-b801b9b5eed7" containerName="payload-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481203    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0730dcd-632a-4fee-8be6-b801b9b5eed7" containerName="payload-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481223    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb424d8f-5855-4e98-8d9c-fe59d42b040e" containerName="payload-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481228    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb424d8f-5855-4e98-8d9c-fe59d42b040e" containerName="payload-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481234    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb985cec-b23f-456a-b469-26761c67c145" containerName="revoke-keys"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481242    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb985cec-b23f-456a-b469-26761c67c145" containerName="revoke-keys"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481259    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7b9185-6905-4d37-b9fc-7ec956e3de19" containerName="payload-pre-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481265    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7b9185-6905-4d37-b9fc-7ec956e3de19" containerName="payload-pre-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab56e34-2116-4cc1-a85f-ec2fc60a3646" containerName="payload-pre-processing"
Jul 29 20:09:14.481282 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481278    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab56e34-2116-4cc1-a85f-ec2fc60a3646" containerName="payload-pre-processing"
Jul 29 20:09:14.481623 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481341    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb424d8f-5855-4e98-8d9c-fe59d42b040e" containerName="payload-processing"
Jul 29 20:09:14.481623 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481349    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb985cec-b23f-456a-b469-26761c67c145" containerName="revoke-keys"
Jul 29 20:09:14.481623 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481356    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab56e34-2116-4cc1-a85f-ec2fc60a3646" containerName="payload-pre-processing"
Jul 29 20:09:14.481623 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481362    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7b9185-6905-4d37-b9fc-7ec956e3de19" containerName="payload-pre-processing"
Jul 29 20:09:14.481623 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.481369    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0730dcd-632a-4fee-8be6-b801b9b5eed7" containerName="payload-processing"
Jul 29 20:09:14.485673 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.485656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:14.487556 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.487535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 20:09:14.487660 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.487537    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:09:14.490870 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.490840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"]
Jul 29 20:09:14.608857 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.608821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78436cff-2374-4d04-8fc9-6f5535f94412-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq\" (UID: \"78436cff-2374-4d04-8fc9-6f5535f94412\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:14.710108 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.710073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78436cff-2374-4d04-8fc9-6f5535f94412-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq\" (UID: \"78436cff-2374-4d04-8fc9-6f5535f94412\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:14.710765 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.710736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78436cff-2374-4d04-8fc9-6f5535f94412-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq\" (UID: \"78436cff-2374-4d04-8fc9-6f5535f94412\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:14.797335 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:14.797251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:15.138352 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:15.138323    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"]
Jul 29 20:09:15.141260 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:09:15.141220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78436cff_2374_4d04_8fc9_6f5535f94412.slice/crio-6cfd9e7d5a424533b8d01f24c53750080a7d2a7c4afd62d4b15f24a46cf0f97d WatchSource:0}: Error finding container 6cfd9e7d5a424533b8d01f24c53750080a7d2a7c4afd62d4b15f24a46cf0f97d: Status 404 returned error can't find the container with id 6cfd9e7d5a424533b8d01f24c53750080a7d2a7c4afd62d4b15f24a46cf0f97d
Jul 29 20:09:15.185968 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:15.185937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq" event={"ID":"78436cff-2374-4d04-8fc9-6f5535f94412","Type":"ContainerStarted","Data":"6cfd9e7d5a424533b8d01f24c53750080a7d2a7c4afd62d4b15f24a46cf0f97d"}
Jul 29 20:09:16.192366 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:16.192332    2576 generic.go:356] "Generic (PLEG): container finished" podID="78436cff-2374-4d04-8fc9-6f5535f94412" containerID="ea2d1e934723848f07de4173c73bb8086a4324768d32c8c728d0edcce768cbf0" exitCode=0
Jul 29 20:09:16.192747 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:16.192376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq" event={"ID":"78436cff-2374-4d04-8fc9-6f5535f94412","Type":"ContainerDied","Data":"ea2d1e934723848f07de4173c73bb8086a4324768d32c8c728d0edcce768cbf0"}
Jul 29 20:09:17.331701 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:17.331673    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:17.435353 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:17.435314    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78436cff-2374-4d04-8fc9-6f5535f94412-maas-api-service-ca\") pod \"78436cff-2374-4d04-8fc9-6f5535f94412\" (UID: \"78436cff-2374-4d04-8fc9-6f5535f94412\") "
Jul 29 20:09:17.435692 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:17.435669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78436cff-2374-4d04-8fc9-6f5535f94412-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78436cff-2374-4d04-8fc9-6f5535f94412" (UID: "78436cff-2374-4d04-8fc9-6f5535f94412"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:17.537119 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:17.537012    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78436cff-2374-4d04-8fc9-6f5535f94412-maas-api-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:18.203093 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:18.203056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq" event={"ID":"78436cff-2374-4d04-8fc9-6f5535f94412","Type":"ContainerDied","Data":"6cfd9e7d5a424533b8d01f24c53750080a7d2a7c4afd62d4b15f24a46cf0f97d"}
Jul 29 20:09:18.203266 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:18.203124    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cfd9e7d5a424533b8d01f24c53750080a7d2a7c4afd62d4b15f24a46cf0f97d"
Jul 29 20:09:18.203266 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:18.203069    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"
Jul 29 20:09:20.464800 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.464761    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"]
Jul 29 20:09:20.465496 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.464978    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd" podUID="d912d499-49e5-460a-923e-6273b752d46b" containerName="payload-processing" containerID="cri-o://b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31" gracePeriod=30
Jul 29 20:09:20.469957 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.469897    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"]
Jul 29 20:09:20.470884 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.470849    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65" podUID="ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" containerName="payload-pre-processing" containerID="cri-o://539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07" gracePeriod=30
Jul 29 20:09:20.662016 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.661981    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"]
Jul 29 20:09:20.674192 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.674161    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8ef216-r27kq"]
Jul 29 20:09:20.761860 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.761833    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 20:09:20.764885 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.764860    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 20:09:20.866325 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.866292    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q79xg\" (UniqueName: \"kubernetes.io/projected/d912d499-49e5-460a-923e-6273b752d46b-kube-api-access-q79xg\") pod \"d912d499-49e5-460a-923e-6273b752d46b\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") "
Jul 29 20:09:20.866541 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.866362    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d912d499-49e5-460a-923e-6273b752d46b-plugins-config-volume\") pod \"d912d499-49e5-460a-923e-6273b752d46b\" (UID: \"d912d499-49e5-460a-923e-6273b752d46b\") "
Jul 29 20:09:20.866541 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.866403    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-plugins-config-volume\") pod \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") "
Jul 29 20:09:20.866541 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.866459    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7znw7\" (UniqueName: \"kubernetes.io/projected/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-kube-api-access-7znw7\") pod \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\" (UID: \"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d\") "
Jul 29 20:09:20.866833 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.866806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d912d499-49e5-460a-923e-6273b752d46b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d912d499-49e5-460a-923e-6273b752d46b" (UID: "d912d499-49e5-460a-923e-6273b752d46b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:20.866892 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.866818    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" (UID: "ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:20.868544 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.868513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-kube-api-access-7znw7" (OuterVolumeSpecName: "kube-api-access-7znw7") pod "ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" (UID: "ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d"). InnerVolumeSpecName "kube-api-access-7znw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:20.868653 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.868597    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d912d499-49e5-460a-923e-6273b752d46b-kube-api-access-q79xg" (OuterVolumeSpecName: "kube-api-access-q79xg") pod "d912d499-49e5-460a-923e-6273b752d46b" (UID: "d912d499-49e5-460a-923e-6273b752d46b"). InnerVolumeSpecName "kube-api-access-q79xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:20.967985 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.967939    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7znw7\" (UniqueName: \"kubernetes.io/projected/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-kube-api-access-7znw7\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:20.967985 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.967977    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q79xg\" (UniqueName: \"kubernetes.io/projected/d912d499-49e5-460a-923e-6273b752d46b-kube-api-access-q79xg\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:20.967985 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.967987    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d912d499-49e5-460a-923e-6273b752d46b-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:20.967985 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:20.967996    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d-plugins-config-volume\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 29 20:09:21.219383 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.219347    2576 generic.go:356] "Generic (PLEG): container finished" podID="ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" containerID="539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07" exitCode=0
Jul 29 20:09:21.219540 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.219394    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"
Jul 29 20:09:21.219540 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.219432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65" event={"ID":"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d","Type":"ContainerDied","Data":"539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07"}
Jul 29 20:09:21.219540 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.219484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65" event={"ID":"ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d","Type":"ContainerDied","Data":"6794050b45fd7ea3e7e45df58f59fcea46c93c9b91f3aa740d5eeaad060a3a38"}
Jul 29 20:09:21.219540 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.219515    2576 scope.go:117] "RemoveContainer" containerID="539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07"
Jul 29 20:09:21.220759 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.220734    2576 generic.go:356] "Generic (PLEG): container finished" podID="d912d499-49e5-460a-923e-6273b752d46b" containerID="b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31" exitCode=0
Jul 29 20:09:21.220870 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.220769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd" event={"ID":"d912d499-49e5-460a-923e-6273b752d46b","Type":"ContainerDied","Data":"b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31"}
Jul 29 20:09:21.220870 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.220790    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"
Jul 29 20:09:21.220870 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.220801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd" event={"ID":"d912d499-49e5-460a-923e-6273b752d46b","Type":"ContainerDied","Data":"178d5e4eda4eeb16b3ac4f9534216359ea3d28fcc3e32988ddb8a4753da6edc4"}
Jul 29 20:09:21.231957 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.231930    2576 scope.go:117] "RemoveContainer" containerID="539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07"
Jul 29 20:09:21.232382 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:09:21.232359    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07\": container with ID starting with 539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07 not found: ID does not exist" containerID="539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07"
Jul 29 20:09:21.232503 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.232392    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07"} err="failed to get container status \"539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07\": rpc error: code = NotFound desc = could not find container \"539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07\": container with ID starting with 539d309f2a430777b9e099fe11862aea202fb750a45437e9dd7af4b3a57fff07 not found: ID does not exist"
Jul 29 20:09:21.232503 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.232413    2576 scope.go:117] "RemoveContainer" containerID="b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31"
Jul 29 20:09:21.241016 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.240998    2576 scope.go:117] "RemoveContainer" containerID="b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31"
Jul 29 20:09:21.241360 ip-10-0-130-131 kubenswrapper[2576]: E0729 20:09:21.241341    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31\": container with ID starting with b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31 not found: ID does not exist" containerID="b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31"
Jul 29 20:09:21.241417 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.241369    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31"} err="failed to get container status \"b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31\": rpc error: code = NotFound desc = could not find container \"b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31\": container with ID starting with b53853f7922676775c5696b439da754469027ab6a8b6c86fdf03ff5ac9497c31 not found: ID does not exist"
Jul 29 20:09:21.241852 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.241834    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"]
Jul 29 20:09:21.245528 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.245507    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ef216-545cb78556-gmd65"]
Jul 29 20:09:21.254999 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.254970    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"]
Jul 29 20:09:21.258842 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:21.258814    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ef216-54dd6d8b8b-6zlmd"]
Jul 29 20:09:22.675459 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:22.675417    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78436cff-2374-4d04-8fc9-6f5535f94412" path="/var/lib/kubelet/pods/78436cff-2374-4d04-8fc9-6f5535f94412/volumes"
Jul 29 20:09:22.676042 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:22.675995    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d912d499-49e5-460a-923e-6273b752d46b" path="/var/lib/kubelet/pods/d912d499-49e5-460a-923e-6273b752d46b/volumes"
Jul 29 20:09:22.676530 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:22.676511    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" path="/var/lib/kubelet/pods/ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d/volumes"
Jul 29 20:09:27.897228 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:27.897193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77749db965-fj6rp_6f020335-16b5-490d-a733-ed49bd82cbf1/authorino/0.log"
Jul 29 20:09:34.263262 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:34.263231    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-xv5fl_c713c056-6503-4f16-b970-20c0029e03eb/copy-manifests/0.log"
Jul 29 20:09:34.270149 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:34.270122    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-xv5fl_c713c056-6503-4f16-b970-20c0029e03eb/manager/0.log"
Jul 29 20:09:36.344635 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:36.344591    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77749db965-fj6rp_6f020335-16b5-490d-a733-ed49bd82cbf1/authorino/0.log"
Jul 29 20:09:36.465777 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:36.465731    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r6bmv_549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3/manager/0.log"
Jul 29 20:09:36.577410 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:36.577384    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgxrw_f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb/manager/0.log"
Jul 29 20:09:36.693241 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:36.693162    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-b2bx7_182de768-f1a0-45c7-ae39-d1175249c924/kuadrant-console-plugin/0.log"
Jul 29 20:09:37.870079 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:37.870048    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-zxv9t_dcb37299-f419-43ca-ba36-d638195bf871/kube-auth-proxy/0.log"
Jul 29 20:09:38.921464 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:38.921428    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rdjjf_e6b126c1-5612-482a-ba3d-59646bb4d78e/main/0.log"
Jul 29 20:09:39.141341 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:39.141312    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bf8bg_c1a9a6f1-f101-46f6-80ce-f1405baa08cf/main/0.log"
Jul 29 20:09:47.930184 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:47.930137    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nhrvq_ed232216-d9a1-4512-9f78-339059c5dcec/global-pull-secret-syncer/0.log"
Jul 29 20:09:48.057957 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:48.057926    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-msxs5_78bffe42-dcde-4971-a13a-0722d22ac989/konnectivity-agent/0.log"
Jul 29 20:09:48.080543 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:48.080511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-131.ec2.internal_9cd9ebd8f4382549a6bbabe657589c93/haproxy/0.log"
Jul 29 20:09:52.691482 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:52.691445    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77749db965-fj6rp_6f020335-16b5-490d-a733-ed49bd82cbf1/authorino/0.log"
Jul 29 20:09:52.741396 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:52.741355    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r6bmv_549fc7c9-d20b-4ee4-902e-2cc4b0bf39c3/manager/0.log"
Jul 29 20:09:52.815352 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:52.815311    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgxrw_f5d0108b-0643-40f0-8c2a-9dc32e7f4fbb/manager/0.log"
Jul 29 20:09:52.870784 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:52.870757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-b2bx7_182de768-f1a0-45c7-ae39-d1175249c924/kuadrant-console-plugin/0.log"
Jul 29 20:09:54.918743 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:54.918713    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/alertmanager/0.log"
Jul 29 20:09:54.936949 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:54.936916    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/config-reloader/0.log"
Jul 29 20:09:54.961223 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:54.961198    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/kube-rbac-proxy-web/0.log"
Jul 29 20:09:54.982166 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:54.982134    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/kube-rbac-proxy/0.log"
Jul 29 20:09:55.003973 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.003935    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/kube-rbac-proxy-metric/0.log"
Jul 29 20:09:55.024929 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.024903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/prom-label-proxy/0.log"
Jul 29 20:09:55.050373 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.050348    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8b396d8-14af-4641-8905-cdb9eb41524d/init-config-reloader/0.log"
Jul 29 20:09:55.136276 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.136250    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-js2fh_3834a7ce-df56-40ad-ba8b-dad5a2b88dfb/kube-state-metrics/0.log"
Jul 29 20:09:55.157638 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.157612    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-js2fh_3834a7ce-df56-40ad-ba8b-dad5a2b88dfb/kube-rbac-proxy-main/0.log"
Jul 29 20:09:55.183888 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.183805    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-js2fh_3834a7ce-df56-40ad-ba8b-dad5a2b88dfb/kube-rbac-proxy-self/0.log"
Jul 29 20:09:55.214277 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.214240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f75dd449b-hfxzz_c353dd3e-9f2a-46b0-986a-e0b7378fe8e7/metrics-server/0.log"
Jul 29 20:09:55.375599 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.375569    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4x8w_46ead131-d1b7-4efe-a02d-614d3ab56c26/node-exporter/0.log"
Jul 29 20:09:55.398211 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.398186    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4x8w_46ead131-d1b7-4efe-a02d-614d3ab56c26/kube-rbac-proxy/0.log"
Jul 29 20:09:55.423069 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.423049    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4x8w_46ead131-d1b7-4efe-a02d-614d3ab56c26/init-textfile/0.log"
Jul 29 20:09:55.628837 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.628809    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/prometheus/0.log"
Jul 29 20:09:55.652194 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.652164    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/config-reloader/0.log"
Jul 29 20:09:55.675688 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.675657    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/thanos-sidecar/0.log"
Jul 29 20:09:55.700961 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.700932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/kube-rbac-proxy-web/0.log"
Jul 29 20:09:55.731832 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.731811    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/kube-rbac-proxy/0.log"
Jul 29 20:09:55.754860 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.754839    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/kube-rbac-proxy-thanos/0.log"
Jul 29 20:09:55.776313 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.776291    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f7901695-fbc7-4532-9d1b-d9ac74457e46/init-config-reloader/0.log"
Jul 29 20:09:55.804680 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.804647    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-rpxcx_979c9ee5-6e11-48b1-b699-2fddb60c9299/prometheus-operator/0.log"
Jul 29 20:09:55.822400 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.822378    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-rpxcx_979c9ee5-6e11-48b1-b699-2fddb60c9299/kube-rbac-proxy/0.log"
Jul 29 20:09:55.875716 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.875677    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4d4fc79f-sbjff_b97c5fea-80e2-4c25-a12e-a78492d38d7e/telemeter-client/0.log"
Jul 29 20:09:55.899257 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.899154    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4d4fc79f-sbjff_b97c5fea-80e2-4c25-a12e-a78492d38d7e/reload/0.log"
Jul 29 20:09:55.923277 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:55.923247    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4d4fc79f-sbjff_b97c5fea-80e2-4c25-a12e-a78492d38d7e/kube-rbac-proxy/0.log"
Jul 29 20:09:58.124694 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.124659    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"]
Jul 29 20:09:58.125125 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125042    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" containerName="payload-pre-processing"
Jul 29 20:09:58.125125 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125055    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" containerName="payload-pre-processing"
Jul 29 20:09:58.125125 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125063    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78436cff-2374-4d04-8fc9-6f5535f94412" containerName="revoke-keys"
Jul 29 20:09:58.125125 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125068    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="78436cff-2374-4d04-8fc9-6f5535f94412" containerName="revoke-keys"
Jul 29 20:09:58.125125 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125099    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d912d499-49e5-460a-923e-6273b752d46b" containerName="payload-processing"
Jul 29 20:09:58.125125 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125105    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d912d499-49e5-460a-923e-6273b752d46b" containerName="payload-processing"
Jul 29 20:09:58.125362 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125170    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d912d499-49e5-460a-923e-6273b752d46b" containerName="payload-processing"
Jul 29 20:09:58.125362 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125180    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="78436cff-2374-4d04-8fc9-6f5535f94412" containerName="revoke-keys"
Jul 29 20:09:58.125362 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.125186    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb5b2d4-3de1-4b87-b24b-1f78308ddd1d" containerName="payload-pre-processing"
Jul 29 20:09:58.128341 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.128324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.130739 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.130715    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x7qkh\"/\"default-dockercfg-t7j52\""
Jul 29 20:09:58.130877 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.130739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7qkh\"/\"openshift-service-ca.crt\""
Jul 29 20:09:58.131260 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.131242    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7qkh\"/\"kube-root-ca.crt\""
Jul 29 20:09:58.135880 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.135601    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"]
Jul 29 20:09:58.198090 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.198053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-sys\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.198274 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.198102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-lib-modules\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.198274 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.198226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-proc\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.198347 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.198274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6tqt\" (UniqueName: \"kubernetes.io/projected/26b84a76-7c28-474e-a936-8686632025b0-kube-api-access-b6tqt\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.198347 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.198322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-podres\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299394 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-sys\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299394 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-lib-modules\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299583 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-proc\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299583 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-sys\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299583 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6tqt\" (UniqueName: \"kubernetes.io/projected/26b84a76-7c28-474e-a936-8686632025b0-kube-api-access-b6tqt\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299583 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-podres\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299774 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299583    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-proc\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299774 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-lib-modules\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.299878 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.299786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26b84a76-7c28-474e-a936-8686632025b0-podres\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.306765 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.306735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6tqt\" (UniqueName: \"kubernetes.io/projected/26b84a76-7c28-474e-a936-8686632025b0-kube-api-access-b6tqt\") pod \"perf-node-gather-daemonset-rhrft\" (UID: \"26b84a76-7c28-474e-a936-8686632025b0\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.439662 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.439539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:58.571477 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:58.571448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"]
Jul 29 20:09:58.573955 ip-10-0-130-131 kubenswrapper[2576]: W0729 20:09:58.573923    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod26b84a76_7c28_474e_a936_8686632025b0.slice/crio-f6cea2105b40465358cfdd113998df49a991d4c742101b619051335b313b6433 WatchSource:0}: Error finding container f6cea2105b40465358cfdd113998df49a991d4c742101b619051335b313b6433: Status 404 returned error can't find the container with id f6cea2105b40465358cfdd113998df49a991d4c742101b619051335b313b6433
Jul 29 20:09:59.409327 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:59.409282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft" event={"ID":"26b84a76-7c28-474e-a936-8686632025b0","Type":"ContainerStarted","Data":"d038a912678d9dfa4d9611d8cf591a31b6a462832e95bd2c93130b4e7b6308dd"}
Jul 29 20:09:59.409813 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:59.409344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft" event={"ID":"26b84a76-7c28-474e-a936-8686632025b0","Type":"ContainerStarted","Data":"f6cea2105b40465358cfdd113998df49a991d4c742101b619051335b313b6433"}
Jul 29 20:09:59.409813 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:59.409411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:09:59.425816 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:09:59.425617    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft" podStartSLOduration=1.4255668479999999 podStartE2EDuration="1.425566848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:59.425166642 +0000 UTC m=+3293.342116230" watchObservedRunningTime="2026-07-29 20:09:59.425566848 +0000 UTC m=+3293.342516441"
Jul 29 20:10:00.305982 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:00.305951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xgrc9_656b7ad0-5439-4b22-aec7-2a9f17ac42e7/dns/0.log"
Jul 29 20:10:00.327360 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:00.327331    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xgrc9_656b7ad0-5439-4b22-aec7-2a9f17ac42e7/kube-rbac-proxy/0.log"
Jul 29 20:10:00.382467 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:00.382440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hgw2d_4e8d45ae-6a24-4c53-a66d-efa1e334b553/dns-node-resolver/0.log"
Jul 29 20:10:01.010120 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:01.010086    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtr52_ba366e20-e4a8-4067-9bbf-dd341a39cf4b/node-ca/0.log"
Jul 29 20:10:02.186573 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:02.186520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-zxv9t_dcb37299-f419-43ca-ba36-d638195bf871/kube-auth-proxy/0.log"
Jul 29 20:10:03.183962 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:03.183933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mq9v_d2503d05-dcf0-44b4-8cb0-5773e946fecd/serve-healthcheck-canary/0.log"
Jul 29 20:10:03.872558 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:03.872531    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdqw4_8142cc10-2852-4db3-9aef-afba0dc36d7c/kube-rbac-proxy/0.log"
Jul 29 20:10:03.895616 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:03.895592    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdqw4_8142cc10-2852-4db3-9aef-afba0dc36d7c/exporter/0.log"
Jul 29 20:10:03.920107 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:03.920078    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdqw4_8142cc10-2852-4db3-9aef-afba0dc36d7c/extractor/0.log"
Jul 29 20:10:05.427619 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:05.427591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-rhrft"
Jul 29 20:10:06.769704 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:06.769661    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 20:10:06.774702 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:06.774679    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4m82q_a0c26413-67c1-4f58-b274-a1ec445c0dba/ovn-acl-logging/0.log"
Jul 29 20:10:07.048968 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:07.048934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-xv5fl_c713c056-6503-4f16-b970-20c0029e03eb/manager/0.log"
Jul 29 20:10:07.088188 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:07.088160    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-xv5fl_c713c056-6503-4f16-b970-20c0029e03eb/copy-manifests/0.log"
Jul 29 20:10:08.532280 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:08.532254    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66ff6dc8fc-7jqqq_e275497e-70ef-40ff-966b-c3ca8a6252b3/manager/0.log"
Jul 29 20:10:08.623254 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:08.623222    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cxshx_6bf09da8-7bbb-4807-b596-d86c24cb50b8/openshift-lws-operator/0.log"
Jul 29 20:10:08.914135 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:08.914104    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-zxv9t_dcb37299-f419-43ca-ba36-d638195bf871/kube-auth-proxy/0.log"
Jul 29 20:10:10.721771 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:10.721745    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-zxv9t_dcb37299-f419-43ca-ba36-d638195bf871/kube-auth-proxy/0.log"
Jul 29 20:10:14.997556 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:14.997482    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/kube-multus-additional-cni-plugins/0.log"
Jul 29 20:10:15.018830 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.018806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/egress-router-binary-copy/0.log"
Jul 29 20:10:15.039920 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.039886    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/cni-plugins/0.log"
Jul 29 20:10:15.060909 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.060880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/bond-cni-plugin/0.log"
Jul 29 20:10:15.084223 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.084198    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/routeoverride-cni/0.log"
Jul 29 20:10:15.110107 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.110081    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/whereabouts-cni-bincopy/0.log"
Jul 29 20:10:15.131359 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.131328    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bswqg_980df7b3-9ea3-4c59-ab60-ad2bb522a660/whereabouts-cni/0.log"
Jul 29 20:10:15.554817 ip-10-0-130-131 kubenswrapper[2576]: I0729 20:10:15.554781    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mx8hx_9ed84254-bf53-411d-81cb-4632cee44b0c/kube-multus/0.log"