Jul 31 00:04:24.699310 ip-10-0-129-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 00:04:24.699323 ip-10-0-129-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 00:04:24.699332 ip-10-0-129-35 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 00:04:24.699645 ip-10-0-129-35 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 00:04:34.854396 ip-10-0-129-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 00:04:34.854415 ip-10-0-129-35 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d0a106926d9045f287a9c8ef618a24de --
Jul 31 00:06:33.802071 ip-10-0-129-35 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 00:06:34.279379 ip-10-0-129-35 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 00:06:34.279379 ip-10-0-129-35 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 00:06:34.279379 ip-10-0-129-35 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 00:06:34.279379 ip-10-0-129-35 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 00:06:34.279379 ip-10-0-129-35 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 00:06:34.280220 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.280079    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 00:06:34.286372 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286355    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:06:34.286372 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286372    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286377    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286380    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286383    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286385    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286388    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286391    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286395    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286399    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286402    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286405    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286408    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286410    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286413    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286416    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286418    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286422    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286424    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286427    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286430    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:06:34.286474 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286433    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286435    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286438    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286441    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286443    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286445    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286448    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286450    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286453    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286456    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286458    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286460    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286464    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286468    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286472    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286475    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286478    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286481    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286484    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:06:34.286956 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286487    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286489    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286492    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286495    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286497    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286500    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286503    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286505    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286508    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286510    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286513    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286517    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286521    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286523    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286526    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286528    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286531    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286534    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286536    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:06:34.287408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286539    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286541    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286544    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286546    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286548    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286551    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286554    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286557    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286560    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286563    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286566    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286568    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286571    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286574    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286576    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286579    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286581    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286584    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286586    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:06:34.287922 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286589    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286591    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286594    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286596    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286600    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286603    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286605    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286608    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286610    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286612    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286615    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286618    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286620    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286623    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286625    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286628    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286630    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286633    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286635    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286638    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:06:34.288386 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.286641    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287353    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287360    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287363    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287366    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287368    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287371    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287374    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287376    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287379    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287381    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287384    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287387    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287389    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287392    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287395    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287398    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287401    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287403    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287406    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:06:34.288880 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287408    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287411    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287414    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287416    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287419    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287422    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287424    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287426    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287429    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287431    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287433    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287436    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287438    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287441    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287446    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287449    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287452    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287455    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287457    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287460    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:06:34.289365 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287462    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287465    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287467    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287470    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287472    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287474    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287477    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287479    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287482    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287484    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287486    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287489    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287491    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287493    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287496    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287498    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287500    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287503    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287505    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:06:34.289868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287508    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287510    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287513    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287516    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287519    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287522    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287525    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287527    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287530    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287534    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287537    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287540    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287543    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287546    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287548    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287551    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287553    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287556    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287558    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287561    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:06:34.290359 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287564    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287566    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287568    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287571    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287574    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287576    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287578    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287582    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287584    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287587    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287589    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287593    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287597    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287600    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287603    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287606    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287609    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287611    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287614    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:06:34.290862 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287617    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.287620    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288028    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288033    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288039    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288042    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288045    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288048    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288050    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288053    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288055    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288058    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288060    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288062    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288065    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288067    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288070    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288072    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288075    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288078    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:06:34.291316 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288080    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288083    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288085    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288088    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288090    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288092    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288095    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288098    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288101    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288103    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288106    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288108    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288111    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288113    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288115    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288118    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288122    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288125    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288127    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:06:34.291818 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288130    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288133    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288135    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288137    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288141    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288144    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288147    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288150    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288153    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288157    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288160    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288163    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288165    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288168    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288171    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288173    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288176    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288178    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288181    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:06:34.292285 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288184    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288188    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288190    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288193    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288196    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288198    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288201    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288204    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288206    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288209    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288212    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288215    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288218    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288220    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288223    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288226    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288228    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288231    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288234    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288236    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:06:34.292762 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288239    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288242    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288244    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288247    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288257    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288261    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288265    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288267    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288270    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288272    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288274    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288277    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288280    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288282    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288285    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288287    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288290    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288292    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288294    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288297    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:06:34.293245 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288300    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288302    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288307    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288380    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288390    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288397    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288401    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288406    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288410    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288414    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288417    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288420    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288423    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288427    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288430    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288433    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288436    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288439    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288442    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288444    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288447    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288452    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288455    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 00:06:34.293714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288458    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288461    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288464    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288468    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288471    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288474    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288477    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288480    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288483    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288486    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288489    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288492    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288496    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288499    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288502    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288504    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288508    2555 flags.go:64] FLAG: --enable-server="true"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288511    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288515    2555 flags.go:64] FLAG: --event-burst="100"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288519    2555 flags.go:64] FLAG: --event-qps="50"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288521    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288524    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288527    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288531    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 00:06:34.294276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288534    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288537    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288540    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288542    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288545    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288548    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288551    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288554    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288556    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288559    2555 flags.go:64] FLAG: --feature-gates=""
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288563    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288566    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288569    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288572    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288575    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288578    2555 flags.go:64] FLAG: --help="false"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288581    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288584    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288586    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288589    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288592    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288596    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288599    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 00:06:34.294859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288601    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288604    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288606    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288616    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288620    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288623    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288625    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288628    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288631    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288634    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288636    2555 flags.go:64] FLAG: --lock-file=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288639    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288642    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288644    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288654    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288657    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288659    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288662    2555 flags.go:64] FLAG: --logging-format="text"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288664    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288670    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288673    2555 flags.go:64] FLAG: --manifest-url=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288675    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288680    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288683    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288687    2555 flags.go:64] FLAG: --max-pods="110"
Jul 31 00:06:34.295470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288690    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288693    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288695    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288698    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288701    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288704    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288707    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288713    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288716    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288719    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288722    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288725    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288744    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288747    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288750    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288753    2555 flags.go:64] FLAG: --port="10250"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288756    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288759    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb63dbf2efc97ac5"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288762    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288765    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288767    2555 flags.go:64] FLAG: --register-node="true"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288770    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288774    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288777    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 31 00:06:34.296081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288779    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288782    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288786    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288790    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288793    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288796    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288798    2555 flags.go:64] FLAG: --runonce="false"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288801    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288804    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288807    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288810    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288812    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288815    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288818    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288821    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288824    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288827    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288829    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288832    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288835    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288838    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288841    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288846    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288849    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288852    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 00:06:34.296671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288856    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288859    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288861    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288864    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288867    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288869    2555 flags.go:64] FLAG: --v="2"
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288873    2555 flags.go:64] FLAG: --version="false"
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288877    2555 flags.go:64] FLAG: --vmodule=""
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288882    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.288885    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.288996    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289000    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289003    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289006    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289009    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289012    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289014    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289017    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289019    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289022    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289024    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289027    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:06:34.297382 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289029    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289032    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289035    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289037    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289040    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289042    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289045    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289047    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289051    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289053    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289057    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289061    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289064    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289066    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289069    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289071    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289074    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289076    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289080    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:06:34.297953 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289083    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289087    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289089    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289092    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289094    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289096    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289099    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289101    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289104    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289106    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289109    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289111    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289114    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289116    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289119    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289121    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289123    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289126    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289128    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289131    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:06:34.298419 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289134    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289136    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289139    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289141    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289144    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289146    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289148    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289151    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289153    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289155    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289158    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289161    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289164    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289168    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289170    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289173    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289177    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289180    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289183    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289186    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:06:34.298910 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289189    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289192    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289194    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289197    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289200    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289202    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289205    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289207    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289210    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289212    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289216    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289219    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289222    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289225    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289227    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289230    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289233    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289236    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289238    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:06:34.299431 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289241    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289243    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289246    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289248    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289252    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289254    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289258    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289260    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.289263    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.290623    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.297311    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.297326    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.297346    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.297352    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297404    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:06:34.299903 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297410    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297414    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297418    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297421    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297424    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297427    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297429    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297432    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297435    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297437    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297440    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297442    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297445    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297448    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297450    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297453    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297457    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297460    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297463    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:06:34.300284 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297466    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297469    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297472    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297474    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297478    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297481    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297484    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297486    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297489    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297493    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297495    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297498    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297500    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297503    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297505    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297508    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297510    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297513    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297515    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:06:34.300749 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297517    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297520    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297522    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297525    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297527    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297529    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297532    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297534    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297537    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297539    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297542    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297544    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297546    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297549    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297552    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297554    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297557    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297559    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297561    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297564    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:06:34.301209 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297566    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297569    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297572    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297575    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297578    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297580    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297583    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297585    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297587    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297590    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297593    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297595    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297597    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297599    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297602    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297604    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297607    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297609    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297613    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297616    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:06:34.301684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297619    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297622    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297625    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297627    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297630    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297633    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297635    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297638    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297640    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297642    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297645    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297647    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297649    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297652    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297655    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297658    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297661    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297664    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297666    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:06:34.302274 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297669    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.297674    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297804    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297809    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297812    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297814    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297817    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297820    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297822    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297824    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297827    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297829    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297832    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297835    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297837    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:06:34.302773 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297840    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297842    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297845    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297847    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297850    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297852    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297855    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297857    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297860    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297862    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297864    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297867    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297870    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297873    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297876    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297879    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297882    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297884    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297887    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297889    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:06:34.303142 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297891    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297894    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297897    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297900    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297903    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297906    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297908    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297911    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297914    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297917    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297919    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297922    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297924    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297928    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297930    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297932    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297935    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297937    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297940    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:06:34.303619 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297942    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297944    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297947    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297949    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297952    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297954    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297957    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297960    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297962    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297965    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297968    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297970    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297973    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297975    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297978    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297980    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297983    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297985    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297987    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297990    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:06:34.304084 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297992    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297995    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.297997    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298000    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298002    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298004    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298007    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298010    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298014    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298016    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298019    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298021    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298024    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298026    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298030    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298033    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298036    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298039    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298042    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:06:34.304567 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298044    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298047    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298050    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298053    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298056    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298058    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298060    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:34.298063    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.298067    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.298179    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.300352    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.301954    2555 server.go:1019] "Starting client certificate rotation"
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.302050    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 00:06:34.305032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.302080    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 00:06:34.305390 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.305376    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 00:06:34.308525 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.308502    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 00:06:34.317007 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.316987    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 31 00:06:34.320698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.320682    2555 log.go:25] "Validated CRI v1 image API"
Jul 31 00:06:34.322630 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.322605    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 00:06:34.325172 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.325155    2555 fs.go:135] Filesystem UUIDs: map[407d21ee-c0af-4d47-85b2-165b0ba0566a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b7966890-8ec0-4cc4-a5c6-e557889bd3fd:/dev/nvme0n1p4]
Jul 31 00:06:34.325231 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.325172    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 00:06:34.330785 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.330648    2555 manager.go:216] Machine: {Timestamp:2026-07-31 00:06:34.32893511 +0000 UTC m=+0.380924667 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100135 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e314da264752c777b465bcdcd3964 SystemUUID:ec2e314d-a264-752c-777b-465bcdcd3964 BootID:d0a10692-6d90-45f2-87a9-c8ef618a24de Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:05:94:93:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:05:94:93:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:5e:60:68:fa:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 00:06:34.330785 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.330783    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 00:06:34.330889 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.330861    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 00:06:34.331931 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.331916    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 00:06:34.334448 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.334425    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 00:06:34.334577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.334452    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 00:06:34.335808 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.335798    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 00:06:34.335849 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.335811    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 00:06:34.335849 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.335819    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 00:06:34.335849 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.335829    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 00:06:34.336692 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.336682    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 00:06:34.340911 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.340899    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 00:06:34.341030 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341021    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 00:06:34.341059 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341049    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 00:06:34.341095 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341061    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 00:06:34.341095 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341075    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 00:06:34.341095 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341087    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 31 00:06:34.341176 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341098    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 00:06:34.341452 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341441    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 00:06:34.341498 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.341459    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 00:06:34.343879 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.343852    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 00:06:34.345216 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.345203    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 00:06:34.345270 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.345233    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 00:06:34.347126 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347112    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347131    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347137    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347142    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347151    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347157    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347164    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347169    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 00:06:34.347181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347183    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 00:06:34.347415 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347189    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 00:06:34.347415 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347197    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 00:06:34.347415 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347202    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 00:06:34.347975 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347966    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 00:06:34.348014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.347975    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 00:06:34.349374 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.349353    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vfftr"
Jul 31 00:06:34.351118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.351107    2555 server.go:1268] "Started kubelet"
Jul 31 00:06:34.351288 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.351235    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 00:06:34.351359 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.351330    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 00:06:34.351517 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.351480    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 00:06:34.351687 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.351664    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 00:06:34.351763 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.351726    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 00:06:34.352033 ip-10-0-129-35 systemd[1]: Started Kubernetes Kubelet.
Jul 31 00:06:34.353717 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.351791    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 00:06:34.355544 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.355479    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 00:06:34.356540 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.356519    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 00:06:34.356654 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.356504    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 00:06:34.356968 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.356947    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vfftr"
Jul 31 00:06:34.359758 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.358831    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-35.ec2.internal.18c73721833ec947  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-35.ec2.internal,UID:ip-10-0-129-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-35.ec2.internal,},FirstTimestamp:2026-07-31 00:06:34.351069511 +0000 UTC m=+0.403059067,LastTimestamp:2026-07-31 00:06:34.351069511 +0000 UTC m=+0.403059067,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-35.ec2.internal,}"
Jul 31 00:06:34.362025 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362011    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 00:06:34.362104 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362026    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 00:06:34.362104 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.362076    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.362952 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362930    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 00:06:34.362952 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362933    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 00:06:34.362952 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362943    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 00:06:34.363145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362969    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 00:06:34.363145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.362948    2555 factory.go:55] Registering systemd factory
Jul 31 00:06:34.363145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363032    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 31 00:06:34.363145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363112    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 00:06:34.363145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363121    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 00:06:34.363340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363270    2555 factory.go:153] Registering CRI-O factory
Jul 31 00:06:34.363340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363283    2555 factory.go:223] Registration of the crio container factory successfully
Jul 31 00:06:34.363340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363304    2555 factory.go:103] Registering Raw factory
Jul 31 00:06:34.363340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363319    2555 manager.go:1196] Started watching for new ooms in manager
Jul 31 00:06:34.363872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.363854    2555 manager.go:349] Starting recovery of all containers
Jul 31 00:06:34.372424 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.372404    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:34.373961 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.373943    2555 manager.go:354] Recovery completed
Jul 31 00:06:34.375445 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.375423    2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-35.ec2.internal\" not found" node="ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.378270 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.378259    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.379991 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.379973    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.380062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.380006    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.380062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.380019    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.380505 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.380491    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 00:06:34.380568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.380505    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 00:06:34.380568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.380524    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 00:06:34.380568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.380495    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.381692 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.381677    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.381850 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.381706    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.381850 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.381720    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.381964 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.381886    2555 policy_none.go:49] "None policy: Start"
Jul 31 00:06:34.381964 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.381898    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 00:06:34.381964 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.381908    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 00:06:34.383568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.383557    2555 policy_none.go:47] "Start"
Jul 31 00:06:34.418387 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418243    2555 manager.go:337] "Starting Device Plugin manager"
Jul 31 00:06:34.418465 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.418402    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 00:06:34.418465 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418413    2555 server.go:87] "Starting device plugin registration server"
Jul 31 00:06:34.418608 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418597    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 00:06:34.418642 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418609    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 00:06:34.418725 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418706    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 00:06:34.418815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418801    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 00:06:34.418815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.418815    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 00:06:34.419313 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.419298    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 00:06:34.419384 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.419340    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.519310 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.519278    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.521004 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.520444    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.521004 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.520475    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.521004 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.520486    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.521004 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.520519    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.527831 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.527806    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.527831 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.527830    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-35.ec2.internal\": node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.531141 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.531088    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 00:06:34.532467 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.532453    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 00:06:34.532544 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.532487    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 00:06:34.532544 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.532505    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 00:06:34.532544 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.532535    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 00:06:34.534684 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.534668    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:34.540757 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.540719    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.633736 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.633699    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"]
Jul 31 00:06:34.633837 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.633799    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.635803 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.635783    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.635918 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.635814    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.635918 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.635825    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.637451 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.637438    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.637616 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.637601    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.637676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.637639    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.638698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.638681    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.638789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.638711    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.638789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.638721    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.638789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.638681    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.638789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.638766    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.638789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.638778    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.640210 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.640193    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.640280 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.640224    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:06:34.640788 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.640774    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.641058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.641044    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:06:34.641113 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.641071    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:06:34.641113 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.641082    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:06:34.666004 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.665980    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47a62544d32d54f5dc69003031bf1331-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"47a62544d32d54f5dc69003031bf1331\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.666090 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.666015    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47a62544d32d54f5dc69003031bf1331-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"47a62544d32d54f5dc69003031bf1331\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.666090 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.666050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2ac76fcfd2a1053c05256ae49c3a18b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-35.ec2.internal\" (UID: \"a2ac76fcfd2a1053c05256ae49c3a18b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.667363 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.667348    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-35.ec2.internal\" not found" node="ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.671563 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.671549    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-35.ec2.internal\" not found" node="ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.741270 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.741238    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.766637 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.766619    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47a62544d32d54f5dc69003031bf1331-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"47a62544d32d54f5dc69003031bf1331\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.766698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.766640    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47a62544d32d54f5dc69003031bf1331-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"47a62544d32d54f5dc69003031bf1331\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.766698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.766657    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2ac76fcfd2a1053c05256ae49c3a18b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-35.ec2.internal\" (UID: \"a2ac76fcfd2a1053c05256ae49c3a18b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.766698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.766695    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2ac76fcfd2a1053c05256ae49c3a18b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-35.ec2.internal\" (UID: \"a2ac76fcfd2a1053c05256ae49c3a18b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.766834 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.766718    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47a62544d32d54f5dc69003031bf1331-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"47a62544d32d54f5dc69003031bf1331\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.766834 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.766726    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47a62544d32d54f5dc69003031bf1331-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"47a62544d32d54f5dc69003031bf1331\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.841998 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.841928    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.942413 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:34.942381    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:34.969917 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.969899    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:34.975402 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:34.975269    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:35.042794 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:35.042761    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:35.143326 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:35.143270    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:36.571840 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:36.571820    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:36.629466 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.629447    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 00:06:36.629846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.629592    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 00:06:36.629846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.629592    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 00:06:36.672873 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:36.672850    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:36.688605 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.688572    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 00:01:35 +0000 UTC" deadline="2028-03-19 07:49:58.053946795 +0000 UTC"
Jul 31 00:06:36.688605 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.688597    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14335h43m21.36535295s"
Jul 31 00:06:36.773885 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:36.773865    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:36.874487 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:36.874462    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:36.886491 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:36.886463    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ac76fcfd2a1053c05256ae49c3a18b.slice/crio-e817c6250135928f200f66b4e84d8e9b8f89074b43eb8a007c79dbab03a53130 WatchSource:0}: Error finding container e817c6250135928f200f66b4e84d8e9b8f89074b43eb8a007c79dbab03a53130: Status 404 returned error can't find the container with id e817c6250135928f200f66b4e84d8e9b8f89074b43eb8a007c79dbab03a53130
Jul 31 00:06:36.886986 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:36.886968    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a62544d32d54f5dc69003031bf1331.slice/crio-af63f218b0332c9b0c7a1cfad89de9a0fc855bb52e56efc0a211ae5bf25c0bac WatchSource:0}: Error finding container af63f218b0332c9b0c7a1cfad89de9a0fc855bb52e56efc0a211ae5bf25c0bac: Status 404 returned error can't find the container with id af63f218b0332c9b0c7a1cfad89de9a0fc855bb52e56efc0a211ae5bf25c0bac
Jul 31 00:06:36.891774 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.891746    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:06:36.905428 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:36.905403    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:36.974686 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:36.974668    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found"
Jul 31 00:06:37.052853 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.052790    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:37.090447 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.090426    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:37.099373 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.099356    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 00:06:37.100239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.100227    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"
Jul 31 00:06:37.108599 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.108584    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 00:06:37.643304 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.643276    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:37.670726 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.670700    2555 apiserver.go:52] "Watching apiserver"
Jul 31 00:06:37.677653 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.677619    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 00:06:37.678327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.678305    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-v56gk","kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x55fh","openshift-image-registry/node-ca-b2nmw","openshift-multus/multus-additional-cni-plugins-djrwl","openshift-multus/network-metrics-daemon-7fcf6","openshift-network-diagnostics/network-check-target-q8l2k","openshift-network-operator/iptables-alerter-jfh58","openshift-ovn-kubernetes/ovnkube-node-lxkt9","kube-system/global-pull-secret-syncer-xkr25","kube-system/konnectivity-agent-b7ctz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp","openshift-dns/node-resolver-hcfgz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal"]
Jul 31 00:06:37.680900 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.680874    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:37.681006 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.680947    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:37.683010 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.682978    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.685120 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.685098    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nxwms\""
Jul 31 00:06:37.686579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.685591    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.686579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.685689    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.686579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.685968    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.687853 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.687834    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.688092 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.688067    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.688406 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.688387    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.689069 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.689051    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jnpvm\""
Jul 31 00:06:37.690061 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.690042    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.690272 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.690257    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 00:06:37.690406 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.690391    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 00:06:37.692564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.690868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.692639 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.692604    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26w5c\""
Jul 31 00:06:37.692639 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.692608    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.692748 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.692737    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:37.692840 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.692817    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:37.692893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.692872    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r7hsc\""
Jul 31 00:06:37.692980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.692964    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.693018 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.692975    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 00:06:37.693082 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.693068    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.693122 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.693079    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 00:06:37.693224 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.693206    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 00:06:37.695360 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.695311    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.697494 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.697475    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 00:06:37.698158 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.697842    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.698158 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.697979    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 00:06:37.698504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.698487    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.698597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.698491    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 00:06:37.698597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.698592    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 00:06:37.698707 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.698621    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lmrn9\""
Jul 31 00:06:37.698707 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.698497    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.700445 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.700429    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 00:06:37.700666 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.700650    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wxx7z\""
Jul 31 00:06:37.701251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.701221    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.704433 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704415    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.704523 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.704471    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:37.704707 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704689    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.704798 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.704798 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704744    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysctl-conf\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.704798 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704794    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-var-lib-kubelet\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.704958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704819    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xvq\" (UniqueName: \"kubernetes.io/projected/74844aa7-2483-499e-b047-91989c57445a-kube-api-access-h6xvq\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.704958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704842    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-lib-modules\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.704958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704864    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-system-cni-dir\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.704958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704893    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-os-release\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.704958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74844aa7-2483-499e-b047-91989c57445a-tmp-dir\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.704958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704940    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-modprobe-d\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704963    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c97156-0172-40ba-804f-3c1589e7ad30-tmp\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.704987    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysconfig\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-sys\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705045    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c97156-0172-40ba-804f-3c1589e7ad30-etc-tuned\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705071    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3061a80-e687-4256-af18-173c5ff6b279-host\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705093    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3061a80-e687-4256-af18-173c5ff6b279-serviceca\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705125    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tjsh\" (UniqueName: \"kubernetes.io/projected/c3061a80-e687-4256-af18-173c5ff6b279-kube-api-access-9tjsh\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwkzr\" (UniqueName: \"kubernetes.io/projected/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-kube-api-access-vwkzr\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705182    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtj6g\" (UniqueName: \"kubernetes.io/projected/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-kube-api-access-mtj6g\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:37.705239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705215    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705238    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74844aa7-2483-499e-b047-91989c57445a-hosts-file\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705265    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cni-binary-copy\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705289    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysctl-d\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705334    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-run\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744lc\" (UniqueName: \"kubernetes.io/projected/84c97156-0172-40ba-804f-3c1589e7ad30-kube-api-access-744lc\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cnibin\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705421    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705447    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-systemd\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705470    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-host\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.705698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705494    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-kubernetes\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.706193 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.705909    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.707453 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.707433    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.707689 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.707673    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.708292 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.708263    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.708387 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.708330    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 00:06:37.708658 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.708641    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5znz2\""
Jul 31 00:06:37.708735 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.708718    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 00:06:37.708807 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.708793    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 00:06:37.708880 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.708864    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c2k8w\""
Jul 31 00:06:37.710055 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.710012    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 00:06:37.711022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.710208    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 00:06:37.711022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.710215    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jffn5\""
Jul 31 00:06:37.711022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.710868    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 00:06:37.717339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.714220    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 00:06:37.727877 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.727857    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjmhw"
Jul 31 00:06:37.734562 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.734543    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjmhw"
Jul 31 00:06:37.792510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.792483    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 00:06:37.806118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806083    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3061a80-e687-4256-af18-173c5ff6b279-serviceca\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.806246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806124    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:37.806246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74844aa7-2483-499e-b047-91989c57445a-hosts-file\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.806246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806178    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysctl-d\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.806246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806198    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.806246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806213    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlnp5\" (UniqueName: \"kubernetes.io/projected/d0bb52be-8795-4935-801f-0942ae7919e0-kube-api-access-qlnp5\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.806246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806230    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/557d5b10-3009-41e3-b5b2-a35f73920670-iptables-alerter-script\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd10469a-d51d-4155-991e-f157be459a76-agent-certs\") pod \"konnectivity-agent-b7ctz\" (UID: \"fd10469a-d51d-4155-991e-f157be459a76\") " pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806291    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-systemd-units\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-netns\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806333    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-hostroot\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-host\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806361    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58kvg\" (UniqueName: \"kubernetes.io/projected/557d5b10-3009-41e3-b5b2-a35f73920670-kube-api-access-58kvg\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806375    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-var-lib-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl92x\" (UniqueName: \"kubernetes.io/projected/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-kube-api-access-nl92x\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806409    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-cni-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806460    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806485    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-var-lib-kubelet\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzsj\" (UniqueName: \"kubernetes.io/projected/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-kube-api-access-gwzsj\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.806504 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806503    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74844aa7-2483-499e-b047-91989c57445a-hosts-file\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806515    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvq\" (UniqueName: \"kubernetes.io/projected/74844aa7-2483-499e-b047-91989c57445a-kube-api-access-h6xvq\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806532    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-kubelet\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806549    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-socket-dir-parent\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806581    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-daemon-config\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3061a80-e687-4256-af18-173c5ff6b279-serviceca\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806636    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysctl-d\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806609    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74844aa7-2483-499e-b047-91989c57445a-tmp-dir\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-host\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806689    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd10469a-d51d-4155-991e-f157be459a76-konnectivity-ca\") pod \"konnectivity-agent-b7ctz\" (UID: \"fd10469a-d51d-4155-991e-f157be459a76\") " pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.806967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74844aa7-2483-499e-b047-91989c57445a-tmp-dir\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807121    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807195    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-var-lib-kubelet\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.807222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807219    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807226    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-device-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807332    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-kubelet\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807361    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysconfig\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807397    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c97156-0172-40ba-804f-3c1589e7ad30-etc-tuned\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807410    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysconfig\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807440    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-kubelet-config\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807512    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-dbus\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807548    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-run-netns\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807567    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-log-socket\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807607    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-cni-binary-copy\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807637    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3061a80-e687-4256-af18-173c5ff6b279-host\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjsh\" (UniqueName: \"kubernetes.io/projected/c3061a80-e687-4256-af18-173c5ff6b279-kube-api-access-9tjsh\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807657    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807690    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwkzr\" (UniqueName: \"kubernetes.io/projected/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-kube-api-access-vwkzr\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.807869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807694    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3061a80-e687-4256-af18-173c5ff6b279-host\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807715    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtj6g\" (UniqueName: \"kubernetes.io/projected/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-kube-api-access-mtj6g\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807737    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744lc\" (UniqueName: \"kubernetes.io/projected/84c97156-0172-40ba-804f-3c1589e7ad30-kube-api-access-744lc\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/557d5b10-3009-41e3-b5b2-a35f73920670-host-slash\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807807    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-socket-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807828    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovnkube-config\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cni-binary-copy\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807877    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807898    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-run\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807923    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-ovn\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807943    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-env-overrides\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807967    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovn-node-metrics-cert\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.807988    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-system-cni-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808031    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-os-release\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808056    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cnibin\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808080    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808114    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-systemd\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.808516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808170    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-systemd\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808207    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cnibin\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.808218    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808235    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-node-log\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808257    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-etc-kubernetes\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.808299    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:06:38.308256816 +0000 UTC m=+3.032222784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808323    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-run\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808355    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-kubernetes\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-slash\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808410    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-systemd\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808441    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-cni-netd\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-cni-bin\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808696    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-cni-multus\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-conf-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808512    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-kubernetes\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.809454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808801    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysctl-conf\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808843    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-registration-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808869    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-sys-fs\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808889    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-sysctl-conf\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808893    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-cnibin\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808556    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-cni-binary-copy\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-multus-certs\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808946    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-lib-modules\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808970    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovnkube-script-lib\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.808995    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-system-cni-dir\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809021    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-os-release\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809055    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-modprobe-d\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809070    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-lib-modules\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809076    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c97156-0172-40ba-804f-3c1589e7ad30-tmp\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809101    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809125    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-cni-bin\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809153    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-k8s-cni-cncf-io\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.810251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-etc-modprobe-d\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809177    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-etc-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809195    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-os-release\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809200    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-sys\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-system-cni-dir\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.809342    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c97156-0172-40ba-804f-3c1589e7ad30-sys\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.810984    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.811001    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:37.811032 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.811010    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:37.811400 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.811062    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:06:38.311046145 +0000 UTC m=+3.035012124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:37.811617 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.811575    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c97156-0172-40ba-804f-3c1589e7ad30-tmp\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.811684 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.811635    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c97156-0172-40ba-804f-3c1589e7ad30-etc-tuned\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.813945 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.813928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xvq\" (UniqueName: \"kubernetes.io/projected/74844aa7-2483-499e-b047-91989c57445a-kube-api-access-h6xvq\") pod \"node-resolver-hcfgz\" (UID: \"74844aa7-2483-499e-b047-91989c57445a\") " pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:37.814921 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.814901    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtj6g\" (UniqueName: \"kubernetes.io/projected/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-kube-api-access-mtj6g\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:37.824020 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.823998    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjsh\" (UniqueName: \"kubernetes.io/projected/c3061a80-e687-4256-af18-173c5ff6b279-kube-api-access-9tjsh\") pod \"node-ca-b2nmw\" (UID: \"c3061a80-e687-4256-af18-173c5ff6b279\") " pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:37.825462 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.825442    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-744lc\" (UniqueName: \"kubernetes.io/projected/84c97156-0172-40ba-804f-3c1589e7ad30-kube-api-access-744lc\") pod \"tuned-x55fh\" (UID: \"84c97156-0172-40ba-804f-3c1589e7ad30\") " pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:37.826121 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.826105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwkzr\" (UniqueName: \"kubernetes.io/projected/8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c-kube-api-access-vwkzr\") pod \"multus-additional-cni-plugins-djrwl\" (UID: \"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c\") " pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:37.867580 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.867532    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" event={"ID":"a2ac76fcfd2a1053c05256ae49c3a18b","Type":"ContainerStarted","Data":"e817c6250135928f200f66b4e84d8e9b8f89074b43eb8a007c79dbab03a53130"}
Jul 31 00:06:37.868767 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.868725    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" event={"ID":"47a62544d32d54f5dc69003031bf1331","Type":"ContainerStarted","Data":"af63f218b0332c9b0c7a1cfad89de9a0fc855bb52e56efc0a211ae5bf25c0bac"}
Jul 31 00:06:37.910386 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910310    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58kvg\" (UniqueName: \"kubernetes.io/projected/557d5b10-3009-41e3-b5b2-a35f73920670-kube-api-access-58kvg\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.910386 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910351    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-var-lib-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.910386 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910375    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl92x\" (UniqueName: \"kubernetes.io/projected/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-kube-api-access-nl92x\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910401    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-cni-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzsj\" (UniqueName: \"kubernetes.io/projected/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-kube-api-access-gwzsj\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910451    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-kubelet\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-socket-dir-parent\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910489    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-daemon-config\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910515    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd10469a-d51d-4155-991e-f157be459a76-konnectivity-ca\") pod \"konnectivity-agent-b7ctz\" (UID: \"fd10469a-d51d-4155-991e-f157be459a76\") " pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910536    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-device-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-kubelet\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-kubelet-config\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910623    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-dbus\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.910633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-run-netns\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-log-socket\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910685    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-socket-dir-parent\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910687    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-cni-binary-copy\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910769    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-var-lib-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910954    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/557d5b10-3009-41e3-b5b2-a35f73920670-host-slash\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910980    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-socket-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.910997    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovnkube-config\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-ovn\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911041    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-env-overrides\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovn-node-metrics-cert\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911091    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-system-cni-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911109    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-os-release\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-node-log\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911169    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-etc-kubernetes\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911186    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-slash\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911199    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-systemd\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.911245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911215    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-cni-netd\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911232    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911248    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-cni-bin\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911256    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-daemon-config\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-cni-multus\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911300    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/557d5b10-3009-41e3-b5b2-a35f73920670-host-slash\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911327    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-conf-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911356    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-registration-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-sys-fs\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911408    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-cnibin\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911418    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-cni-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911432    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-multus-certs\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911456    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovnkube-script-lib\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911571    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-socket-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911610    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-kubelet\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.911655    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-dbus\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.912099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912057    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovnkube-config\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912110    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-ovn\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912433    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-env-overrides\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912713    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd10469a-d51d-4155-991e-f157be459a76-konnectivity-ca\") pod \"konnectivity-agent-b7ctz\" (UID: \"fd10469a-d51d-4155-991e-f157be459a76\") " pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912715    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-kubelet-config\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912778    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912778    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-log-socket\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912818    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-device-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912828    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-run-netns\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912843    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-multus-certs\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912843    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-registration-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.912890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912879    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-cni-netd\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912908    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-cnibin\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.912942    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912954    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.912979    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-cni-bin\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:37.913003    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:38.412986142 +0000 UTC m=+3.136952300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913010    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-cni-bin\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913033    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-k8s-cni-cncf-io\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913057    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-etc-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913139    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-k8s-cni-cncf-io\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913171    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-etc-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913209    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913211    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-etc-kubernetes\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913238    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-kubelet\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913268    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-cni-binary-copy\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913280    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovnkube-script-lib\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913270    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlnp5\" (UniqueName: \"kubernetes.io/projected/d0bb52be-8795-4935-801f-0942ae7919e0-kube-api-access-qlnp5\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913318    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913329    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-cni-bin\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913339    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/557d5b10-3009-41e3-b5b2-a35f73920670-iptables-alerter-script\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913370    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd10469a-d51d-4155-991e-f157be459a76-agent-certs\") pod \"konnectivity-agent-b7ctz\" (UID: \"fd10469a-d51d-4155-991e-f157be459a76\") " pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913376    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bb52be-8795-4935-801f-0942ae7919e0-sys-fs\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913374    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913396    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-systemd-units\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913414    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-host-slash\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913422    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-os-release\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.913501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913446    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-netns\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913455    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-systemd-units\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913458    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-openvswitch\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913471    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-hostroot\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-multus-conf-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913518    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-system-cni-dir\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913525    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-var-lib-cni-multus\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913542    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-hostroot\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913587    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-host-run-netns\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913640    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-run-systemd\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913666    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-node-log\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.914170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.913894    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/557d5b10-3009-41e3-b5b2-a35f73920670-iptables-alerter-script\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.914972 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.914952    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-ovn-node-metrics-cert\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.915906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.915885    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd10469a-d51d-4155-991e-f157be459a76-agent-certs\") pod \"konnectivity-agent-b7ctz\" (UID: \"fd10469a-d51d-4155-991e-f157be459a76\") " pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:37.918332 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.918311    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl92x\" (UniqueName: \"kubernetes.io/projected/fc01b05a-fe73-42e3-8fb6-4188fe7254a0-kube-api-access-nl92x\") pod \"multus-v56gk\" (UID: \"fc01b05a-fe73-42e3-8fb6-4188fe7254a0\") " pod="openshift-multus/multus-v56gk"
Jul 31 00:06:37.918444 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.918429    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzsj\" (UniqueName: \"kubernetes.io/projected/ef95ab9e-8f6e-4a51-84d3-a48a3168d012-kube-api-access-gwzsj\") pod \"ovnkube-node-lxkt9\" (UID: \"ef95ab9e-8f6e-4a51-84d3-a48a3168d012\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:37.918557 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.918533    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58kvg\" (UniqueName: \"kubernetes.io/projected/557d5b10-3009-41e3-b5b2-a35f73920670-kube-api-access-58kvg\") pod \"iptables-alerter-jfh58\" (UID: \"557d5b10-3009-41e3-b5b2-a35f73920670\") " pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:37.920491 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.920473    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlnp5\" (UniqueName: \"kubernetes.io/projected/d0bb52be-8795-4935-801f-0942ae7919e0-kube-api-access-qlnp5\") pod \"aws-ebs-csi-driver-node-nwldp\" (UID: \"d0bb52be-8795-4935-801f-0942ae7919e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:37.995604 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:37.995574    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hcfgz"
Jul 31 00:06:38.003673 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.003651    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x55fh"
Jul 31 00:06:38.015394 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.015368    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2nmw"
Jul 31 00:06:38.019080 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.019063    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-djrwl"
Jul 31 00:06:38.026949 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.026929    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:06:38.034553 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.034525    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v56gk"
Jul 31 00:06:38.050141 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.050118    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jfh58"
Jul 31 00:06:38.056662 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.056646    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:06:38.062280 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.062257    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp"
Jul 31 00:06:38.121851 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.121826    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:38.316521 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.316435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:38.316521 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.316497    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:38.316718 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.316610    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:38.316718 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.316647    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:38.316718 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.316664    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:38.316718 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.316678    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:38.316718 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.316683    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:06:39.316666857 +0000 UTC m=+4.040632801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:38.316940 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.316726    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:06:39.316710496 +0000 UTC m=+4.040676443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:38.417040 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.417012    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:38.417186 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.417154    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:38.417227 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:38.417214    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:39.417198478 +0000 UTC m=+4.141164424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:38.737778 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.737700    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 00:01:37 +0000 UTC" deadline="2028-04-24 08:17:52.848821968 +0000 UTC"
Jul 31 00:06:38.737778 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.737727    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15200h11m14.111098003s"
Jul 31 00:06:38.798579 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:38.798554    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3061a80_e687_4256_af18_173c5ff6b279.slice/crio-51bab34e12563e3975b82cbb0b04f8340c3144fdb463c51e7ad09e936d5951d0 WatchSource:0}: Error finding container 51bab34e12563e3975b82cbb0b04f8340c3144fdb463c51e7ad09e936d5951d0: Status 404 returned error can't find the container with id 51bab34e12563e3975b82cbb0b04f8340c3144fdb463c51e7ad09e936d5951d0
Jul 31 00:06:38.800489 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:38.800454    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557d5b10_3009_41e3_b5b2_a35f73920670.slice/crio-ec8675deb72afc6ee469fba56c1bc265927456ade73498d8e09d51aa57372757 WatchSource:0}: Error finding container ec8675deb72afc6ee469fba56c1bc265927456ade73498d8e09d51aa57372757: Status 404 returned error can't find the container with id ec8675deb72afc6ee469fba56c1bc265927456ade73498d8e09d51aa57372757
Jul 31 00:06:38.804147 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:38.804129    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae8f7db_80fe_4f85_b1b3_3eec86c8a36c.slice/crio-bdd118f6bce16a8bf844fc4d8b63b68774a999e2a3fc8a1cecce87ddcb4d3362 WatchSource:0}: Error finding container bdd118f6bce16a8bf844fc4d8b63b68774a999e2a3fc8a1cecce87ddcb4d3362: Status 404 returned error can't find the container with id bdd118f6bce16a8bf844fc4d8b63b68774a999e2a3fc8a1cecce87ddcb4d3362
Jul 31 00:06:38.805434 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:38.805417    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc01b05a_fe73_42e3_8fb6_4188fe7254a0.slice/crio-2e6171ab86796ed518f3fb7031833376229fb0aaf5315079fe45b8603e44f603 WatchSource:0}: Error finding container 2e6171ab86796ed518f3fb7031833376229fb0aaf5315079fe45b8603e44f603: Status 404 returned error can't find the container with id 2e6171ab86796ed518f3fb7031833376229fb0aaf5315079fe45b8603e44f603
Jul 31 00:06:38.806986 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:38.806963    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bb52be_8795_4935_801f_0942ae7919e0.slice/crio-9ea4094c7b686754774c5adcb3ae8d2cb9666bc04e6c7ef2189dd95bcf3e7d53 WatchSource:0}: Error finding container 9ea4094c7b686754774c5adcb3ae8d2cb9666bc04e6c7ef2189dd95bcf3e7d53: Status 404 returned error can't find the container with id 9ea4094c7b686754774c5adcb3ae8d2cb9666bc04e6c7ef2189dd95bcf3e7d53
Jul 31 00:06:38.811900 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:06:38.811878    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef95ab9e_8f6e_4a51_84d3_a48a3168d012.slice/crio-2e7d780be0cf4fd56b653fef7e0574987a9cc0f23937d2184da4b1c12d8dc829 WatchSource:0}: Error finding container 2e7d780be0cf4fd56b653fef7e0574987a9cc0f23937d2184da4b1c12d8dc829: Status 404 returned error can't find the container with id 2e7d780be0cf4fd56b653fef7e0574987a9cc0f23937d2184da4b1c12d8dc829
Jul 31 00:06:38.873953 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.873925    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"2e7d780be0cf4fd56b653fef7e0574987a9cc0f23937d2184da4b1c12d8dc829"}
Jul 31 00:06:38.875915 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.875793    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v56gk" event={"ID":"fc01b05a-fe73-42e3-8fb6-4188fe7254a0","Type":"ContainerStarted","Data":"2e6171ab86796ed518f3fb7031833376229fb0aaf5315079fe45b8603e44f603"}
Jul 31 00:06:38.876861 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.876833    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hcfgz" event={"ID":"74844aa7-2483-499e-b047-91989c57445a","Type":"ContainerStarted","Data":"c23c800d72ab9bd80ba73a81999a40d1248fecd7f2076bb558525b51cca51e35"}
Jul 31 00:06:38.878122 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.878095    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp" event={"ID":"d0bb52be-8795-4935-801f-0942ae7919e0","Type":"ContainerStarted","Data":"9ea4094c7b686754774c5adcb3ae8d2cb9666bc04e6c7ef2189dd95bcf3e7d53"}
Jul 31 00:06:38.879548 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.879523    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x55fh" event={"ID":"84c97156-0172-40ba-804f-3c1589e7ad30","Type":"ContainerStarted","Data":"9f03e4f2666473b6b04d84181ace4b5d5fb5f4a7f55b4f6151cef58670f55315"}
Jul 31 00:06:38.880998 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.880974    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jfh58" event={"ID":"557d5b10-3009-41e3-b5b2-a35f73920670","Type":"ContainerStarted","Data":"ec8675deb72afc6ee469fba56c1bc265927456ade73498d8e09d51aa57372757"}
Jul 31 00:06:38.882054 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.882034    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b7ctz" event={"ID":"fd10469a-d51d-4155-991e-f157be459a76","Type":"ContainerStarted","Data":"8dccbf61ba53ced9a1d9929c1e323b9ce07a476573ef27a3e8cd1314cb37cb5d"}
Jul 31 00:06:38.883257 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.883235    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerStarted","Data":"bdd118f6bce16a8bf844fc4d8b63b68774a999e2a3fc8a1cecce87ddcb4d3362"}
Jul 31 00:06:38.885085 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:38.885066    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2nmw" event={"ID":"c3061a80-e687-4256-af18-173c5ff6b279","Type":"ContainerStarted","Data":"51bab34e12563e3975b82cbb0b04f8340c3144fdb463c51e7ad09e936d5951d0"}
Jul 31 00:06:39.323098 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.323004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:39.323098 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.323062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:39.323288 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.323203    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:39.323288 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.323225    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:39.323288 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.323238    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:39.323438 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.323293    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:06:41.32327487 +0000 UTC m=+6.047240821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:39.323696 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.323676    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:39.323804 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.323731    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:06:41.323715745 +0000 UTC m=+6.047681693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:39.423516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.423484    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:39.423687 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.423658    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:39.423768 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.423721    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:41.423701811 +0000 UTC m=+6.147667762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:39.738379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.738219    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 00:01:37 +0000 UTC" deadline="2028-03-14 17:13:18.550355413 +0000 UTC"
Jul 31 00:06:39.738379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.738279    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14225h6m38.812080775s"
Jul 31 00:06:39.861919 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.861893    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:39.862118 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.862029    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:39.862118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.861893    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:39.862118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.862080    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:39.862280 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.862129    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:39.862280 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:39.862197    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:39.895479 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.895443    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" event={"ID":"a2ac76fcfd2a1053c05256ae49c3a18b","Type":"ContainerStarted","Data":"7b4965ef48c3c99038730fc8993bf144dd6e14f675450d40de8e444d9a200795"}
Jul 31 00:06:39.901404 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.901362    2555 generic.go:356] "Generic (PLEG): container finished" podID="47a62544d32d54f5dc69003031bf1331" containerID="9b3c24650ac1af43c82545f8a67996bb91a8a27d8edf0b0f2d821d268abdc101" exitCode=0
Jul 31 00:06:39.901547 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.901413    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" event={"ID":"47a62544d32d54f5dc69003031bf1331","Type":"ContainerDied","Data":"9b3c24650ac1af43c82545f8a67996bb91a8a27d8edf0b0f2d821d268abdc101"}
Jul 31 00:06:39.919592 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:39.919323    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" podStartSLOduration=2.919303133 podStartE2EDuration="2.919303133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:39.908076213 +0000 UTC m=+4.632042201" watchObservedRunningTime="2026-07-31 00:06:39.919303133 +0000 UTC m=+4.643269091"
Jul 31 00:06:40.942952 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:40.942914    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" event={"ID":"47a62544d32d54f5dc69003031bf1331","Type":"ContainerStarted","Data":"1a73ff56435290190c8878768d60bef03f87620bc6730b89bace49020b64039a"}
Jul 31 00:06:40.956638 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:40.956579    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" podStartSLOduration=3.956556607 podStartE2EDuration="3.956556607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:40.95571706 +0000 UTC m=+5.679683057" watchObservedRunningTime="2026-07-31 00:06:40.956556607 +0000 UTC m=+5.680522575"
Jul 31 00:06:41.341239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:41.341157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:41.341239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:41.341225    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:41.341459 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.341395    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:41.341459 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.341415    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:41.341459 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.341427    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:41.341608 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.341484    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:06:45.341466152 +0000 UTC m=+10.065432102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:41.341941 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.341914    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:41.342031 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.341971    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:06:45.341955641 +0000 UTC m=+10.065921591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:41.441889 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:41.441834    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:41.442055 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.441998    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:41.442115 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.442065    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:45.442047479 +0000 UTC m=+10.166013428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:41.862499 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:41.862471    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:41.862651 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.862614    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:41.863049 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:41.863026    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:41.863150 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.863128    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:41.863368 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:41.863353    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:41.863467 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:41.863448    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:43.862255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:43.861684    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:43.862255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:43.861830    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:43.862255 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:43.861836    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:43.862255 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:43.861945    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:43.862255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:43.862005    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:43.862255 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:43.862080    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:45.371888 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:45.371853    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:45.371905    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.372021    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.372040    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.372055    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.372067    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.372094    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:06:53.37207425 +0000 UTC m=+18.096040210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:45.372342 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.372113    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:06:53.372101085 +0000 UTC m=+18.096067043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:45.472453 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:45.472403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:45.472634 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.472556    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:45.472634 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.472615    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:53.472596626 +0000 UTC m=+18.196562573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:45.862456 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:45.862425    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:45.862597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:45.862524    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:45.862597 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.862541    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:45.862597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:45.862593    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:45.862697 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.862658    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:45.862747 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:45.862690    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:47.861768 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:47.861263    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:47.861768 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:47.861306    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:47.861768 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:47.861264    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:47.861768 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:47.861398    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:47.861768 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:47.861478    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:47.861768 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:47.861541    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:49.860831 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:49.860798    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:49.861276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:49.860812    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:49.861276 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:49.860922    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:49.861276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:49.860812    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:49.861276 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:49.860997    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:49.861276 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:49.861053    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:51.861416 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:51.861384    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:51.861953 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:51.861426    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:51.861953 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:51.861384    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:51.861953 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:51.861527    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:51.861953 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:51.861625    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:51.861953 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:51.861723    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:53.436271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:53.436238    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:53.436302    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.436417    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.436425    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.436443    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.436452    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.436475    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:07:09.436459868 +0000 UTC m=+34.160425817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:53.436699 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.436491    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:07:09.436480753 +0000 UTC m=+34.160446698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:53.536846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:53.536808    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:53.537021 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.536956    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:53.537078 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.537040    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:09.537011242 +0000 UTC m=+34.260977189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:53.861359 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:53.861287    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:53.861359 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:53.861321    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:53.861554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:53.861294    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:53.861554 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.861417    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:53.861554 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.861465    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:53.861714 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:53.861575    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:55.862119 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:55.862072    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:55.862625 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:55.862188    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:55.862625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:55.862202    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:55.862625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:55.862241    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:55.862625 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:55.862334    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:55.862625 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:55.862425    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:57.861902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.861466    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:57.862566 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:57.861995    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:57.862566 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.861594    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:57.862566 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:57.862085    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:57.862566 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.861466    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:57.862566 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:57.862173    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:06:57.980894 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.980595    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hcfgz" event={"ID":"74844aa7-2483-499e-b047-91989c57445a","Type":"ContainerStarted","Data":"de304fa7173284927bae7a96eed70fbe4fc0593f087dd2c8a98bc4b847306edb"}
Jul 31 00:06:57.982312 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.982277    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp" event={"ID":"d0bb52be-8795-4935-801f-0942ae7919e0","Type":"ContainerStarted","Data":"206f862923b44b2d6f16eaaba86d464d4ac4c37015d3e46ee973fa656fa61c04"}
Jul 31 00:06:57.983987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.983932    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x55fh" event={"ID":"84c97156-0172-40ba-804f-3c1589e7ad30","Type":"ContainerStarted","Data":"5bf0c76ef7f6221db343407f1bc83a79f9892dfcfb21a1e3271840e7be834af4"}
Jul 31 00:06:57.985623 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.985577    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b7ctz" event={"ID":"fd10469a-d51d-4155-991e-f157be459a76","Type":"ContainerStarted","Data":"dcd3c68a141b6cccab60e6f332adae89bf7d2691d89d620727d3137af1e68809"}
Jul 31 00:06:57.987332 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.987311    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c" containerID="bbcd68c788d0c49e9ef7eaa615754472e5e7fa1810a8cceefb4da3a336e7c7a8" exitCode=0
Jul 31 00:06:57.987473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.987452    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerDied","Data":"bbcd68c788d0c49e9ef7eaa615754472e5e7fa1810a8cceefb4da3a336e7c7a8"}
Jul 31 00:06:57.989513 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.989490    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2nmw" event={"ID":"c3061a80-e687-4256-af18-173c5ff6b279","Type":"ContainerStarted","Data":"7b02989121db9d5f9070fb3e19a93c6b2eb2d1e2f6a3c66b90737f9053621f93"}
Jul 31 00:06:57.993672 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.993604    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hcfgz" podStartSLOduration=4.572702324 podStartE2EDuration="22.993591103s" totalImagesPullingTime="18.420888779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:57.993183901 +0000 UTC m=+22.717149868" watchObservedRunningTime="2026-07-31 00:06:57.993591103 +0000 UTC m=+22.717557069"
Jul 31 00:06:57.994063 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.994029    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"4ce6e7818f43b8f2e9f865b2573081b8920ca6def8fae897dbaa366eca5d4353"}
Jul 31 00:06:57.994147 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.994120    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"473da84cf7e3197672510bd7cd24342f71cf5d8e734baab386f976554362810b"}
Jul 31 00:06:57.994207 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.994180    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"86f2d1ee72854b0474a5fe52c9d26931c6c6dc9482124b123f98e79287d0810f"}
Jul 31 00:06:57.994265 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.994227    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"cd2c85e3b455090d985b1b03595cd0145a42c4ff35adf152efcf1f52fac5415b"}
Jul 31 00:06:57.994319 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.994276    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"01adfba7ddcbbaf89f0809ace3d1bc4c0b60c44a7aeb7b7ed873cdeb8fcf53c9"}
Jul 31 00:06:57.994392 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.994364    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"a68cbfb622b8bfc3fe62a81c1e241098da7e33ccd8fe16cb5dc8ff5991684b1c"}
Jul 31 00:06:57.995602 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:57.995579    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v56gk" event={"ID":"fc01b05a-fe73-42e3-8fb6-4188fe7254a0","Type":"ContainerStarted","Data":"7b58c0b16497554458c60a080dfc259c908f80a36a369d1d7a89424b8bec014d"}
Jul 31 00:06:58.005474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.005434    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2nmw" podStartSLOduration=4.578108257 podStartE2EDuration="23.005420509s" totalImagesPullingTime="18.427312252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:58.004909383 +0000 UTC m=+22.728875356" watchObservedRunningTime="2026-07-31 00:06:58.005420509 +0000 UTC m=+22.729386479"
Jul 31 00:06:58.037284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.037240    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b7ctz" podStartSLOduration=8.873558781 podStartE2EDuration="23.037226161s" totalImagesPullingTime="14.16366738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:58.037075275 +0000 UTC m=+22.761041259" watchObservedRunningTime="2026-07-31 00:06:58.037226161 +0000 UTC m=+22.761192128"
Jul 31 00:06:58.053960 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.053922    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x55fh" podStartSLOduration=4.633085709 podStartE2EDuration="23.053909303s" totalImagesPullingTime="18.420823594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:58.053747588 +0000 UTC m=+22.777713565" watchObservedRunningTime="2026-07-31 00:06:58.053909303 +0000 UTC m=+22.777875315"
Jul 31 00:06:58.071992 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.071953    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v56gk" podStartSLOduration=4.592761389 podStartE2EDuration="23.071941691s" totalImagesPullingTime="18.479180302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:58.070637239 +0000 UTC m=+22.794603207" watchObservedRunningTime="2026-07-31 00:06:58.071941691 +0000 UTC m=+22.795907657"
Jul 31 00:06:58.662118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.662094    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 00:06:58.760553 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.760458    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T00:06:58.662113961Z","UUID":"8c2d9050-b955-42fe-a147-af11e7bbea7f","Handler":null,"Name":"","Endpoint":""}
Jul 31 00:06:58.762111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.762086    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 00:06:58.762257 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.762133    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 00:06:58.999719 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:58.999688    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp" event={"ID":"d0bb52be-8795-4935-801f-0942ae7919e0","Type":"ContainerStarted","Data":"012c2cd0fcb6acc562c70d6fa710e0d6f25e0c10aa53a3f200dd087205774450"}
Jul 31 00:06:59.001120 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:59.001097    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jfh58" event={"ID":"557d5b10-3009-41e3-b5b2-a35f73920670","Type":"ContainerStarted","Data":"74c4547e0b584decfebac01da6e92f30883ab174b7ded44eebafe83381f6800b"}
Jul 31 00:06:59.014037 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:59.013979    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jfh58" podStartSLOduration=5.584555199 podStartE2EDuration="24.013962009s" totalImagesPullingTime="18.42940681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:59.013771155 +0000 UTC m=+23.737737150" watchObservedRunningTime="2026-07-31 00:06:59.013962009 +0000 UTC m=+23.737927977"
Jul 31 00:06:59.860954 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:59.860930    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:06:59.861077 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:59.861053    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:06:59.861189 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:59.860933    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:06:59.861189 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:06:59.861094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:06:59.861365 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:59.861190    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:06:59.861365 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:06:59.861288    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:00.006008 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:00.005977    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp" event={"ID":"d0bb52be-8795-4935-801f-0942ae7919e0","Type":"ContainerStarted","Data":"8f305175249706dcf9d3c5e503dfe3cb289e664196a3479f1256dc5254addc1a"}
Jul 31 00:07:00.020793 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:00.020721    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwldp" podStartSLOduration=4.38232076 podStartE2EDuration="25.020703209s" totalImagesPullingTime="20.638382449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:00.020495901 +0000 UTC m=+24.744461888" watchObservedRunningTime="2026-07-31 00:07:00.020703209 +0000 UTC m=+24.744669176"
Jul 31 00:07:01.012710 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:01.012667    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"1cc158c959a9d7789f79fd6fdca907eabf852012e7945074a47efd9d13e8eece"}
Jul 31 00:07:01.861510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:01.861470    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:01.861685 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:01.861476    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:01.861685 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:01.861618    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:01.861685 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:01.861477    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:01.861894 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:01.861698    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:07:01.861894 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:01.861798    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:07:02.246834 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:02.246802    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:07:02.247387 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:02.247367    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:07:03.019028 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.018727    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c" containerID="c3abfb0cff44f4046864e4c720b3fd43511172cb06b3316022cdf426770c1ca3" exitCode=0
Jul 31 00:07:03.019028 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.018788    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerDied","Data":"c3abfb0cff44f4046864e4c720b3fd43511172cb06b3316022cdf426770c1ca3"}
Jul 31 00:07:03.022897 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.022856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" event={"ID":"ef95ab9e-8f6e-4a51-84d3-a48a3168d012","Type":"ContainerStarted","Data":"b69c895eae7c62f256a60166913e7bea08075521c030d97fdb9ac8716b28715f"}
Jul 31 00:07:03.023206 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.023182    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:07:03.023287 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.023233    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:07:03.023287 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.023285    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:07:03.023953 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.023935    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b7ctz"
Jul 31 00:07:03.039034 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.039013    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:07:03.039134 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.039097    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:07:03.068146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.068103    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9" podStartSLOduration=9.568028351 podStartE2EDuration="28.068088136s" totalImagesPullingTime="18.500059785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:03.067486569 +0000 UTC m=+27.791452555" watchObservedRunningTime="2026-07-31 00:07:03.068088136 +0000 UTC m=+27.792054103"
Jul 31 00:07:03.476775 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.476732    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:07:03.861868 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.861578    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:03.862008 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.861578    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:03.862008 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:03.861936    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:07:03.862008 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:03.861640    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:03.862008 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:03.861996    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:07:03.862153 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:03.862095    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:04.466221 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:04.466191    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fcf6"]
Jul 31 00:07:04.466420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:04.466308    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:04.466420 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:04.466405    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:04.468631 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:04.468607    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q8l2k"]
Jul 31 00:07:04.468717 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:04.468680    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:04.468784 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:04.468769    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:07:04.476514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:04.476492    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkr25"]
Jul 31 00:07:04.476612 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:04.476555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:04.476689 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:04.476615    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:07:05.029297 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:05.029264    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c" containerID="06f56f569441cac13f70029edb0fb76bc66ad36fc442718a33693537de934be9" exitCode=0
Jul 31 00:07:05.029696 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:05.029354    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerDied","Data":"06f56f569441cac13f70029edb0fb76bc66ad36fc442718a33693537de934be9"}
Jul 31 00:07:05.861525 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:05.861496    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:05.861676 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:05.861608    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:05.861676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:05.861665    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:05.861789 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:05.861767    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:07:06.861295 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:06.861095    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:06.861632 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:06.861327    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:07:07.035267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:07.035233    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c" containerID="5d4af4699660ec0c1f8fa42112632d82e1aebe2ad11479ee7530c209f5a39e0a" exitCode=0
Jul 31 00:07:07.035267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:07.035272    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerDied","Data":"5d4af4699660ec0c1f8fa42112632d82e1aebe2ad11479ee7530c209f5a39e0a"}
Jul 31 00:07:07.861579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:07.861545    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:07.862178 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:07.861593    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:07.862178 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:07.861686    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:07.862178 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:07.861806    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:07:08.861534 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:08.861453    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:08.861682 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:08.861569    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8l2k" podUID="c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd"
Jul 31 00:07:09.447192 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:09.447150    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:09.447358 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:09.447211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:09.447358 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.447308    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:07:09.447470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.447361    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:07:09.447470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.447378    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:07:41.447357371 +0000 UTC m=+66.171323330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:07:09.447470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.447378    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:07:09.447470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.447398    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ghs5g for pod openshift-network-diagnostics/network-check-target-q8l2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:07:09.447470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.447446    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g podName:c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd nodeName:}" failed. No retries permitted until 2026-07-31 00:07:41.447430641 +0000 UTC m=+66.171396593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghs5g" (UniqueName: "kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g") pod "network-check-target-q8l2k" (UID: "c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:07:09.547826 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:09.547789    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:09.547998 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.547949    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:07:09.548058 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.548021    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret podName:2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:41.548003559 +0000 UTC m=+66.271969527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret") pod "global-pull-secret-syncer-xkr25" (UID: "2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:07:09.861595 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:09.861563    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:09.861811 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.861771    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:07:09.862271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:09.861809    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:09.862271 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:09.861926    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkr25" podUID="2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0"
Jul 31 00:07:10.022913 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.022831    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeReady"
Jul 31 00:07:10.023070 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.022985    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 00:07:10.062891 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.062863    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vfqzp"]
Jul 31 00:07:10.065565 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.065538    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlnrt"]
Jul 31 00:07:10.065709 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.065580    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.067111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.067092    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.067553 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.067532    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 00:07:10.067648 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.067573    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 00:07:10.067648 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.067592    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnjn4\""
Jul 31 00:07:10.068637 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.068617    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5mc7x\""
Jul 31 00:07:10.068745 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.068720    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 00:07:10.068953 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.068848    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 00:07:10.068953 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.068914    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 00:07:10.075185 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.075167    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vfqzp"]
Jul 31 00:07:10.087450 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.087428    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlnrt"]
Jul 31 00:07:10.152676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.152647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv77x\" (UniqueName: \"kubernetes.io/projected/607c0767-752d-4ed2-95c0-32536bcdfc15-kube-api-access-tv77x\") pod \"ingress-canary-zlnrt\" (UID: \"607c0767-752d-4ed2-95c0-32536bcdfc15\") " pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.152676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.152683    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.152908 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.152720    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607c0767-752d-4ed2-95c0-32536bcdfc15-cert\") pod \"ingress-canary-zlnrt\" (UID: \"607c0767-752d-4ed2-95c0-32536bcdfc15\") " pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.152908 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.152740    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07143eab-2b8d-42bb-b999-98fff8133c4f-config-volume\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.152908 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.152777    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07143eab-2b8d-42bb-b999-98fff8133c4f-tmp-dir\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.152908 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.152797    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcc48\" (UniqueName: \"kubernetes.io/projected/07143eab-2b8d-42bb-b999-98fff8133c4f-kube-api-access-pcc48\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.254145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.254115    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv77x\" (UniqueName: \"kubernetes.io/projected/607c0767-752d-4ed2-95c0-32536bcdfc15-kube-api-access-tv77x\") pod \"ingress-canary-zlnrt\" (UID: \"607c0767-752d-4ed2-95c0-32536bcdfc15\") " pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.254317 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.254154    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.254317 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.254184    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607c0767-752d-4ed2-95c0-32536bcdfc15-cert\") pod \"ingress-canary-zlnrt\" (UID: \"607c0767-752d-4ed2-95c0-32536bcdfc15\") " pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.254317 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:10.254290    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:10.254474 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:10.254360    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:07:10.754343899 +0000 UTC m=+35.478309849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:10.254474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.254386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07143eab-2b8d-42bb-b999-98fff8133c4f-config-volume\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.254474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.254409    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07143eab-2b8d-42bb-b999-98fff8133c4f-tmp-dir\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.254474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.254430    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc48\" (UniqueName: \"kubernetes.io/projected/07143eab-2b8d-42bb-b999-98fff8133c4f-kube-api-access-pcc48\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.255184 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.255155    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07143eab-2b8d-42bb-b999-98fff8133c4f-config-volume\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.255300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.255237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07143eab-2b8d-42bb-b999-98fff8133c4f-tmp-dir\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.259587 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.259564    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/607c0767-752d-4ed2-95c0-32536bcdfc15-cert\") pod \"ingress-canary-zlnrt\" (UID: \"607c0767-752d-4ed2-95c0-32536bcdfc15\") " pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.261852 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.261828    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv77x\" (UniqueName: \"kubernetes.io/projected/607c0767-752d-4ed2-95c0-32536bcdfc15-kube-api-access-tv77x\") pod \"ingress-canary-zlnrt\" (UID: \"607c0767-752d-4ed2-95c0-32536bcdfc15\") " pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.262381 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.262354    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcc48\" (UniqueName: \"kubernetes.io/projected/07143eab-2b8d-42bb-b999-98fff8133c4f-kube-api-access-pcc48\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.387885 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.387814    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlnrt"
Jul 31 00:07:10.759270 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.759243    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:10.759450 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:10.759341    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:10.759450 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:10.759399    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:07:11.759381157 +0000 UTC m=+36.483347115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:10.861607 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.861571    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:10.863729 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.863706    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 00:07:10.864200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.863821    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 00:07:10.864200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:10.863880    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmpl\""
Jul 31 00:07:11.278613 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.278492    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlnrt"]
Jul 31 00:07:11.281286 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:07:11.281261    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607c0767_752d_4ed2_95c0_32536bcdfc15.slice/crio-85be2a91f10c623c38edb1fee42d3ce90534b525973baac893e6c0182b5153f6 WatchSource:0}: Error finding container 85be2a91f10c623c38edb1fee42d3ce90534b525973baac893e6c0182b5153f6: Status 404 returned error can't find the container with id 85be2a91f10c623c38edb1fee42d3ce90534b525973baac893e6c0182b5153f6
Jul 31 00:07:11.765969 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.765940    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:11.766136 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:11.766063    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:11.766197 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:11.766141    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:07:13.76612185 +0000 UTC m=+38.490087809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:11.861463 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.861432    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:11.861645 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.861627    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:11.863566 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.863545    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 00:07:11.863959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.863940    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbfb2\""
Jul 31 00:07:11.864324 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:11.863972    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 00:07:12.050212 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:12.050133    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c" containerID="82b171084d87df809e6b14d072aea753def82eac25b3c0ea2cd641d31037210f" exitCode=0
Jul 31 00:07:12.050344 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:12.050222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerDied","Data":"82b171084d87df809e6b14d072aea753def82eac25b3c0ea2cd641d31037210f"}
Jul 31 00:07:12.051614 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:12.051574    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlnrt" event={"ID":"607c0767-752d-4ed2-95c0-32536bcdfc15","Type":"ContainerStarted","Data":"85be2a91f10c623c38edb1fee42d3ce90534b525973baac893e6c0182b5153f6"}
Jul 31 00:07:13.057613 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:13.057578    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c" containerID="f8e8e420dc7a69b5257852ea5213a915c16661a97e1eddd8bf95a3ac2c27230e" exitCode=0
Jul 31 00:07:13.058080 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:13.057638    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerDied","Data":"f8e8e420dc7a69b5257852ea5213a915c16661a97e1eddd8bf95a3ac2c27230e"}
Jul 31 00:07:13.780568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:13.780538    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:13.780693 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:13.780676    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:13.780822 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:13.780733    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:07:17.780717943 +0000 UTC m=+42.504683892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:14.064106 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:14.063885    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djrwl" event={"ID":"8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c","Type":"ContainerStarted","Data":"879aa1f05eed91ff7c5dfa6c5fa9adbb6d2a9e01f966c600e42276dc8f65d62e"}
Jul 31 00:07:14.065348 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:14.065322    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlnrt" event={"ID":"607c0767-752d-4ed2-95c0-32536bcdfc15","Type":"ContainerStarted","Data":"136749034b27dbaed7bb021a256dd19d3a3aa20891c18a21b4036eb2f806868f"}
Jul 31 00:07:14.084217 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:14.084174    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-djrwl" podStartSLOduration=9.505761358 podStartE2EDuration="39.08415347s" totalImagesPullingTime="29.578392112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:14.08313359 +0000 UTC m=+38.807099579" watchObservedRunningTime="2026-07-31 00:07:14.08415347 +0000 UTC m=+38.808119437"
Jul 31 00:07:14.095955 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:14.095917    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlnrt" podStartSLOduration=1.6159092959999999 podStartE2EDuration="4.095903972s" totalImagesPullingTime="2.479994676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:14.09525432 +0000 UTC m=+38.819220286" watchObservedRunningTime="2026-07-31 00:07:14.095903972 +0000 UTC m=+38.819869940"
Jul 31 00:07:17.809989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:17.809947    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:17.810343 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:17.810094    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:17.810343 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:17.810162    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:07:25.81014333 +0000 UTC m=+50.534109296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:25.867594 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:25.867564    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:25.868051 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:25.867660    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:25.868051 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:25.867706    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:07:41.86769355 +0000 UTC m=+66.591659496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:35.045386 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.045357    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxkt9"
Jul 31 00:07:35.169634 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.169602    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"]
Jul 31 00:07:35.201514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.201487    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"]
Jul 31 00:07:35.201650 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.201573    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.203414 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.203391    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 31 00:07:35.203554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.203423    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 31 00:07:35.203554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.203452    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 31 00:07:35.203667 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.203656    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 31 00:07:35.229860 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.229838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.229997 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.229875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-tmp\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.229997 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.229893    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4zs\" (UniqueName: \"kubernetes.io/projected/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-kube-api-access-5k4zs\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.330921 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.330868    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.330921 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.330911    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-tmp\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.331077 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.330930    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4zs\" (UniqueName: \"kubernetes.io/projected/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-kube-api-access-5k4zs\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.331240 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.331221    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-tmp\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.335047 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.335027    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.339436 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.339413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4zs\" (UniqueName: \"kubernetes.io/projected/d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39-kube-api-access-5k4zs\") pod \"klusterlet-addon-workmgr-5b945fc495-whdp2\" (UID: \"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.510564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.510530    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:35.649400 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:35.649371    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"]
Jul 31 00:07:35.652949 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:07:35.652925    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e51ff5_f4d6_4ad0_aa79_2bfa8b6e2c39.slice/crio-ff7da93e1bfbdf6a8cac71379efb56e9aa3fc755e0c45fe6fedfc71368af3137 WatchSource:0}: Error finding container ff7da93e1bfbdf6a8cac71379efb56e9aa3fc755e0c45fe6fedfc71368af3137: Status 404 returned error can't find the container with id ff7da93e1bfbdf6a8cac71379efb56e9aa3fc755e0c45fe6fedfc71368af3137
Jul 31 00:07:36.114366 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:36.114329    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2" event={"ID":"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39","Type":"ContainerStarted","Data":"ff7da93e1bfbdf6a8cac71379efb56e9aa3fc755e0c45fe6fedfc71368af3137"}
Jul 31 00:07:41.474410 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.474378    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:07:41.474885 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.474478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:41.476581 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.476561    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 00:07:41.476671 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.476566    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 00:07:41.485012 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:41.484991    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 00:07:41.485099 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:41.485044    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:08:45.485030607 +0000 UTC m=+130.208996552 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : secret "metrics-daemon-secret" not found
Jul 31 00:07:41.486725 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.486710    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 00:07:41.498636 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.498621    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghs5g\" (UniqueName: \"kubernetes.io/projected/c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd-kube-api-access-ghs5g\") pod \"network-check-target-q8l2k\" (UID: \"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd\") " pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:41.575734 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.575705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:41.577764 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.577739    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 00:07:41.588321 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.588298    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0-original-pull-secret\") pod \"global-pull-secret-syncer-xkr25\" (UID: \"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0\") " pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:41.789149 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.789051    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmpl\""
Jul 31 00:07:41.792593 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.792579    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:41.878133 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.878108    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:07:41.878299 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:41.878280    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:41.878358 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:07:41.878348    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:08:13.878330124 +0000 UTC m=+98.602296070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:41.878577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.878564    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkr25"
Jul 31 00:07:41.929199 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:41.929125    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q8l2k"]
Jul 31 00:07:41.933090 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:07:41.933055    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10554f0_2c13_4cdb_ab1b_9e2d2ebc5bbd.slice/crio-fbd0885242ad7f13a4a6399bb93fc5bb8fe30a847847ca1a7a0f5e39167ed7c9 WatchSource:0}: Error finding container fbd0885242ad7f13a4a6399bb93fc5bb8fe30a847847ca1a7a0f5e39167ed7c9: Status 404 returned error can't find the container with id fbd0885242ad7f13a4a6399bb93fc5bb8fe30a847847ca1a7a0f5e39167ed7c9
Jul 31 00:07:42.006519 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.006489    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkr25"]
Jul 31 00:07:42.009473 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:07:42.009433    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7ec3b6_c4b5_4e97_b08f_374dfb1c15e0.slice/crio-b95bc0ac4adfb01df99c396040751849576a2572ea8ee64cf601cc71705d1e0e WatchSource:0}: Error finding container b95bc0ac4adfb01df99c396040751849576a2572ea8ee64cf601cc71705d1e0e: Status 404 returned error can't find the container with id b95bc0ac4adfb01df99c396040751849576a2572ea8ee64cf601cc71705d1e0e
Jul 31 00:07:42.128722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.128637    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2" event={"ID":"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39","Type":"ContainerStarted","Data":"3c3f0ece1fa0f7a70ec2425c7cbe4769729b096019976143dbe311ca3d208644"}
Jul 31 00:07:42.128897 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.128795    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:42.129921 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.129889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkr25" event={"ID":"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0","Type":"ContainerStarted","Data":"b95bc0ac4adfb01df99c396040751849576a2572ea8ee64cf601cc71705d1e0e"}
Jul 31 00:07:42.130863 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.130839    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:07:42.131102 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.131086    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q8l2k" event={"ID":"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd","Type":"ContainerStarted","Data":"fbd0885242ad7f13a4a6399bb93fc5bb8fe30a847847ca1a7a0f5e39167ed7c9"}
Jul 31 00:07:42.142088 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:42.142051    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2" podStartSLOduration=1.674472856 podStartE2EDuration="7.142038299s" totalImagesPullingTime="5.467565443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:42.141369099 +0000 UTC m=+66.865335092" watchObservedRunningTime="2026-07-31 00:07:42.142038299 +0000 UTC m=+66.866004266"
Jul 31 00:07:47.145824 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:47.145786    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q8l2k" event={"ID":"c10554f0-2c13-4cdb-ab1b-9e2d2ebc5bbd","Type":"ContainerStarted","Data":"dc069b3d7498ef054ca4ba825867afa4affdd7897766fb5d1c50eea7ffdaf54c"}
Jul 31 00:07:47.146304 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:47.145862    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:07:47.147195 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:47.147173    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkr25" event={"ID":"2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0","Type":"ContainerStarted","Data":"7522ececa3cd3bf84b6a7f29bf9e49dd66a67d12dea7c72a8d266ce13d6b02a0"}
Jul 31 00:07:47.164845 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:47.164799    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q8l2k" podStartSLOduration=67.674405722 podStartE2EDuration="1m12.164786663s" totalImagesPullingTime="4.490380941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:47.160886404 +0000 UTC m=+71.884852370" watchObservedRunningTime="2026-07-31 00:07:47.164786663 +0000 UTC m=+71.888752657"
Jul 31 00:07:47.174035 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:07:47.173958    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xkr25" podStartSLOduration=67.754743741 podStartE2EDuration="1m12.173943605s" totalImagesPullingTime="4.419199864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:47.17388795 +0000 UTC m=+71.897853946" watchObservedRunningTime="2026-07-31 00:07:47.173943605 +0000 UTC m=+71.897909574"
Jul 31 00:08:13.896333 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:08:13.896225    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:08:13.896777 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:08:13.896348    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:08:13.896777 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:08:13.896425    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:09:17.896406106 +0000 UTC m=+162.620372065 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:08:18.152271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:08:18.152242    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q8l2k"
Jul 31 00:08:45.497640 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:08:45.497603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:08:45.498146 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:08:45.497736    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 00:08:45.498146 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:08:45.497827    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs podName:8a4af45a-1ff2-46d6-a98a-cf698fcbdfff nodeName:}" failed. No retries permitted until 2026-07-31 00:10:47.497809875 +0000 UTC m=+252.221775820 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs") pod "network-metrics-daemon-7fcf6" (UID: "8a4af45a-1ff2-46d6-a98a-cf698fcbdfff") : secret "metrics-daemon-secret" not found
Jul 31 00:09:13.081503 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:09:13.081461    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vfqzp" podUID="07143eab-2b8d-42bb-b999-98fff8133c4f"
Jul 31 00:09:13.351600 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:13.351517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:09:14.873570 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:09:14.873518    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fcf6" podUID="8a4af45a-1ff2-46d6-a98a-cf698fcbdfff"
Jul 31 00:09:17.905730 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:17.905683    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:09:17.906128 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:09:17.905828    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:09:17.906128 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:09:17.905883    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls podName:07143eab-2b8d-42bb-b999-98fff8133c4f nodeName:}" failed. No retries permitted until 2026-07-31 00:11:19.905868344 +0000 UTC m=+284.629834288 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls") pod "dns-default-vfqzp" (UID: "07143eab-2b8d-42bb-b999-98fff8133c4f") : secret "dns-default-metrics-tls" not found
Jul 31 00:09:29.861875 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:29.861783    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:09:41.413768 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:41.413721    2555 generic.go:356] "Generic (PLEG): container finished" podID="d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39" containerID="3c3f0ece1fa0f7a70ec2425c7cbe4769729b096019976143dbe311ca3d208644" exitCode=1
Jul 31 00:09:41.414112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:41.413785    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2" event={"ID":"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39","Type":"ContainerDied","Data":"3c3f0ece1fa0f7a70ec2425c7cbe4769729b096019976143dbe311ca3d208644"}
Jul 31 00:09:41.414112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:41.414079    2555 scope.go:117] "RemoveContainer" containerID="3c3f0ece1fa0f7a70ec2425c7cbe4769729b096019976143dbe311ca3d208644"
Jul 31 00:09:42.129656 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:42.129617    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:09:42.418229 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:42.418136    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2" event={"ID":"d9e51ff5-f4d6-4ad0-aa79-2bfa8b6e2c39","Type":"ContainerStarted","Data":"dff26e630ee6f55a345a98df19636cc3302be9058e520510c3654a7810fed9e7"}
Jul 31 00:09:42.418614 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:42.418345    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:09:42.418966 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:09:42.418952    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b945fc495-whdp2"
Jul 31 00:10:14.580258 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.580217    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"]
Jul 31 00:10:14.582062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.582046    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"]
Jul 31 00:10:14.582174 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.582156    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"
Jul 31 00:10:14.584013 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.583988    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.584114 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.584026    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zqmvg\""
Jul 31 00:10:14.585934 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.585913    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.586012 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.585985    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 31 00:10:14.586678 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.586666    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t9qcb\""
Jul 31 00:10:14.586991 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.586978    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.587215 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.587204    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 31 00:10:14.592512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.592494    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"]
Jul 31 00:10:14.597083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.597061    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"]
Jul 31 00:10:14.672151 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.672124    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"]
Jul 31 00:10:14.672520 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.672500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c009cf61-0a88-4b6c-b673-6dd00d936515-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.672614 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.672541    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzj9g\" (UniqueName: \"kubernetes.io/projected/eca0e7a9-adf6-44d9-a54a-23033e5fa859-kube-api-access-wzj9g\") pod \"network-check-source-65bdbbff45-9kpzt\" (UID: \"eca0e7a9-adf6-44d9-a54a-23033e5fa859\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"
Jul 31 00:10:14.672614 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.672568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mfdr\" (UniqueName: \"kubernetes.io/projected/c009cf61-0a88-4b6c-b673-6dd00d936515-kube-api-access-4mfdr\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.672727 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.672705    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.673957 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.673944    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.675944 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.675920    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 31 00:10:14.676161 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.676143    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.676247 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.676204    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 31 00:10:14.676247 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.676221    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.676354 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.676310    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zdp4q\""
Jul 31 00:10:14.678559 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.678530    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"]
Jul 31 00:10:14.680116 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.680100    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"]
Jul 31 00:10:14.680222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.680210    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.681770 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.681740    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b78b8b699-88qld"]
Jul 31 00:10:14.681861 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.681826    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:14.682305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.682289    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.682305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.682294    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bvr6g\""
Jul 31 00:10:14.682473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.682323    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 31 00:10:14.682567 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.682553    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 31 00:10:14.682632 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.682608    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.683470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.683451    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 31 00:10:14.683569 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.683555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.683774 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.683742    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.684663 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.684646    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.685187 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.685166    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kzkc5\""
Jul 31 00:10:14.685463 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.685423    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wdb2m\""
Jul 31 00:10:14.685567 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.685479    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 00:10:14.685637 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.685600    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"]
Jul 31 00:10:14.685637 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.685617    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 00:10:14.686275 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.686259    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 00:10:14.691814 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.691792    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 00:10:14.692808 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.692788    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"]
Jul 31 00:10:14.693675 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.693657    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"]
Jul 31 00:10:14.695666 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.695648    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b78b8b699-88qld"]
Jul 31 00:10:14.773875 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.773844    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mfdr\" (UniqueName: \"kubernetes.io/projected/c009cf61-0a88-4b6c-b673-6dd00d936515-kube-api-access-4mfdr\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.773987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.773883    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:14.773987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.773909    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-installation-pull-secrets\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.773987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.773965    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c009cf61-0a88-4b6c-b673-6dd00d936515-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.774127 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774024    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43412d3c-1163-4e1d-b861-9a8c395365a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.774127 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774058    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62pn2\" (UniqueName: \"kubernetes.io/projected/e3b1c460-362a-4b58-bbfd-174feefcb94f-kube-api-access-62pn2\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.774127 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774077    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-trusted-ca\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774127 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.774127 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774120    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43412d3c-1163-4e1d-b861-9a8c395365a8-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774143    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxbh\" (UniqueName: \"kubernetes.io/projected/de097f81-cf42-4f3f-91dc-b803f5e38801-kube-api-access-6qxbh\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-certificates\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774176    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-bound-sa-token\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-image-registry-private-configuration\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.774244    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b1c460-362a-4b58-bbfd-174feefcb94f-serving-cert\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.774303 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.774290    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls podName:c009cf61-0a88-4b6c-b673-6dd00d936515 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:15.274276531 +0000 UTC m=+219.998242477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-qtcqb" (UID: "c009cf61-0a88-4b6c-b673-6dd00d936515") : secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774358    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzj9g\" (UniqueName: \"kubernetes.io/projected/eca0e7a9-adf6-44d9-a54a-23033e5fa859-kube-api-access-wzj9g\") pod \"network-check-source-65bdbbff45-9kpzt\" (UID: \"eca0e7a9-adf6-44d9-a54a-23033e5fa859\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774410    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjhhp\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-kube-api-access-tjhhp\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774448    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-ca-trust-extracted\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774481    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774539    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3b1c460-362a-4b58-bbfd-174feefcb94f-config\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774553    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c009cf61-0a88-4b6c-b673-6dd00d936515-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.774622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.774576    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8l4\" (UniqueName: \"kubernetes.io/projected/43412d3c-1163-4e1d-b861-9a8c395365a8-kube-api-access-kf8l4\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.785485 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.785468    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzj9g\" (UniqueName: \"kubernetes.io/projected/eca0e7a9-adf6-44d9-a54a-23033e5fa859-kube-api-access-wzj9g\") pod \"network-check-source-65bdbbff45-9kpzt\" (UID: \"eca0e7a9-adf6-44d9-a54a-23033e5fa859\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"
Jul 31 00:10:14.785654 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.785633    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mfdr\" (UniqueName: \"kubernetes.io/projected/c009cf61-0a88-4b6c-b673-6dd00d936515-kube-api-access-4mfdr\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:14.875475 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875407    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-image-registry-private-configuration\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.875475 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b1c460-362a-4b58-bbfd-174feefcb94f-serving-cert\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.875475 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875471    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjhhp\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-kube-api-access-tjhhp\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.875722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-ca-trust-extracted\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.875722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875607    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.875722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875635    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3b1c460-362a-4b58-bbfd-174feefcb94f-config\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.875722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875662    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8l4\" (UniqueName: \"kubernetes.io/projected/43412d3c-1163-4e1d-b861-9a8c395365a8-kube-api-access-kf8l4\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.875722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875707    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875730    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-installation-pull-secrets\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.875735    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.875776    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b78b8b699-88qld: secret "image-registry-tls" not found
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875806    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43412d3c-1163-4e1d-b861-9a8c395365a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.875838    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.875847    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls podName:1f53b4f0-98c2-46a9-9c06-3ff1268fd130 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:15.375827647 +0000 UTC m=+220.099793599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls") pod "image-registry-6b78b8b699-88qld" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130") : secret "image-registry-tls" not found
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875878    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62pn2\" (UniqueName: \"kubernetes.io/projected/e3b1c460-362a-4b58-bbfd-174feefcb94f-kube-api-access-62pn2\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:14.875902    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls podName:de097f81-cf42-4f3f-91dc-b803f5e38801 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:15.375884876 +0000 UTC m=+220.099850824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-svzhp" (UID: "de097f81-cf42-4f3f-91dc-b803f5e38801") : secret "samples-operator-tls" not found
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875931    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-trusted-ca\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875964    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-ca-trust-extracted\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.876017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.875970    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43412d3c-1163-4e1d-b861-9a8c395365a8-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.876836 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.876025    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxbh\" (UniqueName: \"kubernetes.io/projected/de097f81-cf42-4f3f-91dc-b803f5e38801-kube-api-access-6qxbh\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:14.876836 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.876051    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-certificates\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.876836 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.876072    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-bound-sa-token\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.876836 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.876301    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3b1c460-362a-4b58-bbfd-174feefcb94f-config\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.878074 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.877369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43412d3c-1163-4e1d-b861-9a8c395365a8-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.878074 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.877807    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-trusted-ca\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.878074 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.877903    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-certificates\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.881999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.878579    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b1c460-362a-4b58-bbfd-174feefcb94f-serving-cert\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.881999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.878817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43412d3c-1163-4e1d-b861-9a8c395365a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.881999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.880195    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-installation-pull-secrets\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.882552 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.882470    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-image-registry-private-configuration\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.884669 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.884642    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-bound-sa-token\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.884862 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.884844    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62pn2\" (UniqueName: \"kubernetes.io/projected/e3b1c460-362a-4b58-bbfd-174feefcb94f-kube-api-access-62pn2\") pod \"service-ca-operator-784f97bcf6-p4wjq\" (UID: \"e3b1c460-362a-4b58-bbfd-174feefcb94f\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:14.884917 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.884859    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjhhp\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-kube-api-access-tjhhp\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:14.885591 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.885562    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxbh\" (UniqueName: \"kubernetes.io/projected/de097f81-cf42-4f3f-91dc-b803f5e38801-kube-api-access-6qxbh\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:14.885802 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.885784    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8l4\" (UniqueName: \"kubernetes.io/projected/43412d3c-1163-4e1d-b861-9a8c395365a8-kube-api-access-kf8l4\") pod \"kube-storage-version-migrator-operator-7878f4b88c-k56wt\" (UID: \"43412d3c-1163-4e1d-b861-9a8c395365a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.891657 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.891637    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"
Jul 31 00:10:14.983235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.983204    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"
Jul 31 00:10:14.992874 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:14.992855    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"
Jul 31 00:10:15.011440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.011415    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt"]
Jul 31 00:10:15.013152 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:15.013125    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca0e7a9_adf6_44d9_a54a_23033e5fa859.slice/crio-f5f5e2175f63b1d80afd491858aa245346cf11338eee5a10fa5a0c9585aecb1c WatchSource:0}: Error finding container f5f5e2175f63b1d80afd491858aa245346cf11338eee5a10fa5a0c9585aecb1c: Status 404 returned error can't find the container with id f5f5e2175f63b1d80afd491858aa245346cf11338eee5a10fa5a0c9585aecb1c
Jul 31 00:10:15.116173 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.116144    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt"]
Jul 31 00:10:15.119408 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:15.119383    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43412d3c_1163_4e1d_b861_9a8c395365a8.slice/crio-776ddcfcf489e23f9960e0a3ea32eeb1e89fafeae7215792229d36f602c77a05 WatchSource:0}: Error finding container 776ddcfcf489e23f9960e0a3ea32eeb1e89fafeae7215792229d36f602c77a05: Status 404 returned error can't find the container with id 776ddcfcf489e23f9960e0a3ea32eeb1e89fafeae7215792229d36f602c77a05
Jul 31 00:10:15.133560 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.133504    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq"]
Jul 31 00:10:15.138463 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:15.138431    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b1c460_362a_4b58_bbfd_174feefcb94f.slice/crio-d3e09c0905cb43804b587ed8a9fc3a4d626d1f79bd320823873212d80ea466bc WatchSource:0}: Error finding container d3e09c0905cb43804b587ed8a9fc3a4d626d1f79bd320823873212d80ea466bc: Status 404 returned error can't find the container with id d3e09c0905cb43804b587ed8a9fc3a4d626d1f79bd320823873212d80ea466bc
Jul 31 00:10:15.280002 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.279972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:15.280176 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.280135    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:15.280217 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.280207    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls podName:c009cf61-0a88-4b6c-b673-6dd00d936515 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:16.280187162 +0000 UTC m=+221.004153116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-qtcqb" (UID: "c009cf61-0a88-4b6c-b673-6dd00d936515") : secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:15.380990 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.380963    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:15.381124 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.381010    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:15.381170 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.381123    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:10:15.381170 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.381140    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b78b8b699-88qld: secret "image-registry-tls" not found
Jul 31 00:10:15.381231 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.381190    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls podName:1f53b4f0-98c2-46a9-9c06-3ff1268fd130 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:16.381170859 +0000 UTC m=+221.105136804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls") pod "image-registry-6b78b8b699-88qld" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130") : secret "image-registry-tls" not found
Jul 31 00:10:15.381231 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.381198    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 00:10:15.381296 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:15.381237    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls podName:de097f81-cf42-4f3f-91dc-b803f5e38801 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:16.381224352 +0000 UTC m=+221.105190296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-svzhp" (UID: "de097f81-cf42-4f3f-91dc-b803f5e38801") : secret "samples-operator-tls" not found
Jul 31 00:10:15.500112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.500085    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt" event={"ID":"43412d3c-1163-4e1d-b861-9a8c395365a8","Type":"ContainerStarted","Data":"776ddcfcf489e23f9960e0a3ea32eeb1e89fafeae7215792229d36f602c77a05"}
Jul 31 00:10:15.501194 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.501154    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq" event={"ID":"e3b1c460-362a-4b58-bbfd-174feefcb94f","Type":"ContainerStarted","Data":"d3e09c0905cb43804b587ed8a9fc3a4d626d1f79bd320823873212d80ea466bc"}
Jul 31 00:10:15.502452 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.502431    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt" event={"ID":"eca0e7a9-adf6-44d9-a54a-23033e5fa859","Type":"ContainerStarted","Data":"628f227f974a45a8bc23ad33b3d07e8d2c7fc9ccb1574c2123ead7d3b1d2d55a"}
Jul 31 00:10:15.502519 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.502467    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt" event={"ID":"eca0e7a9-adf6-44d9-a54a-23033e5fa859","Type":"ContainerStarted","Data":"f5f5e2175f63b1d80afd491858aa245346cf11338eee5a10fa5a0c9585aecb1c"}
Jul 31 00:10:15.515932 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:15.515888    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9kpzt" podStartSLOduration=1.515869941 podStartE2EDuration="1.515869941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:15.514631297 +0000 UTC m=+220.238597284" watchObservedRunningTime="2026-07-31 00:10:15.515869941 +0000 UTC m=+220.239835910"
Jul 31 00:10:16.287941 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:16.287896    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:16.288383 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.288044    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:16.288383 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.288108    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls podName:c009cf61-0a88-4b6c-b673-6dd00d936515 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:18.288089431 +0000 UTC m=+223.012055375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-qtcqb" (UID: "c009cf61-0a88-4b6c-b673-6dd00d936515") : secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:16.388775 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:16.388591    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:16.388775 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:16.388665    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:16.389020 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.388787    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:10:16.389020 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.388808    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b78b8b699-88qld: secret "image-registry-tls" not found
Jul 31 00:10:16.389020 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.388836    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 00:10:16.389020 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.388869    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls podName:1f53b4f0-98c2-46a9-9c06-3ff1268fd130 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:18.388848371 +0000 UTC m=+223.112814331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls") pod "image-registry-6b78b8b699-88qld" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130") : secret "image-registry-tls" not found
Jul 31 00:10:16.389020 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:16.388897    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls podName:de097f81-cf42-4f3f-91dc-b803f5e38801 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:18.388879297 +0000 UTC m=+223.112845245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-svzhp" (UID: "de097f81-cf42-4f3f-91dc-b803f5e38801") : secret "samples-operator-tls" not found
Jul 31 00:10:17.512965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:17.512929    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt" event={"ID":"43412d3c-1163-4e1d-b861-9a8c395365a8","Type":"ContainerStarted","Data":"8ce5dae0697613551e98355d52c1deb8d42d8fcccf56527e6f55517437ba4b6b"}
Jul 31 00:10:17.528569 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:17.528522    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt" podStartSLOduration=1.6853992610000001 podStartE2EDuration="3.528499876s" totalImagesPullingTime="1.843100615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:17.527504942 +0000 UTC m=+222.251470911" watchObservedRunningTime="2026-07-31 00:10:17.528499876 +0000 UTC m=+222.252465842"
Jul 31 00:10:18.303988 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.303955    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:18.304139 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.304113    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:18.304191 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.304180    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls podName:c009cf61-0a88-4b6c-b673-6dd00d936515 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.304164269 +0000 UTC m=+227.028130215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-qtcqb" (UID: "c009cf61-0a88-4b6c-b673-6dd00d936515") : secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:18.345235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.345199    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"]
Jul 31 00:10:18.347329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.347307    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"
Jul 31 00:10:18.349416 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.349392    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 31 00:10:18.349501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.349392    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 31 00:10:18.349911 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.349893    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9rnkk\""
Jul 31 00:10:18.355026 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.355003    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"]
Jul 31 00:10:18.405012 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.404982    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:18.405176 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.405023    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:18.405176 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.405089    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gjt\" (UniqueName: \"kubernetes.io/projected/773e8476-0fdf-4170-85f2-fb96341429a8-kube-api-access-v6gjt\") pod \"migrator-68bc745d87-qgz9f\" (UID: \"773e8476-0fdf-4170-85f2-fb96341429a8\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"
Jul 31 00:10:18.405176 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.405151    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:10:18.405176 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.405168    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b78b8b699-88qld: secret "image-registry-tls" not found
Jul 31 00:10:18.405378 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.405203    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 00:10:18.405378 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.405233    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls podName:1f53b4f0-98c2-46a9-9c06-3ff1268fd130 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.405211598 +0000 UTC m=+227.129177544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls") pod "image-registry-6b78b8b699-88qld" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130") : secret "image-registry-tls" not found
Jul 31 00:10:18.405378 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.405254    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls podName:de097f81-cf42-4f3f-91dc-b803f5e38801 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.405240058 +0000 UTC m=+227.129206003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-svzhp" (UID: "de097f81-cf42-4f3f-91dc-b803f5e38801") : secret "samples-operator-tls" not found
Jul 31 00:10:18.506333 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.506304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gjt\" (UniqueName: \"kubernetes.io/projected/773e8476-0fdf-4170-85f2-fb96341429a8-kube-api-access-v6gjt\") pod \"migrator-68bc745d87-qgz9f\" (UID: \"773e8476-0fdf-4170-85f2-fb96341429a8\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"
Jul 31 00:10:18.514568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.514539    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gjt\" (UniqueName: \"kubernetes.io/projected/773e8476-0fdf-4170-85f2-fb96341429a8-kube-api-access-v6gjt\") pod \"migrator-68bc745d87-qgz9f\" (UID: \"773e8476-0fdf-4170-85f2-fb96341429a8\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"
Jul 31 00:10:18.517413 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.517391    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq" event={"ID":"e3b1c460-362a-4b58-bbfd-174feefcb94f","Type":"ContainerStarted","Data":"db32dbf29e6d676fac9c76193e719609c07c8ff81e38db32b1d130eab6289897"}
Jul 31 00:10:18.530128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.530080    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq" podStartSLOduration=1.819897581 podStartE2EDuration="4.530066501s" totalImagesPullingTime="2.71016892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:18.529444211 +0000 UTC m=+223.253410179" watchObservedRunningTime="2026-07-31 00:10:18.530066501 +0000 UTC m=+223.254032468"
Jul 31 00:10:18.638298 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.638223    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wxmz4"]
Jul 31 00:10:18.640549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.640528    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.642437 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.642417    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 00:10:18.642437 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.642430    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 00:10:18.642591 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.642425    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f672z\""
Jul 31 00:10:18.642740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.642717    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 00:10:18.642852 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.642717    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 00:10:18.652797 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.652775    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxmz4"]
Jul 31 00:10:18.656804 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.656782    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"
Jul 31 00:10:18.707676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.707646    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/266dc6ac-6827-42e0-b103-c5b01060a634-crio-socket\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.707883 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.707771    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/266dc6ac-6827-42e0-b103-c5b01060a634-data-volume\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.707956 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.707884    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.708007 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.707985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.708094 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.708040    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7722\" (UniqueName: \"kubernetes.io/projected/266dc6ac-6827-42e0-b103-c5b01060a634-kube-api-access-q7722\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.776004 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.775976    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f"]
Jul 31 00:10:18.779580 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:18.779553    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773e8476_0fdf_4170_85f2_fb96341429a8.slice/crio-12a86c5bcc2d61eea57ac30b016c4b3e0c9a7689584fe25d11f335273fda01b6 WatchSource:0}: Error finding container 12a86c5bcc2d61eea57ac30b016c4b3e0c9a7689584fe25d11f335273fda01b6: Status 404 returned error can't find the container with id 12a86c5bcc2d61eea57ac30b016c4b3e0c9a7689584fe25d11f335273fda01b6
Jul 31 00:10:18.809235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809207    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.809360 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809247    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.809360 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809276    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7722\" (UniqueName: \"kubernetes.io/projected/266dc6ac-6827-42e0-b103-c5b01060a634-kube-api-access-q7722\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.809470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.809357    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 00:10:18.809470 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/266dc6ac-6827-42e0-b103-c5b01060a634-crio-socket\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.809470 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.809469    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:19.309454963 +0000 UTC m=+224.033420907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : configmap "kube-rbac-proxy" not found
Jul 31 00:10:18.809612 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809520    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/266dc6ac-6827-42e0-b103-c5b01060a634-crio-socket\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.809612 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.809592    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:18.809686 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:18.809635    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:19.309618402 +0000 UTC m=+224.033584347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:18.809686 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/266dc6ac-6827-42e0-b103-c5b01060a634-data-volume\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.809934 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.809919    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/266dc6ac-6827-42e0-b103-c5b01060a634-data-volume\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:18.818745 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:18.818722    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7722\" (UniqueName: \"kubernetes.io/projected/266dc6ac-6827-42e0-b103-c5b01060a634-kube-api-access-q7722\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:19.314082 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:19.314053    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:19.314270 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:19.314092    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:19.314270 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:19.314186    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 00:10:19.314270 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:19.314226    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:19.314270 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:19.314257    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:20.314237806 +0000 UTC m=+225.038203774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : configmap "kube-rbac-proxy" not found
Jul 31 00:10:19.314270 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:19.314274    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:20.314265127 +0000 UTC m=+225.038231072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:19.522621 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:19.522585    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f" event={"ID":"773e8476-0fdf-4170-85f2-fb96341429a8","Type":"ContainerStarted","Data":"12a86c5bcc2d61eea57ac30b016c4b3e0c9a7689584fe25d11f335273fda01b6"}
Jul 31 00:10:20.321833 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:20.321805    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:20.322015 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:20.321902    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:20.322015 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:20.321943    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:20.322015 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:20.321968    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 00:10:20.322015 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:20.322001    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.321987711 +0000 UTC m=+227.045953656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:20.322015 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:20.322015    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.32200902 +0000 UTC m=+227.045974965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : configmap "kube-rbac-proxy" not found
Jul 31 00:10:20.527854 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:20.527821    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f" event={"ID":"773e8476-0fdf-4170-85f2-fb96341429a8","Type":"ContainerStarted","Data":"2d4626f7824e9db1bf03ab25b80da990d35419fd02638244b616b71dc362933a"}
Jul 31 00:10:20.528215 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:20.527873    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f" event={"ID":"773e8476-0fdf-4170-85f2-fb96341429a8","Type":"ContainerStarted","Data":"053f33c2e20fee8c4e2ff261ea95683b2a718d05c5b765b2392e89bc0f8cd647"}
Jul 31 00:10:20.541846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:20.541804    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qgz9f" podStartSLOduration=1.420087906 podStartE2EDuration="2.541788565s" totalImagesPullingTime="1.121700659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:20.541010597 +0000 UTC m=+225.264976574" watchObservedRunningTime="2026-07-31 00:10:20.541788565 +0000 UTC m=+225.265754553"
Jul 31 00:10:21.415667 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:21.415639    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcfgz_74844aa7-2483-499e-b047-91989c57445a/dns-node-resolver/0.log"
Jul 31 00:10:22.338089 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.338052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:22.338480 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.338142    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:22.338480 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.338171    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:22.338480 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.338195    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:22.338480 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.338268    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls podName:c009cf61-0a88-4b6c-b673-6dd00d936515 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:30.338251234 +0000 UTC m=+235.062217199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-qtcqb" (UID: "c009cf61-0a88-4b6c-b673-6dd00d936515") : secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:22.338480 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.338282    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:22.338480 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.338331    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:26.338317219 +0000 UTC m=+231.062283165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:22.338693 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.338677    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/266dc6ac-6827-42e0-b103-c5b01060a634-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:22.439120 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.439084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:22.439297 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.439211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:22.439676 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.439657    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 00:10:22.439731 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.439720    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls podName:de097f81-cf42-4f3f-91dc-b803f5e38801 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:30.439700921 +0000 UTC m=+235.163666870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-svzhp" (UID: "de097f81-cf42-4f3f-91dc-b803f5e38801") : secret "samples-operator-tls" not found
Jul 31 00:10:22.439823 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.439659    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:10:22.439823 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.439792    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b78b8b699-88qld: secret "image-registry-tls" not found
Jul 31 00:10:22.439909 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:22.439847    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls podName:1f53b4f0-98c2-46a9-9c06-3ff1268fd130 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:30.439830851 +0000 UTC m=+235.163796813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls") pod "image-registry-6b78b8b699-88qld" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130") : secret "image-registry-tls" not found
Jul 31 00:10:22.614022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:22.613953    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2nmw_c3061a80-e687-4256-af18-173c5ff6b279/node-ca/0.log"
Jul 31 00:10:23.614736 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:23.614706    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlnrt_607c0767-752d-4ed2-95c0-32536bcdfc15/serve-healthcheck-canary/0.log"
Jul 31 00:10:23.814823 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:23.814791    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-qgz9f_773e8476-0fdf-4170-85f2-fb96341429a8/migrator/0.log"
Jul 31 00:10:24.014015 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:24.013987    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-qgz9f_773e8476-0fdf-4170-85f2-fb96341429a8/graceful-termination/0.log"
Jul 31 00:10:24.214965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:24.214935    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-k56wt_43412d3c-1163-4e1d-b861-9a8c395365a8/kube-storage-version-migrator-operator/0.log"
Jul 31 00:10:26.370305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:26.370275    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:26.370692 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:26.370419    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:26.370692 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:26.370485    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls podName:266dc6ac-6827-42e0-b103-c5b01060a634 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:34.370470121 +0000 UTC m=+239.094436066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxmz4" (UID: "266dc6ac-6827-42e0-b103-c5b01060a634") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:30.403609 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.403574    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:30.404002 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:30.403721    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:30.404002 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:10:30.403813    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls podName:c009cf61-0a88-4b6c-b673-6dd00d936515 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:46.403797524 +0000 UTC m=+251.127763469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-qtcqb" (UID: "c009cf61-0a88-4b6c-b673-6dd00d936515") : secret "cluster-monitoring-operator-tls" not found
Jul 31 00:10:30.504535 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.504503    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:30.504689 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.504545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:30.507003 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.506972    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"image-registry-6b78b8b699-88qld\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") " pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:30.507135 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.507084    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de097f81-cf42-4f3f-91dc-b803f5e38801-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-svzhp\" (UID: \"de097f81-cf42-4f3f-91dc-b803f5e38801\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:30.599958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.599933    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"
Jul 31 00:10:30.604939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.604918    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:30.730910 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.730850    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp"]
Jul 31 00:10:30.749916 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:30.749887    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b78b8b699-88qld"]
Jul 31 00:10:30.752407 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:30.752384    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f53b4f0_98c2_46a9_9c06_3ff1268fd130.slice/crio-448e4df1f4ea39c4d3e8c66b58b13ad82812f38890d8db4b23370b4060ff25d2 WatchSource:0}: Error finding container 448e4df1f4ea39c4d3e8c66b58b13ad82812f38890d8db4b23370b4060ff25d2: Status 404 returned error can't find the container with id 448e4df1f4ea39c4d3e8c66b58b13ad82812f38890d8db4b23370b4060ff25d2
Jul 31 00:10:31.562655 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:31.562616    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" event={"ID":"1f53b4f0-98c2-46a9-9c06-3ff1268fd130","Type":"ContainerStarted","Data":"08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973"}
Jul 31 00:10:31.563089 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:31.562715    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:10:31.563089 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:31.562739    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" event={"ID":"1f53b4f0-98c2-46a9-9c06-3ff1268fd130","Type":"ContainerStarted","Data":"448e4df1f4ea39c4d3e8c66b58b13ad82812f38890d8db4b23370b4060ff25d2"}
Jul 31 00:10:31.564462 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:31.564422    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp" event={"ID":"de097f81-cf42-4f3f-91dc-b803f5e38801","Type":"ContainerStarted","Data":"d811e93eebe34bd469a7ddf018faeed8845af82fc3fee3bf539ddcc1aa16138e"}
Jul 31 00:10:31.578877 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:31.578820    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" podStartSLOduration=17.578806145 podStartE2EDuration="17.578806145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:31.578449347 +0000 UTC m=+236.302415341" watchObservedRunningTime="2026-07-31 00:10:31.578806145 +0000 UTC m=+236.302772112"
Jul 31 00:10:32.570532 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:32.570504    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp" event={"ID":"de097f81-cf42-4f3f-91dc-b803f5e38801","Type":"ContainerStarted","Data":"956db9f1b6fcc2b82cdba9cd7795649793964d67b7531eed16f67930785cfa61"}
Jul 31 00:10:32.570900 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:32.570561    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp" event={"ID":"de097f81-cf42-4f3f-91dc-b803f5e38801","Type":"ContainerStarted","Data":"a00220aa831fdc77707d373095c1064feeedff79a24fac3f536838d8d27bf69b"}
Jul 31 00:10:32.585050 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:32.585007    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-svzhp" podStartSLOduration=16.910369658 podStartE2EDuration="18.58499223s" totalImagesPullingTime="1.674622572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:32.583472696 +0000 UTC m=+237.307438683" watchObservedRunningTime="2026-07-31 00:10:32.58499223 +0000 UTC m=+237.308958197"
Jul 31 00:10:34.436108 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:34.436075    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:34.438526 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:34.438506    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/266dc6ac-6827-42e0-b103-c5b01060a634-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxmz4\" (UID: \"266dc6ac-6827-42e0-b103-c5b01060a634\") " pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:34.549640 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:34.549606    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxmz4"
Jul 31 00:10:34.672001 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:34.671969    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxmz4"]
Jul 31 00:10:34.674980 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:34.674955    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266dc6ac_6827_42e0_b103_c5b01060a634.slice/crio-640c99489ced28f5fd3dcf8e3df6853ccd81fb48a9e1fbc7ca0edfea1964302e WatchSource:0}: Error finding container 640c99489ced28f5fd3dcf8e3df6853ccd81fb48a9e1fbc7ca0edfea1964302e: Status 404 returned error can't find the container with id 640c99489ced28f5fd3dcf8e3df6853ccd81fb48a9e1fbc7ca0edfea1964302e
Jul 31 00:10:35.582133 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:35.582092    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxmz4" event={"ID":"266dc6ac-6827-42e0-b103-c5b01060a634","Type":"ContainerStarted","Data":"ad4daf5e7533a11d0e7294692c13d082e3a704440bae71fbf9af0aaedb19c14a"}
Jul 31 00:10:35.582589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:35.582205    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxmz4" event={"ID":"266dc6ac-6827-42e0-b103-c5b01060a634","Type":"ContainerStarted","Data":"c3d04cabeaf56a671a8250e925c4f20af521fb200eeac7975b72fe35cae49155"}
Jul 31 00:10:35.582589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:35.582244    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxmz4" event={"ID":"266dc6ac-6827-42e0-b103-c5b01060a634","Type":"ContainerStarted","Data":"640c99489ced28f5fd3dcf8e3df6853ccd81fb48a9e1fbc7ca0edfea1964302e"}
Jul 31 00:10:37.590045 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:37.590011    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxmz4" event={"ID":"266dc6ac-6827-42e0-b103-c5b01060a634","Type":"ContainerStarted","Data":"3a9fad70fd4f8e343f9bb761c580dbdcba9d49b871fa60758b6654e24933d6bc"}
Jul 31 00:10:37.605847 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:37.605796    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wxmz4" podStartSLOduration=17.284608719 podStartE2EDuration="19.60578026s" totalImagesPullingTime="2.321171541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:10:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:37.603918054 +0000 UTC m=+242.327884020" watchObservedRunningTime="2026-07-31 00:10:37.60578026 +0000 UTC m=+242.329746227"
Jul 31 00:10:39.596679 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.596647    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b78b8b699-88qld"]
Jul 31 00:10:39.630588 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.630543    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7796cfc577-8kn2s"]
Jul 31 00:10:39.634568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.634544    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.645631 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.645591    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7796cfc577-8kn2s"]
Jul 31 00:10:39.778898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.778867    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-registry-tls\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.778898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.778902    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbd614d6-3799-4609-b9c8-204c2f97f8b2-trusted-ca\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.779111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.778924    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbd614d6-3799-4609-b9c8-204c2f97f8b2-ca-trust-extracted\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.779111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.778948    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbd614d6-3799-4609-b9c8-204c2f97f8b2-installation-pull-secrets\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.779111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.778977    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbd614d6-3799-4609-b9c8-204c2f97f8b2-image-registry-private-configuration\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.779111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.778992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-bound-sa-token\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.779111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.779014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbd614d6-3799-4609-b9c8-204c2f97f8b2-registry-certificates\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.779111 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.779028    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzcfj\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-kube-api-access-lzcfj\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-registry-tls\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880334    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbd614d6-3799-4609-b9c8-204c2f97f8b2-trusted-ca\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880357    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbd614d6-3799-4609-b9c8-204c2f97f8b2-ca-trust-extracted\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880484    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbd614d6-3799-4609-b9c8-204c2f97f8b2-installation-pull-secrets\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880512    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbd614d6-3799-4609-b9c8-204c2f97f8b2-image-registry-private-configuration\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-bound-sa-token\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880704 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880687    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbd614d6-3799-4609-b9c8-204c2f97f8b2-registry-certificates\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880786 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880729    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzcfj\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-kube-api-access-lzcfj\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.880915 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.880891    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bbd614d6-3799-4609-b9c8-204c2f97f8b2-ca-trust-extracted\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.881318 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.881263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bbd614d6-3799-4609-b9c8-204c2f97f8b2-trusted-ca\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.881436 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.881419    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bbd614d6-3799-4609-b9c8-204c2f97f8b2-registry-certificates\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.882924 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.882906    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bbd614d6-3799-4609-b9c8-204c2f97f8b2-installation-pull-secrets\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.883475 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.883454    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-registry-tls\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.883546 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.883497    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bbd614d6-3799-4609-b9c8-204c2f97f8b2-image-registry-private-configuration\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.887275 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.887248    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-bound-sa-token\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.887400 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.887383    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzcfj\" (UniqueName: \"kubernetes.io/projected/bbd614d6-3799-4609-b9c8-204c2f97f8b2-kube-api-access-lzcfj\") pod \"image-registry-7796cfc577-8kn2s\" (UID: \"bbd614d6-3799-4609-b9c8-204c2f97f8b2\") " pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:39.942700 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:39.942661    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:40.068338 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:40.068312    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7796cfc577-8kn2s"]
Jul 31 00:10:40.070704 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:40.070672    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd614d6_3799_4609_b9c8_204c2f97f8b2.slice/crio-2316dd97f153b78edf7ffb77ff848568fda37c73c1e266dff508ce3b6cf453b5 WatchSource:0}: Error finding container 2316dd97f153b78edf7ffb77ff848568fda37c73c1e266dff508ce3b6cf453b5: Status 404 returned error can't find the container with id 2316dd97f153b78edf7ffb77ff848568fda37c73c1e266dff508ce3b6cf453b5
Jul 31 00:10:40.600806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:40.600749    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s" event={"ID":"bbd614d6-3799-4609-b9c8-204c2f97f8b2","Type":"ContainerStarted","Data":"119141e4ceb84575f34d95064c866012d1175a4bd615281cf56f6f6262530cf2"}
Jul 31 00:10:40.601235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:40.600821    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s" event={"ID":"bbd614d6-3799-4609-b9c8-204c2f97f8b2","Type":"ContainerStarted","Data":"2316dd97f153b78edf7ffb77ff848568fda37c73c1e266dff508ce3b6cf453b5"}
Jul 31 00:10:40.601235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:40.600882    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:10:40.617360 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:40.617311    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s" podStartSLOduration=1.617297734 podStartE2EDuration="1.617297734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:40.616433206 +0000 UTC m=+245.340399173" watchObservedRunningTime="2026-07-31 00:10:40.617297734 +0000 UTC m=+245.341263700"
Jul 31 00:10:46.435506 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:46.435468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:46.437943 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:46.437922    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c009cf61-0a88-4b6c-b673-6dd00d936515-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-qtcqb\" (UID: \"c009cf61-0a88-4b6c-b673-6dd00d936515\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:46.700380 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:46.700308    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t9qcb\""
Jul 31 00:10:46.708654 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:46.708624    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"
Jul 31 00:10:46.831600 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:46.831578    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb"]
Jul 31 00:10:46.833302 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:46.833274    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc009cf61_0a88_4b6c_b673_6dd00d936515.slice/crio-f5fb5d55473c12f9918080f36acc8f0b6a5133956791ad235a00dc68433ecf2c WatchSource:0}: Error finding container f5fb5d55473c12f9918080f36acc8f0b6a5133956791ad235a00dc68433ecf2c: Status 404 returned error can't find the container with id f5fb5d55473c12f9918080f36acc8f0b6a5133956791ad235a00dc68433ecf2c
Jul 31 00:10:47.545620 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:47.545588    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:10:47.547971 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:47.547946    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4af45a-1ff2-46d6-a98a-cf698fcbdfff-metrics-certs\") pod \"network-metrics-daemon-7fcf6\" (UID: \"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff\") " pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:10:47.564833 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:47.564808    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbfb2\""
Jul 31 00:10:47.573296 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:47.573277    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fcf6"
Jul 31 00:10:47.624598 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:47.624563    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb" event={"ID":"c009cf61-0a88-4b6c-b673-6dd00d936515","Type":"ContainerStarted","Data":"f5fb5d55473c12f9918080f36acc8f0b6a5133956791ad235a00dc68433ecf2c"}
Jul 31 00:10:47.722956 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:47.722927    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fcf6"]
Jul 31 00:10:47.726565 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:10:47.726530    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4af45a_1ff2_46d6_a98a_cf698fcbdfff.slice/crio-fdc295e9037358ef7a2b48afd0da35443b98605cd2d6a6395b8bfe25840ec855 WatchSource:0}: Error finding container fdc295e9037358ef7a2b48afd0da35443b98605cd2d6a6395b8bfe25840ec855: Status 404 returned error can't find the container with id fdc295e9037358ef7a2b48afd0da35443b98605cd2d6a6395b8bfe25840ec855
Jul 31 00:10:48.629533 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:48.629500    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fcf6" event={"ID":"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff","Type":"ContainerStarted","Data":"fdc295e9037358ef7a2b48afd0da35443b98605cd2d6a6395b8bfe25840ec855"}
Jul 31 00:10:49.604732 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.604655    2555 patch_prober.go:28] interesting pod/image-registry-6b78b8b699-88qld container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 00:10:49.604732 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.604709    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:10:49.638749 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.638713    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb" event={"ID":"c009cf61-0a88-4b6c-b673-6dd00d936515","Type":"ContainerStarted","Data":"9f22fc8f9c18414d297d4a7753a9d07732d192a83b983c215988b3ab3c6f23f4"}
Jul 31 00:10:49.640633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.640607    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fcf6" event={"ID":"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff","Type":"ContainerStarted","Data":"1066c0270adf4bfd6903af17838a71fca5bc39050106fb5e7aafe5f9069cbe05"}
Jul 31 00:10:49.640783 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.640660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fcf6" event={"ID":"8a4af45a-1ff2-46d6-a98a-cf698fcbdfff","Type":"ContainerStarted","Data":"71d4719bde866679973f4db344e2189c5ae95048485757f486fc2d03be527ec3"}
Jul 31 00:10:49.654601 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.654560    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-qtcqb" podStartSLOduration=33.193001975 podStartE2EDuration="35.654542158s" totalImagesPullingTime="2.461540183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:49.653326785 +0000 UTC m=+254.377292751" watchObservedRunningTime="2026-07-31 00:10:49.654542158 +0000 UTC m=+254.378508126"
Jul 31 00:10:49.668416 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:49.668370    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7fcf6" podStartSLOduration=253.103967234 podStartE2EDuration="4m14.668356359s" totalImagesPullingTime="1.564389125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:49.66713611 +0000 UTC m=+254.391102078" watchObservedRunningTime="2026-07-31 00:10:49.668356359 +0000 UTC m=+254.392322326"
Jul 31 00:10:56.749115 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.749044    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb7c4464b-g6rvr"]
Jul 31 00:10:56.751151 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.751136    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:56.753056 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753037    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 00:10:56.753202 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753182    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 00:10:56.753245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753230    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 00:10:56.753679 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753653    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c2ls4\""
Jul 31 00:10:56.753799 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753784    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 00:10:56.753897 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753882    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 00:10:56.753946 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.753902    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 00:10:56.754037 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.754020    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 00:10:56.763311 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.763292    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb7c4464b-g6rvr"]
Jul 31 00:10:56.914766 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.914711    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-oauth-config\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:56.914939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.914808    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-service-ca\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:56.914939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.914837    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-oauth-serving-cert\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:56.914939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.914856    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxbqw\" (UniqueName: \"kubernetes.io/projected/82394b09-7e86-4956-b98b-53e18aed1a42-kube-api-access-kxbqw\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:56.914939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.914873    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-serving-cert\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:56.914939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:56.914888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-console-config\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.015461 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.015375    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-service-ca\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.015461 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.015427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-oauth-serving-cert\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.015657 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.015534    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbqw\" (UniqueName: \"kubernetes.io/projected/82394b09-7e86-4956-b98b-53e18aed1a42-kube-api-access-kxbqw\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.015657 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.015566    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-serving-cert\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.015657 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.015582    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-console-config\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.015855 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.015804    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-oauth-config\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.016173 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.016149    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-service-ca\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.016349 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.016332    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-console-config\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.016622 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.016603    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-oauth-serving-cert\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.018226 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.018207    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-oauth-config\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.018327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.018224    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-serving-cert\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.022396 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.022376    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxbqw\" (UniqueName: \"kubernetes.io/projected/82394b09-7e86-4956-b98b-53e18aed1a42-kube-api-access-kxbqw\") pod \"console-6cb7c4464b-g6rvr\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") " pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.060390 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.060368    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:10:57.180799 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.180723    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb7c4464b-g6rvr"]
Jul 31 00:10:57.668872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:57.668838    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7c4464b-g6rvr" event={"ID":"82394b09-7e86-4956-b98b-53e18aed1a42","Type":"ContainerStarted","Data":"9dc412ed8e57bd61f9b7185a7afd0cfa2fe07aeca5dc67f9c2f5a2aad9388ea3"}
Jul 31 00:10:59.602325 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:59.602287    2555 patch_prober.go:28] interesting pod/image-registry-6b78b8b699-88qld container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 00:10:59.602744 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:59.602349    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:10:59.948782 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:59.948719    2555 patch_prober.go:28] interesting pod/image-registry-7796cfc577-8kn2s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 00:10:59.948984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:10:59.948816    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s" podUID="bbd614d6-3799-4609-b9c8-204c2f97f8b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:11:00.682922 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:00.682889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7c4464b-g6rvr" event={"ID":"82394b09-7e86-4956-b98b-53e18aed1a42","Type":"ContainerStarted","Data":"530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b"}
Jul 31 00:11:00.699521 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:00.699477    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cb7c4464b-g6rvr" podStartSLOduration=1.571159516 podStartE2EDuration="4.699460311s" totalImagesPullingTime="3.128300795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:00.698585644 +0000 UTC m=+265.422551630" watchObservedRunningTime="2026-07-31 00:11:00.699460311 +0000 UTC m=+265.423426277"
Jul 31 00:11:01.608669 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:01.608639    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7796cfc577-8kn2s"
Jul 31 00:11:04.615273 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.615213    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerName="registry" containerID="cri-o://08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973" gracePeriod=30
Jul 31 00:11:04.860880 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.860857    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:11:04.881682 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881616    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-installation-pull-secrets\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881682 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881664    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-trusted-ca\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881691    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-ca-trust-extracted\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881721    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjhhp\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-kube-api-access-tjhhp\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881792    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-bound-sa-token\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881815    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881857    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-certificates\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.881893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.881883    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-image-registry-private-configuration\") pod \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\" (UID: \"1f53b4f0-98c2-46a9-9c06-3ff1268fd130\") "
Jul 31 00:11:04.882179 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.882101    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:04.882468 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.882426    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:04.887305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.887258    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-kube-api-access-tjhhp" (OuterVolumeSpecName: "kube-api-access-tjhhp") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "kube-api-access-tjhhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:04.887420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.887343    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:11:04.887657 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.887631    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:11:04.887745 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.887729    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:04.888117 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.888097    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:04.894855 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.894823    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1f53b4f0-98c2-46a9-9c06-3ff1268fd130" (UID: "1f53b4f0-98c2-46a9-9c06-3ff1268fd130"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:11:04.982741 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982713    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-installation-pull-secrets\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982741 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982738    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-trusted-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982748    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-ca-trust-extracted\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982776    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjhhp\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-kube-api-access-tjhhp\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982785    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-bound-sa-token\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982795    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982802    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-registry-certificates\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:04.982923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:04.982811    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f53b4f0-98c2-46a9-9c06-3ff1268fd130-image-registry-private-configuration\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:05.215320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.215289    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d9cz8"]
Jul 31 00:11:05.215541 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.215530    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerName="registry"
Jul 31 00:11:05.215584 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.215542    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerName="registry"
Jul 31 00:11:05.215621 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.215591    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerName="registry"
Jul 31 00:11:05.218772 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.218738    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.220606 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.220578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 00:11:05.220739 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.220631    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r9g7t\""
Jul 31 00:11:05.220970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.220921    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 00:11:05.220970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.220963    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 00:11:05.221344 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.221331    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 00:11:05.285786 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285749    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-wtmp\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.285786 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285795    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.285984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-textfile\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.285984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285836    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d774ba-82fd-482f-b688-4a47ddd87816-metrics-client-ca\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.285984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285869    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.285984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285900    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-root\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.285984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285966    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-sys\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.286146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.285986    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-tls\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.286146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.286003    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4cg\" (UniqueName: \"kubernetes.io/projected/c2d774ba-82fd-482f-b688-4a47ddd87816-kube-api-access-nl4cg\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.386982 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.386950    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-sys\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.386982 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.386982    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-tls\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387185 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387002    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4cg\" (UniqueName: \"kubernetes.io/projected/c2d774ba-82fd-482f-b688-4a47ddd87816-kube-api-access-nl4cg\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387185 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387076    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-sys\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387185 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:11:05.387120    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 00:11:05.387185 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:11:05.387173    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-tls podName:c2d774ba-82fd-482f-b688-4a47ddd87816 nodeName:}" failed. No retries permitted until 2026-07-31 00:11:05.88715406 +0000 UTC m=+270.611120004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-tls") pod "node-exporter-d9cz8" (UID: "c2d774ba-82fd-482f-b688-4a47ddd87816") : secret "node-exporter-tls" not found
Jul 31 00:11:05.387185 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-wtmp\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387224    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-wtmp\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387238    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387283    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-textfile\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387309    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d774ba-82fd-482f-b688-4a47ddd87816-metrics-client-ca\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387333    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387356    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-root\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387709 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387461    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2d774ba-82fd-482f-b688-4a47ddd87816-root\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387709 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387571    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-textfile\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387884 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387867    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d774ba-82fd-482f-b688-4a47ddd87816-metrics-client-ca\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.387951 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.387887    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.389732 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.389716    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.396786 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.396747    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4cg\" (UniqueName: \"kubernetes.io/projected/c2d774ba-82fd-482f-b688-4a47ddd87816-kube-api-access-nl4cg\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.699678 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.699647    2555 generic.go:356] "Generic (PLEG): container finished" podID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" containerID="08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973" exitCode=0
Jul 31 00:11:05.700146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.699698    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" event={"ID":"1f53b4f0-98c2-46a9-9c06-3ff1268fd130","Type":"ContainerDied","Data":"08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973"}
Jul 31 00:11:05.700146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.699736    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b78b8b699-88qld" event={"ID":"1f53b4f0-98c2-46a9-9c06-3ff1268fd130","Type":"ContainerDied","Data":"448e4df1f4ea39c4d3e8c66b58b13ad82812f38890d8db4b23370b4060ff25d2"}
Jul 31 00:11:05.700146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.699699    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b78b8b699-88qld"
Jul 31 00:11:05.700146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.699780    2555 scope.go:117] "RemoveContainer" containerID="08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973"
Jul 31 00:11:05.708365 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.708350    2555 scope.go:117] "RemoveContainer" containerID="08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973"
Jul 31 00:11:05.708653 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:11:05.708633    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973\": container with ID starting with 08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973 not found: ID does not exist" containerID="08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973"
Jul 31 00:11:05.708720 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.708660    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973"} err="failed to get container status \"08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973\": rpc error: code = NotFound desc = could not find container \"08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973\": container with ID starting with 08c608dcb826e30f2414e8a9a07fb246bc60e874a665a2d17dc02b163b1b5973 not found: ID does not exist"
Jul 31 00:11:05.720828 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.720807    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b78b8b699-88qld"]
Jul 31 00:11:05.724414 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.724393    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b78b8b699-88qld"]
Jul 31 00:11:05.865647 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.865619    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f53b4f0-98c2-46a9-9c06-3ff1268fd130" path="/var/lib/kubelet/pods/1f53b4f0-98c2-46a9-9c06-3ff1268fd130/volumes"
Jul 31 00:11:05.891352 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.891325    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-tls\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:05.893683 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:05.893662    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2d774ba-82fd-482f-b688-4a47ddd87816-node-exporter-tls\") pod \"node-exporter-d9cz8\" (UID: \"c2d774ba-82fd-482f-b688-4a47ddd87816\") " pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:06.127497 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:06.127420    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d9cz8"
Jul 31 00:11:06.137711 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:11:06.137684    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d774ba_82fd_482f_b688_4a47ddd87816.slice/crio-d7fcebdf281040a27eb3dbe9fe9a84542e518a13b83d215d3f5fc58126c9845f WatchSource:0}: Error finding container d7fcebdf281040a27eb3dbe9fe9a84542e518a13b83d215d3f5fc58126c9845f: Status 404 returned error can't find the container with id d7fcebdf281040a27eb3dbe9fe9a84542e518a13b83d215d3f5fc58126c9845f
Jul 31 00:11:06.705644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:06.705599    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9cz8" event={"ID":"c2d774ba-82fd-482f-b688-4a47ddd87816","Type":"ContainerStarted","Data":"d7fcebdf281040a27eb3dbe9fe9a84542e518a13b83d215d3f5fc58126c9845f"}
Jul 31 00:11:07.060730 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.060708    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:11:07.060865 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.060793    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:11:07.065597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.065578    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:11:07.213780 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.213729    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"]
Jul 31 00:11:07.216428 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.216407    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.218598 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218576    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 31 00:11:07.218598 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218577    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 31 00:11:07.218815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2j8mf6os4lo0a\""
Jul 31 00:11:07.218815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218685    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 31 00:11:07.218815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vsk97\""
Jul 31 00:11:07.218815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218726    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 31 00:11:07.218815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.218728    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 31 00:11:07.230168 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.230147    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"]
Jul 31 00:11:07.300129 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300063    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-metrics-client-ca\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300129 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300096    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhhdg\" (UniqueName: \"kubernetes.io/projected/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-kube-api-access-bhhdg\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300316 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300133    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300316 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300158    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-grpc-tls\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300316 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300221    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300316 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300265    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300316 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300286    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-tls\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.300523 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.300380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400702    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-metrics-client-ca\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400744    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhhdg\" (UniqueName: \"kubernetes.io/projected/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-kube-api-access-bhhdg\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400791    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400810    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-grpc-tls\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400837    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400862    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400890    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-tls\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.400989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.400940    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.401569 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.401516    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-metrics-client-ca\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.403411 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.403391    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.403508 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.403485    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.403878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.403856    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.404058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.404040    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-tls\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.404117 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.404041    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-grpc-tls\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.404117 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.404045    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.407641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.407620    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhhdg\" (UniqueName: \"kubernetes.io/projected/efebb5a1-3e39-4c63-9fc4-49b9eb177bff-kube-api-access-bhhdg\") pod \"thanos-querier-7bcbb74d8f-5g6rf\" (UID: \"efebb5a1-3e39-4c63-9fc4-49b9eb177bff\") " pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.525891 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.525850    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:07.653436 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.653403    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"]
Jul 31 00:11:07.657495 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:11:07.657466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefebb5a1_3e39_4c63_9fc4_49b9eb177bff.slice/crio-e247ffefe009899f1e4f09d47ccbd9c09baf9375b1698a799a3b0c8e9eec7091 WatchSource:0}: Error finding container e247ffefe009899f1e4f09d47ccbd9c09baf9375b1698a799a3b0c8e9eec7091: Status 404 returned error can't find the container with id e247ffefe009899f1e4f09d47ccbd9c09baf9375b1698a799a3b0c8e9eec7091
Jul 31 00:11:07.710549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.710521    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"e247ffefe009899f1e4f09d47ccbd9c09baf9375b1698a799a3b0c8e9eec7091"}
Jul 31 00:11:07.712076 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.712057    2555 generic.go:356] "Generic (PLEG): container finished" podID="c2d774ba-82fd-482f-b688-4a47ddd87816" containerID="3e85f87e1c2b39c8ba7a043aefb64cf429db2cebdace257832338585b422abf9" exitCode=0
Jul 31 00:11:07.712173 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.712149    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9cz8" event={"ID":"c2d774ba-82fd-482f-b688-4a47ddd87816","Type":"ContainerDied","Data":"3e85f87e1c2b39c8ba7a043aefb64cf429db2cebdace257832338585b422abf9"}
Jul 31 00:11:07.716227 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:07.716211    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:11:08.718658 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:08.718619    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9cz8" event={"ID":"c2d774ba-82fd-482f-b688-4a47ddd87816","Type":"ContainerStarted","Data":"c56ea41094a880dc8246c69965c6fa9ec930499c83cac837b16f8b6ffe23693e"}
Jul 31 00:11:08.719114 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:08.718690    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9cz8" event={"ID":"c2d774ba-82fd-482f-b688-4a47ddd87816","Type":"ContainerStarted","Data":"ee0006a1c368c3e9a3b023d711c5d9faca9813bc0ec7ab839dcedc7b32f6167f"}
Jul 31 00:11:08.738867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:08.738819    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d9cz8" podStartSLOduration=2.807512001 podStartE2EDuration="3.738804198s" totalImagesPullingTime="857.652881ms" totalInitContainerRuntime="73.639316ms" isStatefulPod=true podCreationTimestamp="2026-07-31 00:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:08.737359793 +0000 UTC m=+273.461325785" watchObservedRunningTime="2026-07-31 00:11:08.738804198 +0000 UTC m=+273.462770164"
Jul 31 00:11:10.729501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:10.729459    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"388f9d46124f05c0d4882e5c8ee772e9c29d8c28d3602015f019b298f47ba460"}
Jul 31 00:11:10.729918 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:10.729534    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"19637d4c71095018c2c0b787b8a7b6617b46c7981a548981673cd945a195766e"}
Jul 31 00:11:10.729918 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:10.729560    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"cd41c72e4aefb311c4ebffb925a063874040f7730ed9deb2dfd5ae70ddc4ca13"}
Jul 31 00:11:11.400872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.400788    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:11:11.404597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.404576    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.406912 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.406881    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 31 00:11:11.407028 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.406975    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 31 00:11:11.407028 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.406981    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 31 00:11:11.407317 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407300    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 00:11:11.407365 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407344    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 31 00:11:11.407365 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407358    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 31 00:11:11.407454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407304    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 31 00:11:11.407587 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407555    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 31 00:11:11.407651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407581    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 31 00:11:11.407831 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407810    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 31 00:11:11.407925 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407837    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 31 00:11:11.407925 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.407850    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 31 00:11:11.408038 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.408020    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bdi6prtkanhak\""
Jul 31 00:11:11.408073 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.408057    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 31 00:11:11.408124 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.408112    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 31 00:11:11.408350 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.408338    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tnc87\""
Jul 31 00:11:11.410888 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.410871    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 31 00:11:11.420113 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.420093    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:11:11.432618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432591    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432624    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432799 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432731    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432799 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432777    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432799 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432794    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432896 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432812    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ltfn\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-kube-api-access-6ltfn\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432896 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432865    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432955 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432895    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432955 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432925    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.432955 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432943    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432970    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.432991    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433045    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433187 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433098    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433187 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433123    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433187 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433142    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433187 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433165    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433312 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433187    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.433312 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.433223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534448 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534448 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534471    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534493    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534515    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534567    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534664    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534685    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534707    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ltfn\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-kube-api-access-6ltfn\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534809    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534839    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534862    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534886    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534910    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.534948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534939    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.535431 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.534972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.535431 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.535326    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.535526 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.535429    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.536126 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.536098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.537031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.536596    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.537031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.536897    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.538457 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.538415    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.538546 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.538496    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.538672 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.538560    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.538962 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.538939    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.539616 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.539274    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.539616 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.539578    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.540201 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.540172    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.540392 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.540331    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.540821 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.540791    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.540893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.540863    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.541117 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.541098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.541237 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.541218    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.541477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.541456    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.541771 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.541729    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.543025 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.543010    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ltfn\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-kube-api-access-6ltfn\") pod \"prometheus-k8s-0\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.715740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.715711    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:11.737002 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.736978    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"7a59777374ccf4eebf7150d7552aa9d206b334c8ea8588f468630b8af65efa3d"}
Jul 31 00:11:11.737291 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.737044    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"7121faa53b7f52e902555b55b0f42f485b6fc7fbfd7d4046e8ee7e55109ac058"}
Jul 31 00:11:11.737291 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.737074    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" event={"ID":"efebb5a1-3e39-4c63-9fc4-49b9eb177bff","Type":"ContainerStarted","Data":"c8474b755a3da90971b0cf0cd27fa3626ae5782cdb5d05c793a2cb0f7459f0f5"}
Jul 31 00:11:11.737291 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.737137    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:11.765652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.765602    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf" podStartSLOduration=1.5821722870000001 podStartE2EDuration="4.765585577s" totalImagesPullingTime="3.18341329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:11:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:11.760201855 +0000 UTC m=+276.484167823" watchObservedRunningTime="2026-07-31 00:11:11.765585577 +0000 UTC m=+276.489551543"
Jul 31 00:11:11.781362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.781323    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f77bb8946-9js5w"]
Jul 31 00:11:11.786501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.786476    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.792512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.792081    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f77bb8946-9js5w"]
Jul 31 00:11:11.793394 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.793314    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 00:11:11.836557 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.836527    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-oauth-serving-cert\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.836677 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.836652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-oauth-config\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.836747 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.836730    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-service-ca\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.836834 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.836793    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-trusted-ca-bundle\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.836986 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.836914    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-serving-cert\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.837107 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.836969    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-config\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.837107 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.837096    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9q64\" (UniqueName: \"kubernetes.io/projected/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-kube-api-access-r9q64\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.861326 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.861303    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:11:11.864470 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:11:11.864448    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a1aab8_17a0_4e24_b971_fcac87465eb3.slice/crio-0ccf80919fc94a89b551c444f15e7f02e6b86b6542bbf97e1438c035a32ec75c WatchSource:0}: Error finding container 0ccf80919fc94a89b551c444f15e7f02e6b86b6542bbf97e1438c035a32ec75c: Status 404 returned error can't find the container with id 0ccf80919fc94a89b551c444f15e7f02e6b86b6542bbf97e1438c035a32ec75c
Jul 31 00:11:11.938314 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938284    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-service-ca\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.938426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938320    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-trusted-ca-bundle\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.938426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938362    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-serving-cert\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.938426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-config\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.938426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938406    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9q64\" (UniqueName: \"kubernetes.io/projected/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-kube-api-access-r9q64\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.938572 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938432    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-oauth-serving-cert\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.938572 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.938549    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-oauth-config\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.939143 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.939116    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-service-ca\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.939262 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.939157    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-config\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.939394 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.939370    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-oauth-serving-cert\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.939483 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.939460    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-trusted-ca-bundle\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.940935 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.940914    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-serving-cert\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.941021 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.940990    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-oauth-config\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:11.945417 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:11.945400    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9q64\" (UniqueName: \"kubernetes.io/projected/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-kube-api-access-r9q64\") pod \"console-7f77bb8946-9js5w\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") " pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:12.098154 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:12.098085    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:12.222502 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:12.222476    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f77bb8946-9js5w"]
Jul 31 00:11:12.225090 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:11:12.225060    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac86db1e_a5d4_4a40_8737_eaa2201e6a43.slice/crio-23c101b6f56a3d134374c3bb06bead91c08882d39de67d702268954dae2b4b78 WatchSource:0}: Error finding container 23c101b6f56a3d134374c3bb06bead91c08882d39de67d702268954dae2b4b78: Status 404 returned error can't find the container with id 23c101b6f56a3d134374c3bb06bead91c08882d39de67d702268954dae2b4b78
Jul 31 00:11:12.743964 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:12.743926    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"0ccf80919fc94a89b551c444f15e7f02e6b86b6542bbf97e1438c035a32ec75c"}
Jul 31 00:11:12.745833 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:12.745805    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f77bb8946-9js5w" event={"ID":"ac86db1e-a5d4-4a40-8737-eaa2201e6a43","Type":"ContainerStarted","Data":"0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104"}
Jul 31 00:11:12.745969 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:12.745861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f77bb8946-9js5w" event={"ID":"ac86db1e-a5d4-4a40-8737-eaa2201e6a43","Type":"ContainerStarted","Data":"23c101b6f56a3d134374c3bb06bead91c08882d39de67d702268954dae2b4b78"}
Jul 31 00:11:12.762125 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:12.762072    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f77bb8946-9js5w" podStartSLOduration=1.7620530840000002 podStartE2EDuration="1.762053084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:12.76040073 +0000 UTC m=+277.484366717" watchObservedRunningTime="2026-07-31 00:11:12.762053084 +0000 UTC m=+277.486019044"
Jul 31 00:11:13.750674 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:13.750643    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25" exitCode=0
Jul 31 00:11:13.751073 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:13.750743    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"}
Jul 31 00:11:16.352124 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:11:16.352091    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vfqzp" podUID="07143eab-2b8d-42bb-b999-98fff8133c4f"
Jul 31 00:11:16.761512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:16.761480    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:11:17.756243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.756218    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bcbb74d8f-5g6rf"
Jul 31 00:11:17.768404 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.768354    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"}
Jul 31 00:11:17.768551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.768433    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"}
Jul 31 00:11:17.768551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.768458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"}
Jul 31 00:11:17.768551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.768481    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"}
Jul 31 00:11:17.768551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.768504    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"}
Jul 31 00:11:17.768551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.768525    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerStarted","Data":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"}
Jul 31 00:11:17.823168 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:17.823109    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.296505237 podStartE2EDuration="6.823088416s" totalImagesPullingTime="4.507965558s" totalInitContainerRuntime="18.617621ms" isStatefulPod=false podCreationTimestamp="2026-07-31 00:11:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:17.821731311 +0000 UTC m=+282.545697309" watchObservedRunningTime="2026-07-31 00:11:17.823088416 +0000 UTC m=+282.547054383"
Jul 31 00:11:19.909243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:19.909208    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:11:19.911645 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:19.911617    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07143eab-2b8d-42bb-b999-98fff8133c4f-metrics-tls\") pod \"dns-default-vfqzp\" (UID: \"07143eab-2b8d-42bb-b999-98fff8133c4f\") " pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:11:20.064510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:20.064475    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnjn4\""
Jul 31 00:11:20.073580 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:20.073552    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:11:20.203927 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:20.203738    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vfqzp"]
Jul 31 00:11:20.206423 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:11:20.206399    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07143eab_2b8d_42bb_b999_98fff8133c4f.slice/crio-c7a02a0a8a89226d97d18380511beb8afd7140c7af57f4907c8b35e1415fed0e WatchSource:0}: Error finding container c7a02a0a8a89226d97d18380511beb8afd7140c7af57f4907c8b35e1415fed0e: Status 404 returned error can't find the container with id c7a02a0a8a89226d97d18380511beb8afd7140c7af57f4907c8b35e1415fed0e
Jul 31 00:11:20.781838 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:20.781804    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vfqzp" event={"ID":"07143eab-2b8d-42bb-b999-98fff8133c4f","Type":"ContainerStarted","Data":"c7a02a0a8a89226d97d18380511beb8afd7140c7af57f4907c8b35e1415fed0e"}
Jul 31 00:11:21.716810 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:21.716777    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:11:22.098523 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.098441    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:22.098523 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.098516    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:22.104451 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.104422    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:22.792218 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.792186    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vfqzp" event={"ID":"07143eab-2b8d-42bb-b999-98fff8133c4f","Type":"ContainerStarted","Data":"e9b5e6a8bff37b38535c99bfeec68dab14fb9879e446b70cc4dd24738e3b1b2d"}
Jul 31 00:11:22.792680 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.792241    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vfqzp" event={"ID":"07143eab-2b8d-42bb-b999-98fff8133c4f","Type":"ContainerStarted","Data":"4a34d85fdad32b12163d819489211ec7e7b55690c0a4131e91d385113dcb4c73"}
Jul 31 00:11:22.796255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.796236    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:11:22.808170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.808100    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vfqzp" podStartSLOduration=250.803999346 podStartE2EDuration="4m12.808081637s" totalImagesPullingTime="2.004082291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:22.807970578 +0000 UTC m=+287.531936567" watchObservedRunningTime="2026-07-31 00:11:22.808081637 +0000 UTC m=+287.532047606"
Jul 31 00:11:22.862567 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:22.862543    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb7c4464b-g6rvr"]
Jul 31 00:11:23.797256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:23.797229    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:11:28.817418 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:28.817384    2555 generic.go:356] "Generic (PLEG): container finished" podID="43412d3c-1163-4e1d-b861-9a8c395365a8" containerID="8ce5dae0697613551e98355d52c1deb8d42d8fcccf56527e6f55517437ba4b6b" exitCode=0
Jul 31 00:11:28.817816 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:28.817458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt" event={"ID":"43412d3c-1163-4e1d-b861-9a8c395365a8","Type":"ContainerDied","Data":"8ce5dae0697613551e98355d52c1deb8d42d8fcccf56527e6f55517437ba4b6b"}
Jul 31 00:11:28.817816 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:28.817787    2555 scope.go:117] "RemoveContainer" containerID="8ce5dae0697613551e98355d52c1deb8d42d8fcccf56527e6f55517437ba4b6b"
Jul 31 00:11:29.822818 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:29.822787    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-k56wt" event={"ID":"43412d3c-1163-4e1d-b861-9a8c395365a8","Type":"ContainerStarted","Data":"298777ca9b4cabd758efeb373eb8543119533077572f5634b96be4a0166fcb04"}
Jul 31 00:11:33.803778 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:33.803727    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vfqzp"
Jul 31 00:11:35.721081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:35.721061    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 00:11:43.875145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:43.875113    2555 generic.go:356] "Generic (PLEG): container finished" podID="e3b1c460-362a-4b58-bbfd-174feefcb94f" containerID="db32dbf29e6d676fac9c76193e719609c07c8ff81e38db32b1d130eab6289897" exitCode=0
Jul 31 00:11:43.875540 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:43.875159    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq" event={"ID":"e3b1c460-362a-4b58-bbfd-174feefcb94f","Type":"ContainerDied","Data":"db32dbf29e6d676fac9c76193e719609c07c8ff81e38db32b1d130eab6289897"}
Jul 31 00:11:43.875540 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:43.875435    2555 scope.go:117] "RemoveContainer" containerID="db32dbf29e6d676fac9c76193e719609c07c8ff81e38db32b1d130eab6289897"
Jul 31 00:11:44.880512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:44.880479    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-p4wjq" event={"ID":"e3b1c460-362a-4b58-bbfd-174feefcb94f","Type":"ContainerStarted","Data":"890ac05577dae1e8ded9afaff8cb151a751136dcf0564c558a72f280b0b6fd0e"}
Jul 31 00:11:47.882400 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:47.882343    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cb7c4464b-g6rvr" podUID="82394b09-7e86-4956-b98b-53e18aed1a42" containerName="console" containerID="cri-o://530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b" gracePeriod=15
Jul 31 00:11:48.164597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.164538    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:11:48.353923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.353891    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxbqw\" (UniqueName: \"kubernetes.io/projected/82394b09-7e86-4956-b98b-53e18aed1a42-kube-api-access-kxbqw\") pod \"82394b09-7e86-4956-b98b-53e18aed1a42\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") "
Jul 31 00:11:48.354115 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.353936    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-oauth-config\") pod \"82394b09-7e86-4956-b98b-53e18aed1a42\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") "
Jul 31 00:11:48.354115 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.353965    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-serving-cert\") pod \"82394b09-7e86-4956-b98b-53e18aed1a42\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") "
Jul 31 00:11:48.354115 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.354031    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-oauth-serving-cert\") pod \"82394b09-7e86-4956-b98b-53e18aed1a42\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") "
Jul 31 00:11:48.354115 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.354056    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-console-config\") pod \"82394b09-7e86-4956-b98b-53e18aed1a42\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") "
Jul 31 00:11:48.354115 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.354093    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-service-ca\") pod \"82394b09-7e86-4956-b98b-53e18aed1a42\" (UID: \"82394b09-7e86-4956-b98b-53e18aed1a42\") "
Jul 31 00:11:48.354478 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.354453    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82394b09-7e86-4956-b98b-53e18aed1a42" (UID: "82394b09-7e86-4956-b98b-53e18aed1a42"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:48.354549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.354450    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-console-config" (OuterVolumeSpecName: "console-config") pod "82394b09-7e86-4956-b98b-53e18aed1a42" (UID: "82394b09-7e86-4956-b98b-53e18aed1a42"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:48.354549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.354517    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-service-ca" (OuterVolumeSpecName: "service-ca") pod "82394b09-7e86-4956-b98b-53e18aed1a42" (UID: "82394b09-7e86-4956-b98b-53e18aed1a42"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:48.356417 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.356389    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82394b09-7e86-4956-b98b-53e18aed1a42" (UID: "82394b09-7e86-4956-b98b-53e18aed1a42"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:11:48.356510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.356445    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82394b09-7e86-4956-b98b-53e18aed1a42-kube-api-access-kxbqw" (OuterVolumeSpecName: "kube-api-access-kxbqw") pod "82394b09-7e86-4956-b98b-53e18aed1a42" (UID: "82394b09-7e86-4956-b98b-53e18aed1a42"). InnerVolumeSpecName "kube-api-access-kxbqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:48.356645 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.356630    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82394b09-7e86-4956-b98b-53e18aed1a42" (UID: "82394b09-7e86-4956-b98b-53e18aed1a42"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:11:48.454699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.454673    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxbqw\" (UniqueName: \"kubernetes.io/projected/82394b09-7e86-4956-b98b-53e18aed1a42-kube-api-access-kxbqw\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:48.454699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.454695    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-oauth-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:48.454699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.454704    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82394b09-7e86-4956-b98b-53e18aed1a42-console-serving-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:48.454914 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.454713    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-oauth-serving-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:48.454914 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.454722    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-console-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:48.454914 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.454731    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82394b09-7e86-4956-b98b-53e18aed1a42-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:11:48.896379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.896290    2555 generic.go:356] "Generic (PLEG): container finished" podID="82394b09-7e86-4956-b98b-53e18aed1a42" containerID="530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b" exitCode=0
Jul 31 00:11:48.896379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.896332    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7c4464b-g6rvr"
Jul 31 00:11:48.896379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.896335    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7c4464b-g6rvr" event={"ID":"82394b09-7e86-4956-b98b-53e18aed1a42","Type":"ContainerDied","Data":"530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b"}
Jul 31 00:11:48.896999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.896384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7c4464b-g6rvr" event={"ID":"82394b09-7e86-4956-b98b-53e18aed1a42","Type":"ContainerDied","Data":"9dc412ed8e57bd61f9b7185a7afd0cfa2fe07aeca5dc67f9c2f5a2aad9388ea3"}
Jul 31 00:11:48.896999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.896410    2555 scope.go:117] "RemoveContainer" containerID="530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b"
Jul 31 00:11:48.907549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.907531    2555 scope.go:117] "RemoveContainer" containerID="530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b"
Jul 31 00:11:48.907964 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:11:48.907938    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b\": container with ID starting with 530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b not found: ID does not exist" containerID="530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b"
Jul 31 00:11:48.908066 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.907977    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b"} err="failed to get container status \"530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b\": rpc error: code = NotFound desc = could not find container \"530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b\": container with ID starting with 530a15ebd31cd57276772de02575c4ea90b114df23096722b1d4c1f2b602867b not found: ID does not exist"
Jul 31 00:11:48.916510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.916480    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb7c4464b-g6rvr"]
Jul 31 00:11:48.919805 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:48.919732    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cb7c4464b-g6rvr"]
Jul 31 00:11:49.866420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:11:49.866385    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82394b09-7e86-4956-b98b-53e18aed1a42" path="/var/lib/kubelet/pods/82394b09-7e86-4956-b98b-53e18aed1a42/volumes"
Jul 31 00:12:11.715898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:11.715868    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:11.735497 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:11.735464    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:11.999876 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:11.999801    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:29.774066 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.773984    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:12:29.774589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.774319    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy" containerID="cri-o://35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5" gracePeriod=600
Jul 31 00:12:29.774589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.774366    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-web" containerID="cri-o://8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b" gracePeriod=600
Jul 31 00:12:29.774589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.774319    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2" gracePeriod=600
Jul 31 00:12:29.774589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.774332    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="prometheus" containerID="cri-o://f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93" gracePeriod=600
Jul 31 00:12:29.774589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.774401    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="config-reloader" containerID="cri-o://eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4" gracePeriod=600
Jul 31 00:12:29.774589 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:29.774366    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="thanos-sidecar" containerID="cri-o://1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c" gracePeriod=600
Jul 31 00:12:30.013342 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.013317    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.057551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057478    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2" exitCode=0
Jul 31 00:12:30.057551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057500    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5" exitCode=0
Jul 31 00:12:30.057551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057506    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b" exitCode=0
Jul 31 00:12:30.057551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057511    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c" exitCode=0
Jul 31 00:12:30.057551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057516    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4" exitCode=0
Jul 31 00:12:30.057551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057521    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93" exitCode=0
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057559    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057560    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"}
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057646    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"}
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057689    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"}
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057709    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057785    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"}
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057830    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"}
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057871    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"}
Jul 31 00:12:30.057987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.057914    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a1aab8-17a0-4e24-b971-fcac87465eb3","Type":"ContainerDied","Data":"0ccf80919fc94a89b551c444f15e7f02e6b86b6542bbf97e1438c035a32ec75c"}
Jul 31 00:12:30.066152 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.066134    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.073249 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.073233    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.080327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.080301    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.089339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.089320    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.096352 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.096336    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.103251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.103235    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.105341 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105322    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-0\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105435 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105364    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-kube-rbac-proxy\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105435 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105381    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-2\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105435 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105408    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-metrics-client-ca\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105435 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105426    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-db\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105739 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105711    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.105861 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105775    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-grpc-tls\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105861 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105826    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-serving-certs-ca-bundle\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105861    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105893    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-kubelet-serving-ca-bundle\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105936    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config-out\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.105970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105961    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106154 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.105997    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ltfn\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-kube-api-access-6ltfn\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106154 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106028    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.106154 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106034    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-1\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106154 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106099    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-thanos-prometheus-http-client-file\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106154 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106128    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-trusted-ca-bundle\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106155    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-tls-assets\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106183    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106218    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-web-config\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106253    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-tls\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106286    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-metrics-client-certs\") pod \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\" (UID: \"f3a1aab8-17a0-4e24-b971-fcac87465eb3\") "
Jul 31 00:12:30.106378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106309    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.106646 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106565    2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.106646 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106587    2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-metrics-client-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.106646 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106603    2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.106646 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106565    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:12:30.106863 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.106842    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.107678 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.107639    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.108229 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.108199    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.109087 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.109062    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:30.109192 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.108782    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.109329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.109302    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.109380 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.109327    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.110358 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.110322    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.110840 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.110809    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-kube-api-access-6ltfn" (OuterVolumeSpecName: "kube-api-access-6ltfn") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "kube-api-access-6ltfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:12:30.111492 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.111460    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config" (OuterVolumeSpecName: "config") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.111586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.111528    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.111651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.111602    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:12:30.111651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.111631    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config-out" (OuterVolumeSpecName: "config-out") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:12:30.111651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.111628    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.112076 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.112060    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.114050 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114034    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.114293 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.114276    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.114380 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114310    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"} err="failed to get container status \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist"
Jul 31 00:12:30.114380 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114327    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.114560 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.114542    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.114618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114570    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"} err="failed to get container status \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist"
Jul 31 00:12:30.114618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114593    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.114829 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.114814    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.114892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114834    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"} err="failed to get container status \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist"
Jul 31 00:12:30.114892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.114853    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.115075 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.115059    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.115119 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115080    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"} err="failed to get container status \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist"
Jul 31 00:12:30.115119 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115093    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.115281 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.115267    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.115320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115292    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"} err="failed to get container status \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist"
Jul 31 00:12:30.115320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115304    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.115524 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.115508    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.115585 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115531    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"} err="failed to get container status \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist"
Jul 31 00:12:30.115585 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115550    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.115801 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:12:30.115779    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.115901 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115808    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"} err="failed to get container status \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist"
Jul 31 00:12:30.115901 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.115824    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.116051 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116035    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"} err="failed to get container status \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist"
Jul 31 00:12:30.116097 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116051    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.116320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116297    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"} err="failed to get container status \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist"
Jul 31 00:12:30.116320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116319    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.116539 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116517    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"} err="failed to get container status \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist"
Jul 31 00:12:30.116579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116543    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.116806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116785    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"} err="failed to get container status \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist"
Jul 31 00:12:30.116806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.116804    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.117060 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117043    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"} err="failed to get container status \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist"
Jul 31 00:12:30.117060 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117060    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.117276 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117257    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"} err="failed to get container status \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist"
Jul 31 00:12:30.117330 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117277    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.117511 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117494    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"} err="failed to get container status \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist"
Jul 31 00:12:30.117511 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117510    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.117693 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117678    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"} err="failed to get container status \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist"
Jul 31 00:12:30.117742 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117693    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.117926 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117910    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"} err="failed to get container status \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist"
Jul 31 00:12:30.117980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.117928    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.118103 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118088    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"} err="failed to get container status \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist"
Jul 31 00:12:30.118151 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118103    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.118300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118274    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"} err="failed to get container status \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist"
Jul 31 00:12:30.118349 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118304    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.118555 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118536    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"} err="failed to get container status \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist"
Jul 31 00:12:30.118635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118556    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.118795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118773    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"} err="failed to get container status \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist"
Jul 31 00:12:30.118850 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.118798    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.119045 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119027    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"} err="failed to get container status \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist"
Jul 31 00:12:30.119093 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119045    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.119243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119229    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"} err="failed to get container status \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist"
Jul 31 00:12:30.119294 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119242    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.119459 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119439    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"} err="failed to get container status \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist"
Jul 31 00:12:30.119503 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119462    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.119662 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119643    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"} err="failed to get container status \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist"
Jul 31 00:12:30.119718 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119663    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.119891 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119876    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"} err="failed to get container status \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist"
Jul 31 00:12:30.119891 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.119890    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.120067 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120054    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"} err="failed to get container status \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist"
Jul 31 00:12:30.120103 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120067    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.120219 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120205    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"} err="failed to get container status \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist"
Jul 31 00:12:30.120260 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120218    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.120416 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120399    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"} err="failed to get container status \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist"
Jul 31 00:12:30.120454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120415    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.120636 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120612    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"} err="failed to get container status \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist"
Jul 31 00:12:30.120679 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120639    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.120894 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120875    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"} err="failed to get container status \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist"
Jul 31 00:12:30.120988 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.120893    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.121121 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121106    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"} err="failed to get container status \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist"
Jul 31 00:12:30.121166 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121122    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.121340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121315    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"} err="failed to get container status \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist"
Jul 31 00:12:30.121387 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121341    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.121565 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121548    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"} err="failed to get container status \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist"
Jul 31 00:12:30.121625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121567    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.121789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121772    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"} err="failed to get container status \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist"
Jul 31 00:12:30.121789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121788    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.121992 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121977    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"} err="failed to get container status \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist"
Jul 31 00:12:30.121992 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.121991    2555 scope.go:117] "RemoveContainer" containerID="78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"
Jul 31 00:12:30.122203 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122185    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2"} err="failed to get container status \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": rpc error: code = NotFound desc = could not find container \"78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2\": container with ID starting with 78be01ad9addb81ac1bb2c8b1dfe98050718da1ad278243237db0326782207a2 not found: ID does not exist"
Jul 31 00:12:30.122244 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122204    2555 scope.go:117] "RemoveContainer" containerID="35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"
Jul 31 00:12:30.122408 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122391    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5"} err="failed to get container status \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": rpc error: code = NotFound desc = could not find container \"35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5\": container with ID starting with 35297d9edbd1d06bb4d98b42cc8fea2e0e0a30631c58d7db4be9c4515e2df3f5 not found: ID does not exist"
Jul 31 00:12:30.122466 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122408    2555 scope.go:117] "RemoveContainer" containerID="8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"
Jul 31 00:12:30.122633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122616    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b"} err="failed to get container status \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": rpc error: code = NotFound desc = could not find container \"8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b\": container with ID starting with 8f17bbf37bfbf1fd6bd47ad4be59b1eb2edde0cddc9d569b9a5ffce15a974c8b not found: ID does not exist"
Jul 31 00:12:30.122684 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122634    2555 scope.go:117] "RemoveContainer" containerID="1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"
Jul 31 00:12:30.122684 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122646    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-web-config" (OuterVolumeSpecName: "web-config") pod "f3a1aab8-17a0-4e24-b971-fcac87465eb3" (UID: "f3a1aab8-17a0-4e24-b971-fcac87465eb3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:30.122872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122855    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c"} err="failed to get container status \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": rpc error: code = NotFound desc = could not find container \"1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c\": container with ID starting with 1febd00318740a7f618307d421ebacdd886e27beffc0f680d8371347e76ef95c not found: ID does not exist"
Jul 31 00:12:30.122911 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.122872    2555 scope.go:117] "RemoveContainer" containerID="eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"
Jul 31 00:12:30.123069 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.123054    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4"} err="failed to get container status \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": rpc error: code = NotFound desc = could not find container \"eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4\": container with ID starting with eae079aefc13790876c161cb748e865515eeb235aca68f40028599b4ffd43fa4 not found: ID does not exist"
Jul 31 00:12:30.123110 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.123069    2555 scope.go:117] "RemoveContainer" containerID="f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"
Jul 31 00:12:30.123242 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.123227    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93"} err="failed to get container status \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": rpc error: code = NotFound desc = could not find container \"f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93\": container with ID starting with f74260e13002e6c632ceb71d8533b29c9d303d18ab92cf58dab896548bf09a93 not found: ID does not exist"
Jul 31 00:12:30.123291 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.123242    2555 scope.go:117] "RemoveContainer" containerID="1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"
Jul 31 00:12:30.123439 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.123425    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25"} err="failed to get container status \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": rpc error: code = NotFound desc = could not find container \"1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25\": container with ID starting with 1f2c1d2550016f949dd1c92f9b404e7bcd86853acaf2f4a7d92ab0669f49ef25 not found: ID does not exist"
Jul 31 00:12:30.207079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207035    2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207076    2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-metrics-client-certs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207090    2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207102    2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-kube-rbac-proxy\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207114    2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-k8s-db\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207126    2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-grpc-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207138    2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207150    2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207162    2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207175    2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config-out\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207187    2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207199    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ltfn\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-kube-api-access-6ltfn\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207211    2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207224    2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1aab8-17a0-4e24-b971-fcac87465eb3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207239    2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a1aab8-17a0-4e24-b971-fcac87465eb3-tls-assets\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207252    2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.207322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.207292    2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a1aab8-17a0-4e24-b971-fcac87465eb3-web-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:12:30.378997 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.378965    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:12:30.387300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.387276    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:12:30.410514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410488    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:12:30.410789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410775    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-web"
Jul 31 00:12:30.410789 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410790    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-web"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410803    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-thanos"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410809    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-thanos"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410816    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="thanos-sidecar"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410822    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="thanos-sidecar"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410828    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="init-config-reloader"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410833    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="init-config-reloader"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410838    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="config-reloader"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410843    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="config-reloader"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410852    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410857    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410866    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82394b09-7e86-4956-b98b-53e18aed1a42" containerName="console"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410870    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="82394b09-7e86-4956-b98b-53e18aed1a42" containerName="console"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410876    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="prometheus"
Jul 31 00:12:30.410878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410881    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="prometheus"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410923    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-thanos"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410931    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="82394b09-7e86-4956-b98b-53e18aed1a42" containerName="console"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410936    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="thanos-sidecar"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410941    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="config-reloader"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410947    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410952    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="prometheus"
Jul 31 00:12:30.411256 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.410958    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" containerName="kube-rbac-proxy-web"
Jul 31 00:12:30.416006 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.415988    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.417858 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.417836    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 31 00:12:30.418019 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418003    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 31 00:12:30.418138 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418121    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 31 00:12:30.418231 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418218    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 31 00:12:30.418457 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418437    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 31 00:12:30.418554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418437    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 31 00:12:30.418554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418478    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bdi6prtkanhak\""
Jul 31 00:12:30.418554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418487    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 31 00:12:30.418822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418807    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tnc87\""
Jul 31 00:12:30.419011 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.418990    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 31 00:12:30.419271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.419123    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 31 00:12:30.419271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.419161    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 31 00:12:30.419271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.419199    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 00:12:30.419271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.419247    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 31 00:12:30.419728 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.419711    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 31 00:12:30.422005 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.421986    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 31 00:12:30.428597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.427634    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 31 00:12:30.430954 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.430932    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:12:30.509703 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509675    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509856 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509707    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509856 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509728    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509856 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509858    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dbc0765-0c11-474b-8ce5-463c1dc589d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509886    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509913    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509930    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.509985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509964    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.509984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7jbz\" (UniqueName: \"kubernetes.io/projected/1dbc0765-0c11-474b-8ce5-463c1dc589d2-kube-api-access-p7jbz\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510005    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510032    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510073    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510098    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dbc0765-0c11-474b-8ce5-463c1dc589d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510115    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510131    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510147    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510166    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.510327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.510195    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-config\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610588 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610558    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610776 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610589    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610776 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610609    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610775    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610821    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7jbz\" (UniqueName: \"kubernetes.io/projected/1dbc0765-0c11-474b-8ce5-463c1dc589d2-kube-api-access-p7jbz\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610853    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.610903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610891    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610924    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610949    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.610982    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dbc0765-0c11-474b-8ce5-463c1dc589d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611007    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611027    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611035    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611086    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611114    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-config\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611164    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611255    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611284    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611298    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dbc0765-0c11-474b-8ce5-463c1dc589d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611863 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611567    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.611917 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611875    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.612017 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.611992    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.612798 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.612775    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.613613 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.613588    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616119    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-config\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616343    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dbc0765-0c11-474b-8ce5-463c1dc589d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616402    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616457    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616717 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616501    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616717 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616544    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dbc0765-0c11-474b-8ce5-463c1dc589d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616717 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616601    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.616908 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.616890    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1dbc0765-0c11-474b-8ce5-463c1dc589d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.617036 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.617017    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.617079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.617020    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.617079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.617046    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.617153 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.617042    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1dbc0765-0c11-474b-8ce5-463c1dc589d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.618629 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.618614    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7jbz\" (UniqueName: \"kubernetes.io/projected/1dbc0765-0c11-474b-8ce5-463c1dc589d2-kube-api-access-p7jbz\") pod \"prometheus-k8s-0\" (UID: \"1dbc0765-0c11-474b-8ce5-463c1dc589d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.731120 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.731099    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:30.866902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:30.866604    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 00:12:30.869414 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:12:30.869388    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbc0765_0c11_474b_8ce5_463c1dc589d2.slice/crio-54e47690e12174b20d21a9db515fa67b223a74283c1478ff6adba13990bf12dd WatchSource:0}: Error finding container 54e47690e12174b20d21a9db515fa67b223a74283c1478ff6adba13990bf12dd: Status 404 returned error can't find the container with id 54e47690e12174b20d21a9db515fa67b223a74283c1478ff6adba13990bf12dd
Jul 31 00:12:31.063175 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:31.063143    2555 generic.go:356] "Generic (PLEG): container finished" podID="1dbc0765-0c11-474b-8ce5-463c1dc589d2" containerID="cafedb069041d913128a8b206d940829ef2bcebde7c8a438f2af27eb2c797438" exitCode=0
Jul 31 00:12:31.063321 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:31.063233    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerDied","Data":"cafedb069041d913128a8b206d940829ef2bcebde7c8a438f2af27eb2c797438"}
Jul 31 00:12:31.063321 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:31.063307    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"54e47690e12174b20d21a9db515fa67b223a74283c1478ff6adba13990bf12dd"}
Jul 31 00:12:31.866215 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:31.866183    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a1aab8-17a0-4e24-b971-fcac87465eb3" path="/var/lib/kubelet/pods/f3a1aab8-17a0-4e24-b971-fcac87465eb3/volumes"
Jul 31 00:12:32.071014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.070936    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"ca98f72497cc1408be472a9a0d982dcd217de430a2c968f4171cfc364580a61f"}
Jul 31 00:12:32.071014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.070995    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"c6b7a5eb077e32a11323e9cf157126399e7777786dff51bf58a8df9c19497497"}
Jul 31 00:12:32.071391 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.071020    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"c1d2129332d37269e317187dafce538eec6392bb50f27737f4a398bc22a19d0a"}
Jul 31 00:12:32.071391 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.071046    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"465c85e19a3b6bf9eb27369f51539ba2b2a9898c00edca1adb0f2e75f8ab6f6f"}
Jul 31 00:12:32.071391 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.071068    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"36feff7eaed72513f687b9ca4926abde9d583b86c1163321da110f56e346f7b7"}
Jul 31 00:12:32.071391 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.071098    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dbc0765-0c11-474b-8ce5-463c1dc589d2","Type":"ContainerStarted","Data":"c047a61e56701dbd39cd2f4ba190cc1edeea9555d6e63b8696d156b1094d09fb"}
Jul 31 00:12:32.094660 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:32.094618    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.075513483 podStartE2EDuration="2.094603085s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.089602ms" isStatefulPod=false podCreationTimestamp="2026-07-31 00:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:12:32.093281458 +0000 UTC m=+356.817247435" watchObservedRunningTime="2026-07-31 00:12:32.094603085 +0000 UTC m=+356.818569052"
Jul 31 00:12:35.732102 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:35.732081    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:12:44.333472 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:12:44.333442    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f77bb8946-9js5w"]
Jul 31 00:13:09.352672 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.352632    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f77bb8946-9js5w" podUID="ac86db1e-a5d4-4a40-8737-eaa2201e6a43" containerName="console" containerID="cri-o://0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104" gracePeriod=15
Jul 31 00:13:09.596514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.596488    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:13:09.706137 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706092    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-oauth-serving-cert\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706144    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-config\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706180    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9q64\" (UniqueName: \"kubernetes.io/projected/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-kube-api-access-r9q64\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706234    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-service-ca\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706285    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-serving-cert\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706314    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-oauth-config\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706356    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-trusted-ca-bundle\") pod \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\" (UID: \"ac86db1e-a5d4-4a40-8737-eaa2201e6a43\") "
Jul 31 00:13:09.706844 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706563    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:13:09.706844 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706726    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-service-ca" (OuterVolumeSpecName: "service-ca") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:13:09.706949 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706837    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:13:09.706949 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.706912    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-config" (OuterVolumeSpecName: "console-config") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:13:09.708804 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.708744    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:13:09.708912 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.708808    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-kube-api-access-r9q64" (OuterVolumeSpecName: "kube-api-access-r9q64") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "kube-api-access-r9q64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:13:09.708912 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.708870    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ac86db1e-a5d4-4a40-8737-eaa2201e6a43" (UID: "ac86db1e-a5d4-4a40-8737-eaa2201e6a43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:13:09.807586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807550    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9q64\" (UniqueName: \"kubernetes.io/projected/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-kube-api-access-r9q64\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:09.807586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807581    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:09.807586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807591    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-serving-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:09.807806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807601    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-oauth-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:09.807806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807610    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-trusted-ca-bundle\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:09.807806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807618    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-oauth-serving-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:09.807806 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:09.807626    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac86db1e-a5d4-4a40-8737-eaa2201e6a43-console-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:13:10.224300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.224267    2555 generic.go:356] "Generic (PLEG): container finished" podID="ac86db1e-a5d4-4a40-8737-eaa2201e6a43" containerID="0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104" exitCode=0
Jul 31 00:13:10.224496 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.224316    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f77bb8946-9js5w"
Jul 31 00:13:10.224496 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.224360    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f77bb8946-9js5w" event={"ID":"ac86db1e-a5d4-4a40-8737-eaa2201e6a43","Type":"ContainerDied","Data":"0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104"}
Jul 31 00:13:10.224496 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.224414    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f77bb8946-9js5w" event={"ID":"ac86db1e-a5d4-4a40-8737-eaa2201e6a43","Type":"ContainerDied","Data":"23c101b6f56a3d134374c3bb06bead91c08882d39de67d702268954dae2b4b78"}
Jul 31 00:13:10.224496 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.224438    2555 scope.go:117] "RemoveContainer" containerID="0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104"
Jul 31 00:13:10.234447 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.234427    2555 scope.go:117] "RemoveContainer" containerID="0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104"
Jul 31 00:13:10.234690 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:13:10.234672    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104\": container with ID starting with 0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104 not found: ID does not exist" containerID="0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104"
Jul 31 00:13:10.234727 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.234699    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104"} err="failed to get container status \"0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104\": rpc error: code = NotFound desc = could not find container \"0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104\": container with ID starting with 0942c34f444ec9bd1bc46d0b197566dc4954948173a1ce47f9f9c03871800104 not found: ID does not exist"
Jul 31 00:13:10.239398 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.239376    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f77bb8946-9js5w"]
Jul 31 00:13:10.244338 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:10.244305    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f77bb8946-9js5w"]
Jul 31 00:13:11.865809 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:11.865746    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac86db1e-a5d4-4a40-8737-eaa2201e6a43" path="/var/lib/kubelet/pods/ac86db1e-a5d4-4a40-8737-eaa2201e6a43/volumes"
Jul 31 00:13:30.732352 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:30.732313    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:13:30.748081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:30.748056    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:13:31.326933 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:13:31.326909    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 00:15:43.452959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.452927    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"]
Jul 31 00:15:43.453369 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.453239    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac86db1e-a5d4-4a40-8737-eaa2201e6a43" containerName="console"
Jul 31 00:15:43.453369 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.453250    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac86db1e-a5d4-4a40-8737-eaa2201e6a43" containerName="console"
Jul 31 00:15:43.453369 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.453300    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac86db1e-a5d4-4a40-8737-eaa2201e6a43" containerName="console"
Jul 31 00:15:43.456334 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.456318    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.458767 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.458721    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 00:15:43.458767 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.458724    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 00:15:43.458941 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.458839    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nl6x5\""
Jul 31 00:15:43.459512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.459492    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 00:15:43.459714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.459698    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 00:15:43.483064 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.483044    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"]
Jul 31 00:15:43.595320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.595289    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0679d330-625d-4264-8f09-e0573bd5837c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.595507 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.595328    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0679d330-625d-4264-8f09-e0573bd5837c-tmp\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.595507 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.595355    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0679d330-625d-4264-8f09-e0573bd5837c-manifests\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.595507 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.595395    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0679d330-625d-4264-8f09-e0573bd5837c-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.595507 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.595480    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5q5z\" (UniqueName: \"kubernetes.io/projected/0679d330-625d-4264-8f09-e0573bd5837c-kube-api-access-q5q5z\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.633520 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.633487    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"]
Jul 31 00:15:43.637126 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.637104    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.640744 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.640709    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 00:15:43.640883 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.640822    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 00:15:43.641114 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.641093    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zfvld\""
Jul 31 00:15:43.641322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.641144    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 00:15:43.641534 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.641514    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 00:15:43.642391 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.642364    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:15:43.657633 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.657606    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"]
Jul 31 00:15:43.696507 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.696483    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0679d330-625d-4264-8f09-e0573bd5837c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.696618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.696519    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0679d330-625d-4264-8f09-e0573bd5837c-tmp\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.696618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.696542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0679d330-625d-4264-8f09-e0573bd5837c-manifests\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.696618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.696561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0679d330-625d-4264-8f09-e0573bd5837c-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.696618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.696605    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5q5z\" (UniqueName: \"kubernetes.io/projected/0679d330-625d-4264-8f09-e0573bd5837c-kube-api-access-q5q5z\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.697030 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.697005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0679d330-625d-4264-8f09-e0573bd5837c-manifests\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.698984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.698964    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0679d330-625d-4264-8f09-e0573bd5837c-tmp\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.699071 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.699013    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0679d330-625d-4264-8f09-e0573bd5837c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.699071 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.699061    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0679d330-625d-4264-8f09-e0573bd5837c-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.708724 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.708675    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5q5z\" (UniqueName: \"kubernetes.io/projected/0679d330-625d-4264-8f09-e0573bd5837c-kube-api-access-q5q5z\") pod \"opendatahub-operator-controller-manager-bff98467-j6wd9\" (UID: \"0679d330-625d-4264-8f09-e0573bd5837c\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.766739 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.766713    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:43.797130 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.797104    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlpp\" (UniqueName: \"kubernetes.io/projected/713bf6e0-b746-4e70-8023-38f66421d978-kube-api-access-6wlpp\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.797243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.797151    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/713bf6e0-b746-4e70-8023-38f66421d978-cert\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.797243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.797176    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/713bf6e0-b746-4e70-8023-38f66421d978-manager-config\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.797243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.797198    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/713bf6e0-b746-4e70-8023-38f66421d978-metrics-cert\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.898420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.898386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/713bf6e0-b746-4e70-8023-38f66421d978-cert\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.898583 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.898424    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/713bf6e0-b746-4e70-8023-38f66421d978-manager-config\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.898583 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.898463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/713bf6e0-b746-4e70-8023-38f66421d978-metrics-cert\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.898583 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.898532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlpp\" (UniqueName: \"kubernetes.io/projected/713bf6e0-b746-4e70-8023-38f66421d978-kube-api-access-6wlpp\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.899088 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.899060    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/713bf6e0-b746-4e70-8023-38f66421d978-manager-config\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.901135 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.901113    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/713bf6e0-b746-4e70-8023-38f66421d978-cert\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.901224 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.901147    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/713bf6e0-b746-4e70-8023-38f66421d978-metrics-cert\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.905284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.905262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"]
Jul 31 00:15:43.909407 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:15:43.909387    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0679d330_625d_4264_8f09_e0573bd5837c.slice/crio-eaa014f713e10d165e55cc180e09499a18d8799ca7346e5fae0aac6a4ad50e6b WatchSource:0}: Error finding container eaa014f713e10d165e55cc180e09499a18d8799ca7346e5fae0aac6a4ad50e6b: Status 404 returned error can't find the container with id eaa014f713e10d165e55cc180e09499a18d8799ca7346e5fae0aac6a4ad50e6b
Jul 31 00:15:43.911104 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.911085    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:15:43.920847 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.920827    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlpp\" (UniqueName: \"kubernetes.io/projected/713bf6e0-b746-4e70-8023-38f66421d978-kube-api-access-6wlpp\") pod \"lws-controller-manager-5dbc4bb7b6-h4p7r\" (UID: \"713bf6e0-b746-4e70-8023-38f66421d978\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:43.951882 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:43.951853    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:44.084544 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:44.084513    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"]
Jul 31 00:15:44.086940 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:15:44.086908    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713bf6e0_b746_4e70_8023_38f66421d978.slice/crio-31ba664bff63b03b614cff579c9332d747ddc271d3cf6a7a7170d0102b4d6d16 WatchSource:0}: Error finding container 31ba664bff63b03b614cff579c9332d747ddc271d3cf6a7a7170d0102b4d6d16: Status 404 returned error can't find the container with id 31ba664bff63b03b614cff579c9332d747ddc271d3cf6a7a7170d0102b4d6d16
Jul 31 00:15:44.802214 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:44.802159    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r" event={"ID":"713bf6e0-b746-4e70-8023-38f66421d978","Type":"ContainerStarted","Data":"31ba664bff63b03b614cff579c9332d747ddc271d3cf6a7a7170d0102b4d6d16"}
Jul 31 00:15:44.804034 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:44.804005    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9" event={"ID":"0679d330-625d-4264-8f09-e0573bd5837c","Type":"ContainerStarted","Data":"eaa014f713e10d165e55cc180e09499a18d8799ca7346e5fae0aac6a4ad50e6b"}
Jul 31 00:15:48.824023 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:48.823991    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r" event={"ID":"713bf6e0-b746-4e70-8023-38f66421d978","Type":"ContainerStarted","Data":"47ffce6b024f88573f7fe0cba0ab32cbc857528ddbeed702c997d6e2ba0ab344"}
Jul 31 00:15:48.824491 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:48.824054    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:15:48.826512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:48.826480    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9" event={"ID":"0679d330-625d-4264-8f09-e0573bd5837c","Type":"ContainerStarted","Data":"aca95cf2873fd618a26b5dddfea27c4236f341f3c39e7cf7ffdddbed3e81ed5d"}
Jul 31 00:15:48.838263 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:48.838217    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r" podStartSLOduration=1.664892779 podStartE2EDuration="5.838203622s" totalImagesPullingTime="4.173310843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:48.83720158 +0000 UTC m=+553.561167578" watchObservedRunningTime="2026-07-31 00:15:48.838203622 +0000 UTC m=+553.562169580"
Jul 31 00:15:49.833031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:49.832998    2555 generic.go:356] "Generic (PLEG): container finished" podID="0679d330-625d-4264-8f09-e0573bd5837c" containerID="aca95cf2873fd618a26b5dddfea27c4236f341f3c39e7cf7ffdddbed3e81ed5d" exitCode=0
Jul 31 00:15:49.833510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:49.833087    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9" event={"ID":"0679d330-625d-4264-8f09-e0573bd5837c","Type":"ContainerDied","Data":"aca95cf2873fd618a26b5dddfea27c4236f341f3c39e7cf7ffdddbed3e81ed5d"}
Jul 31 00:15:50.839905 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:50.839870    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9" event={"ID":"0679d330-625d-4264-8f09-e0573bd5837c","Type":"ContainerStarted","Data":"2465f240008dd8590360078421a023e035c69a4e0eeb48cf6f0bf962ff3d084e"}
Jul 31 00:15:50.840322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:50.840015    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:15:50.860629 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:50.860579    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9" podStartSLOduration=2.251793419 podStartE2EDuration="7.860565718s" totalImagesPullingTime="4.604079936s" totalInitContainerRuntime="1.004692363s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:50.85846297 +0000 UTC m=+555.582428948" watchObservedRunningTime="2026-07-31 00:15:50.860565718 +0000 UTC m=+555.584531685"
Jul 31 00:15:59.836091 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:15:59.836060    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-h4p7r"
Jul 31 00:16:01.847139 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:01.847102    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-j6wd9"
Jul 31 00:16:04.041407 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.041377    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"]
Jul 31 00:16:04.049513 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.049494    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.051553 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.051532    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 00:16:04.051810 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.051795    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 00:16:04.052235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.052205    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 00:16:04.052309 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.052264    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2qrj7\""
Jul 31 00:16:04.053999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.053982    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 00:16:04.055452 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.055391    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff551cf-0096-40a8-b916-691531a9e72e-tmp\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.055452 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.055434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stlw5\" (UniqueName: \"kubernetes.io/projected/3ff551cf-0096-40a8-b916-691531a9e72e-kube-api-access-stlw5\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.055630 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.055505    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ff551cf-0096-40a8-b916-691531a9e72e-tls-certs\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.057354 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.057336    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"]
Jul 31 00:16:04.156337 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.156301    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff551cf-0096-40a8-b916-691531a9e72e-tmp\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.156530 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.156341    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stlw5\" (UniqueName: \"kubernetes.io/projected/3ff551cf-0096-40a8-b916-691531a9e72e-kube-api-access-stlw5\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.156530 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.156374    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ff551cf-0096-40a8-b916-691531a9e72e-tls-certs\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.158707 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.158675    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff551cf-0096-40a8-b916-691531a9e72e-tmp\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.158923 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.158908    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ff551cf-0096-40a8-b916-691531a9e72e-tls-certs\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.174281 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.174258    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stlw5\" (UniqueName: \"kubernetes.io/projected/3ff551cf-0096-40a8-b916-691531a9e72e-kube-api-access-stlw5\") pod \"kube-auth-proxy-f6dcbc74-dxcqt\" (UID: \"3ff551cf-0096-40a8-b916-691531a9e72e\") " pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.360458 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.360382    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"
Jul 31 00:16:04.509553 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.509529    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt"]
Jul 31 00:16:04.512109 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:16:04.512086    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff551cf_0096_40a8_b916_691531a9e72e.slice/crio-54146bfbf5b6eb301a9f12728d5c104682cc81245591f9c324d29f1a1146d70c WatchSource:0}: Error finding container 54146bfbf5b6eb301a9f12728d5c104682cc81245591f9c324d29f1a1146d70c: Status 404 returned error can't find the container with id 54146bfbf5b6eb301a9f12728d5c104682cc81245591f9c324d29f1a1146d70c
Jul 31 00:16:04.903652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:04.903618    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt" event={"ID":"3ff551cf-0096-40a8-b916-691531a9e72e","Type":"ContainerStarted","Data":"54146bfbf5b6eb301a9f12728d5c104682cc81245591f9c324d29f1a1146d70c"}
Jul 31 00:16:07.922405 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:07.922364    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt" event={"ID":"3ff551cf-0096-40a8-b916-691531a9e72e","Type":"ContainerStarted","Data":"bc7970472ccd2d937decbf2cc30f518d485000b4fd63291d530c3106979f99f4"}
Jul 31 00:16:07.937089 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:16:07.937041    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f6dcbc74-dxcqt" podStartSLOduration=1.079520455 podStartE2EDuration="3.937026299s" totalImagesPullingTime="2.857505844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:16:07.935627081 +0000 UTC m=+572.659593048" watchObservedRunningTime="2026-07-31 00:16:07.937026299 +0000 UTC m=+572.660992266"
Jul 31 00:17:51.544138 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.544099    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"]
Jul 31 00:17:51.547479 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.547447    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.550113 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.550078    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r29qw\""
Jul 31 00:17:51.550298 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.550186    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 00:17:51.550437 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.550420    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 00:17:51.559488 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.559457    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"]
Jul 31 00:17:51.735485 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.735445    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzmk\" (UniqueName: \"kubernetes.io/projected/afa0c393-91ab-4485-9f5c-8df977adcd2a-kube-api-access-9wzmk\") pod \"kuadrant-operator-controller-manager-96db98c47-94klc\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.735668 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.735501    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afa0c393-91ab-4485-9f5c-8df977adcd2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-94klc\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.836577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.836478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afa0c393-91ab-4485-9f5c-8df977adcd2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-94klc\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.836577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.836568    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzmk\" (UniqueName: \"kubernetes.io/projected/afa0c393-91ab-4485-9f5c-8df977adcd2a-kube-api-access-9wzmk\") pod \"kuadrant-operator-controller-manager-96db98c47-94klc\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.837003 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.836985    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afa0c393-91ab-4485-9f5c-8df977adcd2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-94klc\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.844315 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.844292    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzmk\" (UniqueName: \"kubernetes.io/projected/afa0c393-91ab-4485-9f5c-8df977adcd2a-kube-api-access-9wzmk\") pod \"kuadrant-operator-controller-manager-96db98c47-94klc\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:51.859658 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:51.859622    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:17:52.004738 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.004701    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"]
Jul 31 00:17:52.008266 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:17:52.008235    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa0c393_91ab_4485_9f5c_8df977adcd2a.slice/crio-54f33861494bebe9db20b589089bfe209b0bd7cc80ed48ac1a93d62055f55b7f WatchSource:0}: Error finding container 54f33861494bebe9db20b589089bfe209b0bd7cc80ed48ac1a93d62055f55b7f: Status 404 returned error can't find the container with id 54f33861494bebe9db20b589089bfe209b0bd7cc80ed48ac1a93d62055f55b7f
Jul 31 00:17:52.295113 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.295077    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"]
Jul 31 00:17:52.301798 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.301748    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"]
Jul 31 00:17:52.316329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.316286    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"]
Jul 31 00:17:52.320929 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.320900    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.416733 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.416697    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"]
Jul 31 00:17:52.442628 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.442592    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-vrzl8\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.442822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.442670    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt2hk\" (UniqueName: \"kubernetes.io/projected/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-kube-api-access-pt2hk\") pod \"kuadrant-operator-controller-manager-96db98c47-vrzl8\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.543330 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.543287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-vrzl8\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.543520 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.543372    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt2hk\" (UniqueName: \"kubernetes.io/projected/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-kube-api-access-pt2hk\") pod \"kuadrant-operator-controller-manager-96db98c47-vrzl8\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.543718 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.543694    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-vrzl8\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.556050 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.555962    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt2hk\" (UniqueName: \"kubernetes.io/projected/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-kube-api-access-pt2hk\") pod \"kuadrant-operator-controller-manager-96db98c47-vrzl8\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.634942 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.634897    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:17:52.807534 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:52.807372    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"]
Jul 31 00:17:52.811542 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:17:52.811505    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13765ec_16aa_4dce_8f8d_96a1bcd324e4.slice/crio-6cd5edd9189d185d6a388c1e0ba1008430e0d6f5ad4ab0d8f1ba9c9a1b10adbe WatchSource:0}: Error finding container 6cd5edd9189d185d6a388c1e0ba1008430e0d6f5ad4ab0d8f1ba9c9a1b10adbe: Status 404 returned error can't find the container with id 6cd5edd9189d185d6a388c1e0ba1008430e0d6f5ad4ab0d8f1ba9c9a1b10adbe
Jul 31 00:17:53.372308 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:17:53.372203    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8" event={"ID":"e13765ec-16aa-4dce-8f8d-96a1bcd324e4","Type":"ContainerStarted","Data":"6cd5edd9189d185d6a388c1e0ba1008430e0d6f5ad4ab0d8f1ba9c9a1b10adbe"}
Jul 31 00:18:01.419315 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.419270    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" containerName="manager" containerID="cri-o://c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032" gracePeriod=2
Jul 31 00:18:01.421150 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:01.421108    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-94klc\" is forbidden: User \"system:node:ip-10-0-129-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-35.ec2.internal' and this object" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:01.421327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.421168    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8" event={"ID":"e13765ec-16aa-4dce-8f8d-96a1bcd324e4","Type":"ContainerStarted","Data":"5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9"}
Jul 31 00:18:01.421327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.421302    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:18:01.422598 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:01.422555    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-94klc\" is forbidden: User \"system:node:ip-10-0-129-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-35.ec2.internal' and this object" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:01.438353 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.438299    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8" podStartSLOduration=1.7143432889999999 podStartE2EDuration="9.438284262s" totalImagesPullingTime="7.723940973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:18:01.437634635 +0000 UTC m=+686.161600621" watchObservedRunningTime="2026-07-31 00:18:01.438284262 +0000 UTC m=+686.162250229"
Jul 31 00:18:01.667047 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.667009    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:01.668867 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:01.668834    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-94klc\" is forbidden: User \"system:node:ip-10-0-129-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-35.ec2.internal' and this object" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:01.723898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.723860    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wzmk\" (UniqueName: \"kubernetes.io/projected/afa0c393-91ab-4485-9f5c-8df977adcd2a-kube-api-access-9wzmk\") pod \"afa0c393-91ab-4485-9f5c-8df977adcd2a\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") "
Jul 31 00:18:01.724099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.723938    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afa0c393-91ab-4485-9f5c-8df977adcd2a-extensions-socket-volume\") pod \"afa0c393-91ab-4485-9f5c-8df977adcd2a\" (UID: \"afa0c393-91ab-4485-9f5c-8df977adcd2a\") "
Jul 31 00:18:01.724261 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.724218    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa0c393-91ab-4485-9f5c-8df977adcd2a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "afa0c393-91ab-4485-9f5c-8df977adcd2a" (UID: "afa0c393-91ab-4485-9f5c-8df977adcd2a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:18:01.726415 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.726381    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa0c393-91ab-4485-9f5c-8df977adcd2a-kube-api-access-9wzmk" (OuterVolumeSpecName: "kube-api-access-9wzmk") pod "afa0c393-91ab-4485-9f5c-8df977adcd2a" (UID: "afa0c393-91ab-4485-9f5c-8df977adcd2a"). InnerVolumeSpecName "kube-api-access-9wzmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:18:01.824654 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.824610    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wzmk\" (UniqueName: \"kubernetes.io/projected/afa0c393-91ab-4485-9f5c-8df977adcd2a-kube-api-access-9wzmk\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:01.824654 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.824643    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afa0c393-91ab-4485-9f5c-8df977adcd2a-extensions-socket-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:01.867366 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:01.867324    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" path="/var/lib/kubelet/pods/afa0c393-91ab-4485-9f5c-8df977adcd2a/volumes"
Jul 31 00:18:02.427927 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:02.427889    2555 generic.go:356] "Generic (PLEG): container finished" podID="afa0c393-91ab-4485-9f5c-8df977adcd2a" containerID="c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032" exitCode=2
Jul 31 00:18:02.428416 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:02.427939    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:02.428416 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:02.428003    2555 scope.go:117] "RemoveContainer" containerID="c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032"
Jul 31 00:18:02.429811 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:02.429726    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-94klc\" is forbidden: User \"system:node:ip-10-0-129-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-35.ec2.internal' and this object" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:02.432441 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:02.432407    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-94klc\" is forbidden: User \"system:node:ip-10-0-129-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-35.ec2.internal' and this object" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-94klc"
Jul 31 00:18:02.437156 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:02.437134    2555 scope.go:117] "RemoveContainer" containerID="c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032"
Jul 31 00:18:02.437486 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:02.437468    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032\": container with ID starting with c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032 not found: ID does not exist" containerID="c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032"
Jul 31 00:18:02.437543 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:02.437498    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032"} err="failed to get container status \"c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032\": rpc error: code = NotFound desc = could not find container \"c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032\": container with ID starting with c0129d98a177f1c88c2450de15cb006597e02d5a95adb1d2673b716fce94c032 not found: ID does not exist"
Jul 31 00:18:12.430999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:12.430965    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:18:24.744860 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:24.744817    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"]
Jul 31 00:18:24.745439 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:24.745116    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8" podUID="e13765ec-16aa-4dce-8f8d-96a1bcd324e4" containerName="manager" containerID="cri-o://5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9" gracePeriod=10
Jul 31 00:18:24.999515 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:24.999435    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:18:25.127680 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.127644    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt2hk\" (UniqueName: \"kubernetes.io/projected/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-kube-api-access-pt2hk\") pod \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") "
Jul 31 00:18:25.127909 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.127696    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-extensions-socket-volume\") pod \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\" (UID: \"e13765ec-16aa-4dce-8f8d-96a1bcd324e4\") "
Jul 31 00:18:25.128250 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.128207    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e13765ec-16aa-4dce-8f8d-96a1bcd324e4" (UID: "e13765ec-16aa-4dce-8f8d-96a1bcd324e4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:18:25.130156 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.130128    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-kube-api-access-pt2hk" (OuterVolumeSpecName: "kube-api-access-pt2hk") pod "e13765ec-16aa-4dce-8f8d-96a1bcd324e4" (UID: "e13765ec-16aa-4dce-8f8d-96a1bcd324e4"). InnerVolumeSpecName "kube-api-access-pt2hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:18:25.229343 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.229297    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt2hk\" (UniqueName: \"kubernetes.io/projected/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-kube-api-access-pt2hk\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:25.229343 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.229335    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13765ec-16aa-4dce-8f8d-96a1bcd324e4-extensions-socket-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:25.543740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.543706    2555 generic.go:356] "Generic (PLEG): container finished" podID="e13765ec-16aa-4dce-8f8d-96a1bcd324e4" containerID="5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9" exitCode=0
Jul 31 00:18:25.543987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.543778    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"
Jul 31 00:18:25.543987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.543799    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8" event={"ID":"e13765ec-16aa-4dce-8f8d-96a1bcd324e4","Type":"ContainerDied","Data":"5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9"}
Jul 31 00:18:25.543987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.543870    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8" event={"ID":"e13765ec-16aa-4dce-8f8d-96a1bcd324e4","Type":"ContainerDied","Data":"6cd5edd9189d185d6a388c1e0ba1008430e0d6f5ad4ab0d8f1ba9c9a1b10adbe"}
Jul 31 00:18:25.543987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.543904    2555 scope.go:117] "RemoveContainer" containerID="5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9"
Jul 31 00:18:25.553841 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.553816    2555 scope.go:117] "RemoveContainer" containerID="5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9"
Jul 31 00:18:25.554176 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:25.554157    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9\": container with ID starting with 5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9 not found: ID does not exist" containerID="5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9"
Jul 31 00:18:25.554234 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.554186    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9"} err="failed to get container status \"5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9\": rpc error: code = NotFound desc = could not find container \"5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9\": container with ID starting with 5e2ba0567a165987420cf8c54beab794860a01579dbc3f3e0898ccc07d4b0ed9 not found: ID does not exist"
Jul 31 00:18:25.567138 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.567102    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"]
Jul 31 00:18:25.570801 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.570739    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-vrzl8"]
Jul 31 00:18:25.867302 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:25.867212    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e13765ec-16aa-4dce-8f8d-96a1bcd324e4" path="/var/lib/kubelet/pods/e13765ec-16aa-4dce-8f8d-96a1bcd324e4/volumes"
Jul 31 00:18:32.088044 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088003    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:32.088486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088350    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" containerName="manager"
Jul 31 00:18:32.088486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088362    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" containerName="manager"
Jul 31 00:18:32.088486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088378    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e13765ec-16aa-4dce-8f8d-96a1bcd324e4" containerName="manager"
Jul 31 00:18:32.088486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088384    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e13765ec-16aa-4dce-8f8d-96a1bcd324e4" containerName="manager"
Jul 31 00:18:32.088486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088443    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e13765ec-16aa-4dce-8f8d-96a1bcd324e4" containerName="manager"
Jul 31 00:18:32.088486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.088451    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa0c393-91ab-4485-9f5c-8df977adcd2a" containerName="manager"
Jul 31 00:18:32.090670 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.090653    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.092490 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.092462    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 00:18:32.092641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.092506    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5248n\""
Jul 31 00:18:32.092641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.092464    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 31 00:18:32.092920 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.092904    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 00:18:32.100094 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.100063    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:32.185160 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.185123    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:32.191012 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.190979    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk948\" (UniqueName: \"kubernetes.io/projected/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-kube-api-access-zk948\") pod \"limitador-limitador-859c4d96d6-4q4np\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.191211 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.191039    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-config-file\") pod \"limitador-limitador-859c4d96d6-4q4np\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.292367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.292321    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk948\" (UniqueName: \"kubernetes.io/projected/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-kube-api-access-zk948\") pod \"limitador-limitador-859c4d96d6-4q4np\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.292561 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.292376    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-config-file\") pod \"limitador-limitador-859c4d96d6-4q4np\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.293039 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.293017    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-config-file\") pod \"limitador-limitador-859c4d96d6-4q4np\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.299343 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.299303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk948\" (UniqueName: \"kubernetes.io/projected/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-kube-api-access-zk948\") pod \"limitador-limitador-859c4d96d6-4q4np\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.401439 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.401335    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:32.543132 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.543095    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:32.546866 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:18:32.546832    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf404844a_53ae_4eb8_91c9_e2e9ed3cbec7.slice/crio-94e78a92520b379701177415fc70a487efc3884be95826a4592d608dae00b489 WatchSource:0}: Error finding container 94e78a92520b379701177415fc70a487efc3884be95826a4592d608dae00b489: Status 404 returned error can't find the container with id 94e78a92520b379701177415fc70a487efc3884be95826a4592d608dae00b489
Jul 31 00:18:32.579503 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.579462    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np" event={"ID":"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7","Type":"ContainerStarted","Data":"94e78a92520b379701177415fc70a487efc3884be95826a4592d608dae00b489"}
Jul 31 00:18:32.855688 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.855651    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-wrh6c"]
Jul 31 00:18:32.859491 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.859464    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:32.861270 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.861249    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vn8lf\""
Jul 31 00:18:32.864135 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.864100    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wrh6c"]
Jul 31 00:18:32.999032 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:32.998986    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgrl\" (UniqueName: \"kubernetes.io/projected/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a-kube-api-access-9bgrl\") pod \"authorino-b54df94b4-wrh6c\" (UID: \"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a\") " pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:33.099892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:33.099845    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgrl\" (UniqueName: \"kubernetes.io/projected/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a-kube-api-access-9bgrl\") pod \"authorino-b54df94b4-wrh6c\" (UID: \"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a\") " pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:33.107477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:33.107401    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgrl\" (UniqueName: \"kubernetes.io/projected/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a-kube-api-access-9bgrl\") pod \"authorino-b54df94b4-wrh6c\" (UID: \"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a\") " pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:33.177920 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:33.177875    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:33.314511 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:33.314465    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wrh6c"]
Jul 31 00:18:33.320164 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:18:33.320130    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c27be59_e2b4_4e4e_9e35_b50e9cc3e37a.slice/crio-e4c05163612f745cb7ebf7019824df8c3e16cdb6e50d3cdc13d0b83ce45d433b WatchSource:0}: Error finding container e4c05163612f745cb7ebf7019824df8c3e16cdb6e50d3cdc13d0b83ce45d433b: Status 404 returned error can't find the container with id e4c05163612f745cb7ebf7019824df8c3e16cdb6e50d3cdc13d0b83ce45d433b
Jul 31 00:18:33.584802 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:33.584735    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wrh6c" event={"ID":"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a","Type":"ContainerStarted","Data":"e4c05163612f745cb7ebf7019824df8c3e16cdb6e50d3cdc13d0b83ce45d433b"}
Jul 31 00:18:34.593615 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:34.593531    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np" event={"ID":"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7","Type":"ContainerStarted","Data":"136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a"}
Jul 31 00:18:34.594151 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:34.593721    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:34.609138 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:34.609057    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np" podStartSLOduration=1.103304509 podStartE2EDuration="2.609032538s" totalImagesPullingTime="1.505728029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:18:34.60673201 +0000 UTC m=+719.330697998" watchObservedRunningTime="2026-07-31 00:18:34.609032538 +0000 UTC m=+719.332998507"
Jul 31 00:18:35.847109 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:35.847067    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wrh6c"]
Jul 31 00:18:36.603825 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:36.603775    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wrh6c" event={"ID":"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a","Type":"ContainerStarted","Data":"c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008"}
Jul 31 00:18:36.603825 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:36.603802    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-wrh6c" podUID="0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" containerName="authorino" containerID="cri-o://c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008" gracePeriod=30
Jul 31 00:18:36.615829 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:36.615748    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-wrh6c" podStartSLOduration=1.425963998 podStartE2EDuration="4.615729338s" totalImagesPullingTime="3.18976534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:18:36.615313465 +0000 UTC m=+721.339279431" watchObservedRunningTime="2026-07-31 00:18:36.615729338 +0000 UTC m=+721.339695303"
Jul 31 00:18:36.871983 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:36.871956    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:37.038597 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.038501    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bgrl\" (UniqueName: \"kubernetes.io/projected/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a-kube-api-access-9bgrl\") pod \"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a\" (UID: \"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a\") "
Jul 31 00:18:37.040870 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.040829    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a-kube-api-access-9bgrl" (OuterVolumeSpecName: "kube-api-access-9bgrl") pod "0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" (UID: "0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a"). InnerVolumeSpecName "kube-api-access-9bgrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:18:37.139721 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.139681    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bgrl\" (UniqueName: \"kubernetes.io/projected/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a-kube-api-access-9bgrl\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:37.610483 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.610445    2555 generic.go:356] "Generic (PLEG): container finished" podID="0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" containerID="c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008" exitCode=2
Jul 31 00:18:37.610483 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.610491    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wrh6c"
Jul 31 00:18:37.610781 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.610527    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wrh6c" event={"ID":"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a","Type":"ContainerDied","Data":"c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008"}
Jul 31 00:18:37.610781 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.610560    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wrh6c" event={"ID":"0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a","Type":"ContainerDied","Data":"e4c05163612f745cb7ebf7019824df8c3e16cdb6e50d3cdc13d0b83ce45d433b"}
Jul 31 00:18:37.610781 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.610586    2555 scope.go:117] "RemoveContainer" containerID="c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008"
Jul 31 00:18:37.620103 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.620085    2555 scope.go:117] "RemoveContainer" containerID="c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008"
Jul 31 00:18:37.620475 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:37.620454    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008\": container with ID starting with c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008 not found: ID does not exist" containerID="c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008"
Jul 31 00:18:37.620533 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.620490    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008"} err="failed to get container status \"c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008\": rpc error: code = NotFound desc = could not find container \"c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008\": container with ID starting with c1be2ad7e3875a3de68c6546d2306e06d25c4b821ccf40ac606d4371a9442008 not found: ID does not exist"
Jul 31 00:18:37.629987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.629945    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wrh6c"]
Jul 31 00:18:37.633177 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.633145    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wrh6c"]
Jul 31 00:18:37.648916 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:37.648877    2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c27be59_e2b4_4e4e_9e35_b50e9cc3e37a.slice/crio-e4c05163612f745cb7ebf7019824df8c3e16cdb6e50d3cdc13d0b83ce45d433b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c27be59_e2b4_4e4e_9e35_b50e9cc3e37a.slice\": RecentStats: unable to find data in memory cache]"
Jul 31 00:18:37.867191 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:37.867090    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" path="/var/lib/kubelet/pods/0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a/volumes"
Jul 31 00:18:45.598867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:45.598829    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:45.852434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:45.852338    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:45.852610 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:45.852533    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np" podUID="f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" containerName="limitador" containerID="cri-o://136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a" gracePeriod=30
Jul 31 00:18:46.410192 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.410157    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:46.420822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.420732    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-config-file\") pod \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") "
Jul 31 00:18:46.420937 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.420829    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk948\" (UniqueName: \"kubernetes.io/projected/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-kube-api-access-zk948\") pod \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\" (UID: \"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7\") "
Jul 31 00:18:46.421097 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.421070    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-config-file" (OuterVolumeSpecName: "config-file") pod "f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" (UID: "f404844a-53ae-4eb8-91c9-e2e9ed3cbec7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:18:46.423083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.423054    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-kube-api-access-zk948" (OuterVolumeSpecName: "kube-api-access-zk948") pod "f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" (UID: "f404844a-53ae-4eb8-91c9-e2e9ed3cbec7"). InnerVolumeSpecName "kube-api-access-zk948". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:18:46.521491 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.521454    2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-config-file\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:46.521491 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.521488    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk948\" (UniqueName: \"kubernetes.io/projected/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7-kube-api-access-zk948\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:18:46.655734 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.655696    2555 generic.go:356] "Generic (PLEG): container finished" podID="f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" containerID="136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a" exitCode=0
Jul 31 00:18:46.656250 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.655744    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np"
Jul 31 00:18:46.656250 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.655783    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np" event={"ID":"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7","Type":"ContainerDied","Data":"136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a"}
Jul 31 00:18:46.656250 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.655861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4q4np" event={"ID":"f404844a-53ae-4eb8-91c9-e2e9ed3cbec7","Type":"ContainerDied","Data":"94e78a92520b379701177415fc70a487efc3884be95826a4592d608dae00b489"}
Jul 31 00:18:46.656250 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.655884    2555 scope.go:117] "RemoveContainer" containerID="136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a"
Jul 31 00:18:46.665632 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.665608    2555 scope.go:117] "RemoveContainer" containerID="136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a"
Jul 31 00:18:46.665984 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:18:46.665961    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a\": container with ID starting with 136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a not found: ID does not exist" containerID="136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a"
Jul 31 00:18:46.666065 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.666000    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a"} err="failed to get container status \"136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a\": rpc error: code = NotFound desc = could not find container \"136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a\": container with ID starting with 136c5afad89dfd6abcb8c58920180106cb55f4a559d8c1f7d0c076e4b909127a not found: ID does not exist"
Jul 31 00:18:46.675022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.674938    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:46.678390 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:46.678360    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4q4np"]
Jul 31 00:18:47.866349 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:47.866313    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" path="/var/lib/kubelet/pods/f404844a-53ae-4eb8-91c9-e2e9ed3cbec7/volumes"
Jul 31 00:18:48.033168 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033133    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"]
Jul 31 00:18:48.033478 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033463    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" containerName="authorino"
Jul 31 00:18:48.033478 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033477    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" containerName="authorino"
Jul 31 00:18:48.033617 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033498    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" containerName="limitador"
Jul 31 00:18:48.033617 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033504    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" containerName="limitador"
Jul 31 00:18:48.033617 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033551    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c27be59-e2b4-4e4e-9e35-b50e9cc3e37a" containerName="authorino"
Jul 31 00:18:48.033617 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.033562    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f404844a-53ae-4eb8-91c9-e2e9ed3cbec7" containerName="limitador"
Jul 31 00:18:48.038087 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.038061    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.040307 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.040285    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 00:18:48.040307 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.040303    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 00:18:48.040624 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.040611    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6pdrq\""
Jul 31 00:18:48.040666 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.040646    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 31 00:18:48.046613 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.046586    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"]
Jul 31 00:18:48.133588 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.133490    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/409563b2-1ddc-47c7-a71a-28be508cf1e6-data\") pod \"postgres-69fb4594cf-5zszg\" (UID: \"409563b2-1ddc-47c7-a71a-28be508cf1e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.133588 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.133530    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9j9r\" (UniqueName: \"kubernetes.io/projected/409563b2-1ddc-47c7-a71a-28be508cf1e6-kube-api-access-c9j9r\") pod \"postgres-69fb4594cf-5zszg\" (UID: \"409563b2-1ddc-47c7-a71a-28be508cf1e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.234264 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.234223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/409563b2-1ddc-47c7-a71a-28be508cf1e6-data\") pod \"postgres-69fb4594cf-5zszg\" (UID: \"409563b2-1ddc-47c7-a71a-28be508cf1e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.234448 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.234277    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9j9r\" (UniqueName: \"kubernetes.io/projected/409563b2-1ddc-47c7-a71a-28be508cf1e6-kube-api-access-c9j9r\") pod \"postgres-69fb4594cf-5zszg\" (UID: \"409563b2-1ddc-47c7-a71a-28be508cf1e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.234715 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.234696    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/409563b2-1ddc-47c7-a71a-28be508cf1e6-data\") pod \"postgres-69fb4594cf-5zszg\" (UID: \"409563b2-1ddc-47c7-a71a-28be508cf1e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.242481 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.242454    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9j9r\" (UniqueName: \"kubernetes.io/projected/409563b2-1ddc-47c7-a71a-28be508cf1e6-kube-api-access-c9j9r\") pod \"postgres-69fb4594cf-5zszg\" (UID: \"409563b2-1ddc-47c7-a71a-28be508cf1e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.349812 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.349739    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:48.492335 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.492303    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"]
Jul 31 00:18:48.495126 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:18:48.495095    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409563b2_1ddc_47c7_a71a_28be508cf1e6.slice/crio-6703f5afd4f2dd590bb5258c43dd56078270359d562cf063521f5f6733ac5369 WatchSource:0}: Error finding container 6703f5afd4f2dd590bb5258c43dd56078270359d562cf063521f5f6733ac5369: Status 404 returned error can't find the container with id 6703f5afd4f2dd590bb5258c43dd56078270359d562cf063521f5f6733ac5369
Jul 31 00:18:48.666094 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:48.665999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg" event={"ID":"409563b2-1ddc-47c7-a71a-28be508cf1e6","Type":"ContainerStarted","Data":"6703f5afd4f2dd590bb5258c43dd56078270359d562cf063521f5f6733ac5369"}
Jul 31 00:18:53.696401 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:53.696353    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg" event={"ID":"409563b2-1ddc-47c7-a71a-28be508cf1e6","Type":"ContainerStarted","Data":"1bd849fd8f8b22f5f82c330e952d42885bf3eea79c6ed238f581f9831a2880f9"}
Jul 31 00:18:53.696807 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:53.696460    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:18:53.710987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:53.710929    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg" podStartSLOduration=0.609390981 podStartE2EDuration="5.710909646s" totalImagesPullingTime="5.101518665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:18:53.709352937 +0000 UTC m=+738.433318904" watchObservedRunningTime="2026-07-31 00:18:53.710909646 +0000 UTC m=+738.434875667"
Jul 31 00:18:59.732174 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:18:59.732141    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5zszg"
Jul 31 00:19:00.277445 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.277406    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-4d9bv"]
Jul 31 00:19:00.279945 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.279924    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:00.281810 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.281748    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 00:19:00.281974 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.281829    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 00:19:00.282379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.282357    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vn8lf\""
Jul 31 00:19:00.284798 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.284775    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-4d9bv"]
Jul 31 00:19:00.331086 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.331050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2rmr\" (UniqueName: \"kubernetes.io/projected/05e43e16-5627-4bd9-986b-72c35f551904-kube-api-access-t2rmr\") pod \"authorino-5dc7ccb5f-4d9bv\" (UID: \"05e43e16-5627-4bd9-986b-72c35f551904\") " pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:00.395079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.395035    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-4d9bv"]
Jul 31 00:19:00.395348 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:19:00.395327    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t2rmr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv" podUID="05e43e16-5627-4bd9-986b-72c35f551904"
Jul 31 00:19:00.413371 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.413336    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-xpwph"]
Jul 31 00:19:00.416014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.415993    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.417740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.417719    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 31 00:19:00.421834 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.421799    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-xpwph"]
Jul 31 00:19:00.432096 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.432054    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1764d464-51ef-484b-822c-4d0e8279b8fc-tls-cert\") pod \"authorino-687bd45585-xpwph\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") " pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.432285 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.432179    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mzb\" (UniqueName: \"kubernetes.io/projected/1764d464-51ef-484b-822c-4d0e8279b8fc-kube-api-access-26mzb\") pod \"authorino-687bd45585-xpwph\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") " pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.432359 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.432293    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2rmr\" (UniqueName: \"kubernetes.io/projected/05e43e16-5627-4bd9-986b-72c35f551904-kube-api-access-t2rmr\") pod \"authorino-5dc7ccb5f-4d9bv\" (UID: \"05e43e16-5627-4bd9-986b-72c35f551904\") " pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:00.440014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.439977    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2rmr\" (UniqueName: \"kubernetes.io/projected/05e43e16-5627-4bd9-986b-72c35f551904-kube-api-access-t2rmr\") pod \"authorino-5dc7ccb5f-4d9bv\" (UID: \"05e43e16-5627-4bd9-986b-72c35f551904\") " pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:00.528374 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.528269    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-xpwph"]
Jul 31 00:19:00.528597 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:19:00.528574    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-26mzb tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-xpwph" podUID="1764d464-51ef-484b-822c-4d0e8279b8fc"
Jul 31 00:19:00.532668 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.532632    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26mzb\" (UniqueName: \"kubernetes.io/projected/1764d464-51ef-484b-822c-4d0e8279b8fc-kube-api-access-26mzb\") pod \"authorino-687bd45585-xpwph\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") " pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.532851 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.532708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1764d464-51ef-484b-822c-4d0e8279b8fc-tls-cert\") pod \"authorino-687bd45585-xpwph\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") " pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.535329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.535307    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1764d464-51ef-484b-822c-4d0e8279b8fc-tls-cert\") pod \"authorino-687bd45585-xpwph\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") " pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.545945 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.545920    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mzb\" (UniqueName: \"kubernetes.io/projected/1764d464-51ef-484b-822c-4d0e8279b8fc-kube-api-access-26mzb\") pod \"authorino-687bd45585-xpwph\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") " pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.554365 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.554330    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f4c5d7c57-zgcz7"]
Jul 31 00:19:00.556828 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.556808    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.563378 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.563344    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4c5d7c57-zgcz7"]
Jul 31 00:19:00.633983 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.633946    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lshh\" (UniqueName: \"kubernetes.io/projected/d9bd504a-bc99-4bce-a284-cddaaf480ad0-kube-api-access-9lshh\") pod \"authorino-f4c5d7c57-zgcz7\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") " pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.634199 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.634026    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9bd504a-bc99-4bce-a284-cddaaf480ad0-tls-cert\") pod \"authorino-f4c5d7c57-zgcz7\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") " pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.727799 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.727767    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:00.727987 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.727750    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.735058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.735028    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9bd504a-bc99-4bce-a284-cddaaf480ad0-tls-cert\") pod \"authorino-f4c5d7c57-zgcz7\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") " pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.735461 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.735117    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lshh\" (UniqueName: \"kubernetes.io/projected/d9bd504a-bc99-4bce-a284-cddaaf480ad0-kube-api-access-9lshh\") pod \"authorino-f4c5d7c57-zgcz7\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") " pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.737804 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.737779    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9bd504a-bc99-4bce-a284-cddaaf480ad0-tls-cert\") pod \"authorino-f4c5d7c57-zgcz7\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") " pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.747024 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.746993    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lshh\" (UniqueName: \"kubernetes.io/projected/d9bd504a-bc99-4bce-a284-cddaaf480ad0-kube-api-access-9lshh\") pod \"authorino-f4c5d7c57-zgcz7\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") " pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.751595 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.751570    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:00.764137 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.764106    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:00.836079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.835982    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2rmr\" (UniqueName: \"kubernetes.io/projected/05e43e16-5627-4bd9-986b-72c35f551904-kube-api-access-t2rmr\") pod \"05e43e16-5627-4bd9-986b-72c35f551904\" (UID: \"05e43e16-5627-4bd9-986b-72c35f551904\") "
Jul 31 00:19:00.836079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.836023    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1764d464-51ef-484b-822c-4d0e8279b8fc-tls-cert\") pod \"1764d464-51ef-484b-822c-4d0e8279b8fc\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") "
Jul 31 00:19:00.836079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.836045    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26mzb\" (UniqueName: \"kubernetes.io/projected/1764d464-51ef-484b-822c-4d0e8279b8fc-kube-api-access-26mzb\") pod \"1764d464-51ef-484b-822c-4d0e8279b8fc\" (UID: \"1764d464-51ef-484b-822c-4d0e8279b8fc\") "
Jul 31 00:19:00.838424 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.838393    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1764d464-51ef-484b-822c-4d0e8279b8fc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1764d464-51ef-484b-822c-4d0e8279b8fc" (UID: "1764d464-51ef-484b-822c-4d0e8279b8fc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:19:00.838424 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.838407    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1764d464-51ef-484b-822c-4d0e8279b8fc-kube-api-access-26mzb" (OuterVolumeSpecName: "kube-api-access-26mzb") pod "1764d464-51ef-484b-822c-4d0e8279b8fc" (UID: "1764d464-51ef-484b-822c-4d0e8279b8fc"). InnerVolumeSpecName "kube-api-access-26mzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:19:00.838586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.838398    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e43e16-5627-4bd9-986b-72c35f551904-kube-api-access-t2rmr" (OuterVolumeSpecName: "kube-api-access-t2rmr") pod "05e43e16-5627-4bd9-986b-72c35f551904" (UID: "05e43e16-5627-4bd9-986b-72c35f551904"). InnerVolumeSpecName "kube-api-access-t2rmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:19:00.885892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.885865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:19:00.937641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.937472    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2rmr\" (UniqueName: \"kubernetes.io/projected/05e43e16-5627-4bd9-986b-72c35f551904-kube-api-access-t2rmr\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:19:00.937641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.937501    2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1764d464-51ef-484b-822c-4d0e8279b8fc-tls-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:19:00.937641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:00.937518    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26mzb\" (UniqueName: \"kubernetes.io/projected/1764d464-51ef-484b-822c-4d0e8279b8fc-kube-api-access-26mzb\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:19:01.027195 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.027148    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4c5d7c57-zgcz7"]
Jul 31 00:19:01.029982 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:19:01.029951    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9bd504a_bc99_4bce_a284_cddaaf480ad0.slice/crio-f47b9d1ccde6f6f034a44b8f6a16ba3aec56057441a26bc7bb4a9c535fa39442 WatchSource:0}: Error finding container f47b9d1ccde6f6f034a44b8f6a16ba3aec56057441a26bc7bb4a9c535fa39442: Status 404 returned error can't find the container with id f47b9d1ccde6f6f034a44b8f6a16ba3aec56057441a26bc7bb4a9c535fa39442
Jul 31 00:19:01.734911 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.734877    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7" event={"ID":"d9bd504a-bc99-4bce-a284-cddaaf480ad0","Type":"ContainerStarted","Data":"f47b9d1ccde6f6f034a44b8f6a16ba3aec56057441a26bc7bb4a9c535fa39442"}
Jul 31 00:19:01.735074 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.734923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-xpwph"
Jul 31 00:19:01.735074 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.734926    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-4d9bv"
Jul 31 00:19:01.764030 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.763989    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-xpwph"]
Jul 31 00:19:01.767557 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.767519    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-xpwph"]
Jul 31 00:19:01.785606 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.785570    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-4d9bv"]
Jul 31 00:19:01.787586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.787558    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-4d9bv"]
Jul 31 00:19:01.867203 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.867168    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e43e16-5627-4bd9-986b-72c35f551904" path="/var/lib/kubelet/pods/05e43e16-5627-4bd9-986b-72c35f551904/volumes"
Jul 31 00:19:01.867420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:01.867407    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1764d464-51ef-484b-822c-4d0e8279b8fc" path="/var/lib/kubelet/pods/1764d464-51ef-484b-822c-4d0e8279b8fc/volumes"
Jul 31 00:19:02.744879 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:02.744839    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7" event={"ID":"d9bd504a-bc99-4bce-a284-cddaaf480ad0","Type":"ContainerStarted","Data":"e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb"}
Jul 31 00:19:02.765232 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:02.765166    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7" podStartSLOduration=2.142996978 podStartE2EDuration="2.76514968s" totalImagesPullingTime="622.152702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:19:02.763932586 +0000 UTC m=+747.487898555" watchObservedRunningTime="2026-07-31 00:19:02.76514968 +0000 UTC m=+747.489115706"
Jul 31 00:19:07.750086 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.750054    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-wnn6s"]
Jul 31 00:19:07.760772 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.760700    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:07.762553 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.762529    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 00:19:07.762729 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.762537    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 00:19:07.762873 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.762597    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bsnn2\""
Jul 31 00:19:07.763825 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.763643    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-wnn6s"]
Jul 31 00:19:07.800265 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.800223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j846h\" (UniqueName: \"kubernetes.io/projected/3b045b60-bbc4-4b40-b793-7894ed137281-kube-api-access-j846h\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:07.800473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.800308    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:07.901171 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.901129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j846h\" (UniqueName: \"kubernetes.io/projected/3b045b60-bbc4-4b40-b793-7894ed137281-kube-api-access-j846h\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:07.901364 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.901210    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:07.901364 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:19:07.901309    2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 31 00:19:07.901438 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:19:07.901367    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert podName:3b045b60-bbc4-4b40-b793-7894ed137281 nodeName:}" failed. No retries permitted until 2026-07-31 00:19:08.401349702 +0000 UTC m=+753.125315647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert") pod "maas-controller-5c9699fb4f-wnn6s" (UID: "3b045b60-bbc4-4b40-b793-7894ed137281") : secret "maas-controller-webhook-cert" not found
Jul 31 00:19:07.909298 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:07.909271    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j846h\" (UniqueName: \"kubernetes.io/projected/3b045b60-bbc4-4b40-b793-7894ed137281-kube-api-access-j846h\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:08.408094 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:08.408049    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:08.410805 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:08.410783    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert\") pod \"maas-controller-5c9699fb4f-wnn6s\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") " pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:08.674981 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:08.674870    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:08.821592 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:08.821565    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-wnn6s"]
Jul 31 00:19:08.824495 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:19:08.824460    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b045b60_bbc4_4b40_b793_7894ed137281.slice/crio-cd4fe3d3aa0fbe4b5b21dbde53bf2e598fc815c1e770347aea2339e43d784520 WatchSource:0}: Error finding container cd4fe3d3aa0fbe4b5b21dbde53bf2e598fc815c1e770347aea2339e43d784520: Status 404 returned error can't find the container with id cd4fe3d3aa0fbe4b5b21dbde53bf2e598fc815c1e770347aea2339e43d784520
Jul 31 00:19:09.781970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:09.781918    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s" event={"ID":"3b045b60-bbc4-4b40-b793-7894ed137281","Type":"ContainerStarted","Data":"cd4fe3d3aa0fbe4b5b21dbde53bf2e598fc815c1e770347aea2339e43d784520"}
Jul 31 00:19:11.793677 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:11.793641    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s" event={"ID":"3b045b60-bbc4-4b40-b793-7894ed137281","Type":"ContainerStarted","Data":"26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb"}
Jul 31 00:19:11.794167 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:11.793817    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:11.812744 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:11.812681    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s" podStartSLOduration=2.437662836 podStartE2EDuration="4.812662725s" totalImagesPullingTime="2.374999889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:19:11.811879957 +0000 UTC m=+756.535845924" watchObservedRunningTime="2026-07-31 00:19:11.812662725 +0000 UTC m=+756.536628694"
Jul 31 00:19:22.800440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:22.800407    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:19:45.099986 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.099945    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"]
Jul 31 00:19:45.105050 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.105026    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.106885 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.106859    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 31 00:19:45.113819 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.113795    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"]
Jul 31 00:19:45.140661 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.140626    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-km5qk"]
Jul 31 00:19:45.143328 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.143299    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.144664 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.144638    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f95298ac-098e-40b3-bb16-de35d3ecab23-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-pfb45\" (UID: \"f95298ac-098e-40b3-bb16-de35d3ecab23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.144792 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.144676    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4qzx\" (UniqueName: \"kubernetes.io/projected/f95298ac-098e-40b3-bb16-de35d3ecab23-kube-api-access-t4qzx\") pod \"payload-pre-processing-687dbb6cf6-pfb45\" (UID: \"f95298ac-098e-40b3-bb16-de35d3ecab23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.145102 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.145087    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9z7gq\""
Jul 31 00:19:45.156326 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.156296    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-km5qk"]
Jul 31 00:19:45.246223 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.246183    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6gx\" (UniqueName: \"kubernetes.io/projected/5648c4a6-8434-4cfc-829e-dc24c83252f6-kube-api-access-lr6gx\") pod \"payload-processing-5cc6cd444b-km5qk\" (UID: \"5648c4a6-8434-4cfc-829e-dc24c83252f6\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.246399 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.246240    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5648c4a6-8434-4cfc-829e-dc24c83252f6-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-km5qk\" (UID: \"5648c4a6-8434-4cfc-829e-dc24c83252f6\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.246399 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.246307    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f95298ac-098e-40b3-bb16-de35d3ecab23-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-pfb45\" (UID: \"f95298ac-098e-40b3-bb16-de35d3ecab23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.246399 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.246338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4qzx\" (UniqueName: \"kubernetes.io/projected/f95298ac-098e-40b3-bb16-de35d3ecab23-kube-api-access-t4qzx\") pod \"payload-pre-processing-687dbb6cf6-pfb45\" (UID: \"f95298ac-098e-40b3-bb16-de35d3ecab23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.247058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.247035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f95298ac-098e-40b3-bb16-de35d3ecab23-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-pfb45\" (UID: \"f95298ac-098e-40b3-bb16-de35d3ecab23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.254999 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.254970    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4qzx\" (UniqueName: \"kubernetes.io/projected/f95298ac-098e-40b3-bb16-de35d3ecab23-kube-api-access-t4qzx\") pod \"payload-pre-processing-687dbb6cf6-pfb45\" (UID: \"f95298ac-098e-40b3-bb16-de35d3ecab23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.346883 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.346844    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6gx\" (UniqueName: \"kubernetes.io/projected/5648c4a6-8434-4cfc-829e-dc24c83252f6-kube-api-access-lr6gx\") pod \"payload-processing-5cc6cd444b-km5qk\" (UID: \"5648c4a6-8434-4cfc-829e-dc24c83252f6\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.347078 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.346893    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5648c4a6-8434-4cfc-829e-dc24c83252f6-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-km5qk\" (UID: \"5648c4a6-8434-4cfc-829e-dc24c83252f6\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.347598 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.347567    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5648c4a6-8434-4cfc-829e-dc24c83252f6-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-km5qk\" (UID: \"5648c4a6-8434-4cfc-829e-dc24c83252f6\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.354270 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.354199    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6gx\" (UniqueName: \"kubernetes.io/projected/5648c4a6-8434-4cfc-829e-dc24c83252f6-kube-api-access-lr6gx\") pod \"payload-processing-5cc6cd444b-km5qk\" (UID: \"5648c4a6-8434-4cfc-829e-dc24c83252f6\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.416905 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.416868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:45.453655 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.453613    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:45.568555 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.568507    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"]
Jul 31 00:19:45.572440 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:19:45.572361    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95298ac_098e_40b3_bb16_de35d3ecab23.slice/crio-47454d16a78778dc275908a45c3941d1855a0047088bb6bdac789fa09cf1a46c WatchSource:0}: Error finding container 47454d16a78778dc275908a45c3941d1855a0047088bb6bdac789fa09cf1a46c: Status 404 returned error can't find the container with id 47454d16a78778dc275908a45c3941d1855a0047088bb6bdac789fa09cf1a46c
Jul 31 00:19:45.610129 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.610110    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-km5qk"]
Jul 31 00:19:45.613005 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:19:45.612969    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5648c4a6_8434_4cfc_829e_dc24c83252f6.slice/crio-2dbd18b74483e1c9839403a9fc8f225bd7d28b7f811b0924b63ed6393e98b116 WatchSource:0}: Error finding container 2dbd18b74483e1c9839403a9fc8f225bd7d28b7f811b0924b63ed6393e98b116: Status 404 returned error can't find the container with id 2dbd18b74483e1c9839403a9fc8f225bd7d28b7f811b0924b63ed6393e98b116
Jul 31 00:19:45.957925 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.957883    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45" event={"ID":"f95298ac-098e-40b3-bb16-de35d3ecab23","Type":"ContainerStarted","Data":"47454d16a78778dc275908a45c3941d1855a0047088bb6bdac789fa09cf1a46c"}
Jul 31 00:19:45.959084 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:45.959054    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk" event={"ID":"5648c4a6-8434-4cfc-829e-dc24c83252f6","Type":"ContainerStarted","Data":"2dbd18b74483e1c9839403a9fc8f225bd7d28b7f811b0924b63ed6393e98b116"}
Jul 31 00:19:48.981676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:48.981638    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45" event={"ID":"f95298ac-098e-40b3-bb16-de35d3ecab23","Type":"ContainerStarted","Data":"661a6208243fd03b738bdaf2073ea0fbe770e8769db6a0925516733f8453cb4d"}
Jul 31 00:19:48.982254 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:48.981819    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:48.983265 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:48.983236    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk" event={"ID":"5648c4a6-8434-4cfc-829e-dc24c83252f6","Type":"ContainerStarted","Data":"e36608e2a347c8c1fc40f68ea0ec53691d8cf0c3f015e225e5c944b4a45dffe5"}
Jul 31 00:19:48.983415 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:48.983373    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:19:48.996175 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:48.996115    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45" podStartSLOduration=1.464956768 podStartE2EDuration="3.996093879s" totalImagesPullingTime="2.531137111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:19:48.99462863 +0000 UTC m=+793.718594624" watchObservedRunningTime="2026-07-31 00:19:48.996093879 +0000 UTC m=+793.720059845"
Jul 31 00:19:49.007587 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:49.007527    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk" podStartSLOduration=1.506353625 podStartE2EDuration="4.00750726s" totalImagesPullingTime="2.501153635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:19:49.006608289 +0000 UTC m=+793.730574272" watchObservedRunningTime="2026-07-31 00:19:49.00750726 +0000 UTC m=+793.731473228"
Jul 31 00:19:59.991022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:59.990936    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-pfb45"
Jul 31 00:19:59.991022 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:19:59.991010    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-km5qk"
Jul 31 00:20:13.675477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.675438    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"]
Jul 31 00:20:13.679966 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.679944    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.681738 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.681710    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 31 00:20:13.681919 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.681832    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2gmq\""
Jul 31 00:20:13.682132 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.682116    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 00:20:13.682202 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.682149    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 00:20:13.688340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.687932    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"]
Jul 31 00:20:13.814694 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.814652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51aa949-2bcf-4be4-902c-03add36c2759-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.814902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.814705    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.814902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.814727    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprnd\" (UniqueName: \"kubernetes.io/projected/f51aa949-2bcf-4be4-902c-03add36c2759-kube-api-access-kprnd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.814902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.814866    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.814902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.814896    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.815038 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.814916    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.915514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.915470    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51aa949-2bcf-4be4-902c-03add36c2759-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.915514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.915524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.915792 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.915551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprnd\" (UniqueName: \"kubernetes.io/projected/f51aa949-2bcf-4be4-902c-03add36c2759-kube-api-access-kprnd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.915792 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.915651    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.915792 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.915679    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.915792 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.915702    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.916079 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.916049    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.916140 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.916091    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.916192 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.916144    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.918251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.918227    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51aa949-2bcf-4be4-902c-03add36c2759-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.918579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.918560    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51aa949-2bcf-4be4-902c-03add36c2759-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.923690 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.923661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprnd\" (UniqueName: \"kubernetes.io/projected/f51aa949-2bcf-4be4-902c-03add36c2759-kube-api-access-kprnd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm\" (UID: \"f51aa949-2bcf-4be4-902c-03add36c2759\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:13.992359 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:13.992297    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:14.140068 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:14.140028    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"]
Jul 31 00:20:14.143799 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:20:14.143747    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51aa949_2bcf_4be4_902c_03add36c2759.slice/crio-85ad7b1b1342eb00c05aec4611928a6a84f4a1a6b7df976a157b6f446b05f589 WatchSource:0}: Error finding container 85ad7b1b1342eb00c05aec4611928a6a84f4a1a6b7df976a157b6f446b05f589: Status 404 returned error can't find the container with id 85ad7b1b1342eb00c05aec4611928a6a84f4a1a6b7df976a157b6f446b05f589
Jul 31 00:20:15.108102 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:15.108053    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm" event={"ID":"f51aa949-2bcf-4be4-902c-03add36c2759","Type":"ContainerStarted","Data":"85ad7b1b1342eb00c05aec4611928a6a84f4a1a6b7df976a157b6f446b05f589"}
Jul 31 00:20:16.115064 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:16.115020    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm" event={"ID":"f51aa949-2bcf-4be4-902c-03add36c2759","Type":"ContainerStarted","Data":"0af00a373296cad919434c60b7669484812a3b4b09c6e43dd77539e821f5d5cc"}
Jul 31 00:20:16.131250 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:16.131183    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm" podStartSLOduration=1.923773848 podStartE2EDuration="3.131163953s" totalImagesPullingTime="1.207390105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:20:16.129286947 +0000 UTC m=+820.853252937" watchObservedRunningTime="2026-07-31 00:20:16.131163953 +0000 UTC m=+820.855129919"
Jul 31 00:20:23.681849 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.681811    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"]
Jul 31 00:20:23.688226 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.688198    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.690020 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.689992    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 31 00:20:23.693007 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.692975    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"]
Jul 31 00:20:23.699827 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.699800    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.699980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.699831    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533b8a1a-e47b-433d-8dde-cf8fff30c61d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.699980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.699887    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.699980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.699966    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dzrm\" (UniqueName: \"kubernetes.io/projected/533b8a1a-e47b-433d-8dde-cf8fff30c61d-kube-api-access-7dzrm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.700150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.700010    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.700150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.700077    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.800730 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.800694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.800730 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.800736    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dzrm\" (UniqueName: \"kubernetes.io/projected/533b8a1a-e47b-433d-8dde-cf8fff30c61d-kube-api-access-7dzrm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801011 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.800786    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801011 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.800819    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801011 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.800866    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801011 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.800881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533b8a1a-e47b-433d-8dde-cf8fff30c61d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.801217    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.801234    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.801334 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.801280    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.803394 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.803368    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/533b8a1a-e47b-433d-8dde-cf8fff30c61d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.803610 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.803590    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/533b8a1a-e47b-433d-8dde-cf8fff30c61d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.809016 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.808993    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dzrm\" (UniqueName: \"kubernetes.io/projected/533b8a1a-e47b-433d-8dde-cf8fff30c61d-kube-api-access-7dzrm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vx8tx\" (UID: \"533b8a1a-e47b-433d-8dde-cf8fff30c61d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:23.993272 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.993172    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:23.993272 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:23.993247    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:24.000347 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:24.000308    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:24.006661 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:24.006632    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:24.151733 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:24.151577    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"]
Jul 31 00:20:24.155108 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:20:24.155077    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533b8a1a_e47b_433d_8dde_cf8fff30c61d.slice/crio-8cbdb3b3d575ad665a5d7fb3689d18369f35919c0568e858ed52b5897c570641 WatchSource:0}: Error finding container 8cbdb3b3d575ad665a5d7fb3689d18369f35919c0568e858ed52b5897c570641: Status 404 returned error can't find the container with id 8cbdb3b3d575ad665a5d7fb3689d18369f35919c0568e858ed52b5897c570641
Jul 31 00:20:24.168347 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:24.168293    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm"
Jul 31 00:20:25.162188 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:25.162143    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx" event={"ID":"533b8a1a-e47b-433d-8dde-cf8fff30c61d","Type":"ContainerStarted","Data":"89a04c114404ffd7f2a1343e47d5b97738bc77fe4378b2583704397dc12f5946"}
Jul 31 00:20:25.162644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:25.162253    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx" event={"ID":"533b8a1a-e47b-433d-8dde-cf8fff30c61d","Type":"ContainerStarted","Data":"8cbdb3b3d575ad665a5d7fb3689d18369f35919c0568e858ed52b5897c570641"}
Jul 31 00:20:25.177984 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:25.177928    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx" podStartSLOduration=2.00468783 podStartE2EDuration="2.177910299s" totalImagesPullingTime="173.222469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:20:25.177209763 +0000 UTC m=+829.901175728" watchObservedRunningTime="2026-07-31 00:20:25.177910299 +0000 UTC m=+829.901876333"
Jul 31 00:20:34.000548 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:34.000493    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:34.000992 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:34.000582    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:34.013912 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:34.013879    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:20:34.215581 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:20:34.215538    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vx8tx"
Jul 31 00:21:47.731221 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.731181    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86c56db9f6-f8ht8"]
Jul 31 00:21:47.734748 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.734727    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:47.740616 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.740586    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c56db9f6-f8ht8"]
Jul 31 00:21:47.863230 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.863193    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k86qs\" (UniqueName: \"kubernetes.io/projected/f8e474b0-f962-4f6b-b0eb-5785f3e61ada-kube-api-access-k86qs\") pod \"authorino-86c56db9f6-f8ht8\" (UID: \"f8e474b0-f962-4f6b-b0eb-5785f3e61ada\") " pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:47.863411 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.863252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8e474b0-f962-4f6b-b0eb-5785f3e61ada-tls-cert\") pod \"authorino-86c56db9f6-f8ht8\" (UID: \"f8e474b0-f962-4f6b-b0eb-5785f3e61ada\") " pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:47.964600 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.964557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k86qs\" (UniqueName: \"kubernetes.io/projected/f8e474b0-f962-4f6b-b0eb-5785f3e61ada-kube-api-access-k86qs\") pod \"authorino-86c56db9f6-f8ht8\" (UID: \"f8e474b0-f962-4f6b-b0eb-5785f3e61ada\") " pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:47.964827 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.964620    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8e474b0-f962-4f6b-b0eb-5785f3e61ada-tls-cert\") pod \"authorino-86c56db9f6-f8ht8\" (UID: \"f8e474b0-f962-4f6b-b0eb-5785f3e61ada\") " pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:47.967391 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.967364    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8e474b0-f962-4f6b-b0eb-5785f3e61ada-tls-cert\") pod \"authorino-86c56db9f6-f8ht8\" (UID: \"f8e474b0-f962-4f6b-b0eb-5785f3e61ada\") " pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:47.971569 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:47.971540    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k86qs\" (UniqueName: \"kubernetes.io/projected/f8e474b0-f962-4f6b-b0eb-5785f3e61ada-kube-api-access-k86qs\") pod \"authorino-86c56db9f6-f8ht8\" (UID: \"f8e474b0-f962-4f6b-b0eb-5785f3e61ada\") " pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:48.045674 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:48.045583    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c56db9f6-f8ht8"
Jul 31 00:21:48.188380 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:48.188352    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c56db9f6-f8ht8"]
Jul 31 00:21:48.191247 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:21:48.191219    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8e474b0_f962_4f6b_b0eb_5785f3e61ada.slice/crio-d908a0c6fc49d8bbc59d8dba59d04212eaa874d409835b4fec1414e4e003429c WatchSource:0}: Error finding container d908a0c6fc49d8bbc59d8dba59d04212eaa874d409835b4fec1414e4e003429c: Status 404 returned error can't find the container with id d908a0c6fc49d8bbc59d8dba59d04212eaa874d409835b4fec1414e4e003429c
Jul 31 00:21:48.192569 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:48.192548    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:21:48.561570 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:48.561533    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c56db9f6-f8ht8" event={"ID":"f8e474b0-f962-4f6b-b0eb-5785f3e61ada","Type":"ContainerStarted","Data":"d908a0c6fc49d8bbc59d8dba59d04212eaa874d409835b4fec1414e4e003429c"}
Jul 31 00:21:49.569377 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.569337    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c56db9f6-f8ht8" event={"ID":"f8e474b0-f962-4f6b-b0eb-5785f3e61ada","Type":"ContainerStarted","Data":"3c102cc3528986545bea0677add455dc7134c1097355be1288a938e350ba311b"}
Jul 31 00:21:49.586506 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.586423    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86c56db9f6-f8ht8" podStartSLOduration=1.821731567 podStartE2EDuration="2.586400741s" totalImagesPullingTime="764.669174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:21:49.584769889 +0000 UTC m=+914.308735847" watchObservedRunningTime="2026-07-31 00:21:49.586400741 +0000 UTC m=+914.310366709"
Jul 31 00:21:49.617986 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.617932    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f4c5d7c57-zgcz7"]
Jul 31 00:21:49.618224 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.618173    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7" podUID="d9bd504a-bc99-4bce-a284-cddaaf480ad0" containerName="authorino" containerID="cri-o://e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb" gracePeriod=30
Jul 31 00:21:49.889235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.889201    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:21:49.983133 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.983097    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9bd504a-bc99-4bce-a284-cddaaf480ad0-tls-cert\") pod \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") "
Jul 31 00:21:49.983341 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.983242    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lshh\" (UniqueName: \"kubernetes.io/projected/d9bd504a-bc99-4bce-a284-cddaaf480ad0-kube-api-access-9lshh\") pod \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\" (UID: \"d9bd504a-bc99-4bce-a284-cddaaf480ad0\") "
Jul 31 00:21:49.985513 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.985465    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bd504a-bc99-4bce-a284-cddaaf480ad0-kube-api-access-9lshh" (OuterVolumeSpecName: "kube-api-access-9lshh") pod "d9bd504a-bc99-4bce-a284-cddaaf480ad0" (UID: "d9bd504a-bc99-4bce-a284-cddaaf480ad0"). InnerVolumeSpecName "kube-api-access-9lshh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:21:49.995718 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:49.995672    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bd504a-bc99-4bce-a284-cddaaf480ad0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d9bd504a-bc99-4bce-a284-cddaaf480ad0" (UID: "d9bd504a-bc99-4bce-a284-cddaaf480ad0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:21:50.084802 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.084739    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lshh\" (UniqueName: \"kubernetes.io/projected/d9bd504a-bc99-4bce-a284-cddaaf480ad0-kube-api-access-9lshh\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:21:50.084802 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.084794    2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9bd504a-bc99-4bce-a284-cddaaf480ad0-tls-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:21:50.576748 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.576709    2555 generic.go:356] "Generic (PLEG): container finished" podID="d9bd504a-bc99-4bce-a284-cddaaf480ad0" containerID="e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb" exitCode=0
Jul 31 00:21:50.577267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.576790    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7"
Jul 31 00:21:50.577267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.576796    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7" event={"ID":"d9bd504a-bc99-4bce-a284-cddaaf480ad0","Type":"ContainerDied","Data":"e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb"}
Jul 31 00:21:50.577267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.576843    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4c5d7c57-zgcz7" event={"ID":"d9bd504a-bc99-4bce-a284-cddaaf480ad0","Type":"ContainerDied","Data":"f47b9d1ccde6f6f034a44b8f6a16ba3aec56057441a26bc7bb4a9c535fa39442"}
Jul 31 00:21:50.577267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.576862    2555 scope.go:117] "RemoveContainer" containerID="e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb"
Jul 31 00:21:50.589167 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.589127    2555 scope.go:117] "RemoveContainer" containerID="e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb"
Jul 31 00:21:50.590018 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:21:50.589992    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb\": container with ID starting with e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb not found: ID does not exist" containerID="e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb"
Jul 31 00:21:50.590128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.590031    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb"} err="failed to get container status \"e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb\": rpc error: code = NotFound desc = could not find container \"e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb\": container with ID starting with e49fc22e4c4759fd8c02d4d223599e5b5487e3aab05ae36c2c4a79f6ec046ecb not found: ID does not exist"
Jul 31 00:21:50.614335 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.614294    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f4c5d7c57-zgcz7"]
Jul 31 00:21:50.620697 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:50.620667    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f4c5d7c57-zgcz7"]
Jul 31 00:21:51.867637 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:21:51.867594    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9bd504a-bc99-4bce-a284-cddaaf480ad0" path="/var/lib/kubelet/pods/d9bd504a-bc99-4bce-a284-cddaaf480ad0/volumes"
Jul 31 00:22:37.943618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:37.943579    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-wnn6s"]
Jul 31 00:22:37.944175 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:37.943827    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s" podUID="3b045b60-bbc4-4b40-b793-7894ed137281" containerName="manager" containerID="cri-o://26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb" gracePeriod=30
Jul 31 00:22:38.203781 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.203680    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:22:38.239449 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.239413    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert\") pod \"3b045b60-bbc4-4b40-b793-7894ed137281\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") "
Jul 31 00:22:38.241891 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.241847    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3b045b60-bbc4-4b40-b793-7894ed137281" (UID: "3b045b60-bbc4-4b40-b793-7894ed137281"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:22:38.340027 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.339987    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j846h\" (UniqueName: \"kubernetes.io/projected/3b045b60-bbc4-4b40-b793-7894ed137281-kube-api-access-j846h\") pod \"3b045b60-bbc4-4b40-b793-7894ed137281\" (UID: \"3b045b60-bbc4-4b40-b793-7894ed137281\") "
Jul 31 00:22:38.340275 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.340258    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b045b60-bbc4-4b40-b793-7894ed137281-webhook-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:22:38.342271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.342239    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b045b60-bbc4-4b40-b793-7894ed137281-kube-api-access-j846h" (OuterVolumeSpecName: "kube-api-access-j846h") pod "3b045b60-bbc4-4b40-b793-7894ed137281" (UID: "3b045b60-bbc4-4b40-b793-7894ed137281"). InnerVolumeSpecName "kube-api-access-j846h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:22:38.440703 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.440666    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j846h\" (UniqueName: \"kubernetes.io/projected/3b045b60-bbc4-4b40-b793-7894ed137281-kube-api-access-j846h\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:22:38.811064 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.811016    2555 generic.go:356] "Generic (PLEG): container finished" podID="3b045b60-bbc4-4b40-b793-7894ed137281" containerID="26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb" exitCode=0
Jul 31 00:22:38.811269 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.811082    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s"
Jul 31 00:22:38.811269 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.811086    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s" event={"ID":"3b045b60-bbc4-4b40-b793-7894ed137281","Type":"ContainerDied","Data":"26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb"}
Jul 31 00:22:38.811269 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.811166    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-wnn6s" event={"ID":"3b045b60-bbc4-4b40-b793-7894ed137281","Type":"ContainerDied","Data":"cd4fe3d3aa0fbe4b5b21dbde53bf2e598fc815c1e770347aea2339e43d784520"}
Jul 31 00:22:38.811269 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.811197    2555 scope.go:117] "RemoveContainer" containerID="26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb"
Jul 31 00:22:38.821460 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.821434    2555 scope.go:117] "RemoveContainer" containerID="26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb"
Jul 31 00:22:38.821876 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:22:38.821853    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb\": container with ID starting with 26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb not found: ID does not exist" containerID="26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb"
Jul 31 00:22:38.821963 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.821888    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb"} err="failed to get container status \"26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb\": rpc error: code = NotFound desc = could not find container \"26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb\": container with ID starting with 26425edd5671869e14eafb38ec78123e565209ebae3358f32c468c2201e22cbb not found: ID does not exist"
Jul 31 00:22:38.833340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.833301    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-wnn6s"]
Jul 31 00:22:38.836485 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:38.836451    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-wnn6s"]
Jul 31 00:22:39.866903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:22:39.866866    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b045b60-bbc4-4b40-b793-7894ed137281" path="/var/lib/kubelet/pods/3b045b60-bbc4-4b40-b793-7894ed137281/volumes"
Jul 31 00:23:39.703864 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.703823    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-x8zst"]
Jul 31 00:23:39.704284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.704269    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bd504a-bc99-4bce-a284-cddaaf480ad0" containerName="authorino"
Jul 31 00:23:39.704284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.704281    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bd504a-bc99-4bce-a284-cddaaf480ad0" containerName="authorino"
Jul 31 00:23:39.704379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.704295    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b045b60-bbc4-4b40-b793-7894ed137281" containerName="manager"
Jul 31 00:23:39.704379 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.704308    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b045b60-bbc4-4b40-b793-7894ed137281" containerName="manager"
Jul 31 00:23:39.704444 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.704386    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b045b60-bbc4-4b40-b793-7894ed137281" containerName="manager"
Jul 31 00:23:39.704444 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.704396    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9bd504a-bc99-4bce-a284-cddaaf480ad0" containerName="authorino"
Jul 31 00:23:39.707524 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.707505    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:39.711238 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.711215    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 00:23:39.711393 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.711215    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bsnn2\""
Jul 31 00:23:39.711393 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.711385    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 00:23:39.722273 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.722242    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-x8zst"]
Jul 31 00:23:39.817019 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.816975    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4d7f80-3a42-4181-9fda-b640046afbdd-webhook-cert\") pod \"maas-controller-5c9699fb4f-x8zst\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") " pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:39.817203 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.817036    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnxl\" (UniqueName: \"kubernetes.io/projected/ae4d7f80-3a42-4181-9fda-b640046afbdd-kube-api-access-4rnxl\") pod \"maas-controller-5c9699fb4f-x8zst\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") " pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:39.917824 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.917747    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4d7f80-3a42-4181-9fda-b640046afbdd-webhook-cert\") pod \"maas-controller-5c9699fb4f-x8zst\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") " pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:39.918031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.917858    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnxl\" (UniqueName: \"kubernetes.io/projected/ae4d7f80-3a42-4181-9fda-b640046afbdd-kube-api-access-4rnxl\") pod \"maas-controller-5c9699fb4f-x8zst\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") " pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:39.920741 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.920716    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4d7f80-3a42-4181-9fda-b640046afbdd-webhook-cert\") pod \"maas-controller-5c9699fb4f-x8zst\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") " pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:39.925717 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:39.925688    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnxl\" (UniqueName: \"kubernetes.io/projected/ae4d7f80-3a42-4181-9fda-b640046afbdd-kube-api-access-4rnxl\") pod \"maas-controller-5c9699fb4f-x8zst\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") " pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:40.018366 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:40.018272    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:40.167911 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:40.167886    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-x8zst"]
Jul 31 00:23:40.171112 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:23:40.171084    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4d7f80_3a42_4181_9fda_b640046afbdd.slice/crio-2c8a3fa3f0fccb17fae20388daf4f607261db2b8a0ff4f34f3149ee8a14bb20d WatchSource:0}: Error finding container 2c8a3fa3f0fccb17fae20388daf4f607261db2b8a0ff4f34f3149ee8a14bb20d: Status 404 returned error can't find the container with id 2c8a3fa3f0fccb17fae20388daf4f607261db2b8a0ff4f34f3149ee8a14bb20d
Jul 31 00:23:41.109830 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:41.109790    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-x8zst" event={"ID":"ae4d7f80-3a42-4181-9fda-b640046afbdd","Type":"ContainerStarted","Data":"6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc"}
Jul 31 00:23:41.110279 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:41.109859    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-x8zst" event={"ID":"ae4d7f80-3a42-4181-9fda-b640046afbdd","Type":"ContainerStarted","Data":"2c8a3fa3f0fccb17fae20388daf4f607261db2b8a0ff4f34f3149ee8a14bb20d"}
Jul 31 00:23:41.110279 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:41.109994    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:41.125021 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:41.124955    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c9699fb4f-x8zst" podStartSLOduration=1.409119182 podStartE2EDuration="2.12493593s" totalImagesPullingTime="715.816748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:23:41.124162407 +0000 UTC m=+1025.848128373" watchObservedRunningTime="2026-07-31 00:23:41.12493593 +0000 UTC m=+1025.848901897"
Jul 31 00:23:52.117586 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:52.117547    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:56.779526 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:56.779480    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-x8zst"]
Jul 31 00:23:56.780026 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:56.779694    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c9699fb4f-x8zst" podUID="ae4d7f80-3a42-4181-9fda-b640046afbdd" containerName="manager" containerID="cri-o://6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc" gracePeriod=30
Jul 31 00:23:57.036555 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.036484    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:57.187482 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.187445    2555 generic.go:356] "Generic (PLEG): container finished" podID="ae4d7f80-3a42-4181-9fda-b640046afbdd" containerID="6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc" exitCode=0
Jul 31 00:23:57.187680 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.187504    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-x8zst"
Jul 31 00:23:57.187680 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.187526    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-x8zst" event={"ID":"ae4d7f80-3a42-4181-9fda-b640046afbdd","Type":"ContainerDied","Data":"6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc"}
Jul 31 00:23:57.187680 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.187575    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-x8zst" event={"ID":"ae4d7f80-3a42-4181-9fda-b640046afbdd","Type":"ContainerDied","Data":"2c8a3fa3f0fccb17fae20388daf4f607261db2b8a0ff4f34f3149ee8a14bb20d"}
Jul 31 00:23:57.187680 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.187599    2555 scope.go:117] "RemoveContainer" containerID="6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc"
Jul 31 00:23:57.189948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.189927    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4d7f80-3a42-4181-9fda-b640046afbdd-webhook-cert\") pod \"ae4d7f80-3a42-4181-9fda-b640046afbdd\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") "
Jul 31 00:23:57.190098 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.189954    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rnxl\" (UniqueName: \"kubernetes.io/projected/ae4d7f80-3a42-4181-9fda-b640046afbdd-kube-api-access-4rnxl\") pod \"ae4d7f80-3a42-4181-9fda-b640046afbdd\" (UID: \"ae4d7f80-3a42-4181-9fda-b640046afbdd\") "
Jul 31 00:23:57.192255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.192227    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4d7f80-3a42-4181-9fda-b640046afbdd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae4d7f80-3a42-4181-9fda-b640046afbdd" (UID: "ae4d7f80-3a42-4181-9fda-b640046afbdd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:23:57.192255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.192229    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4d7f80-3a42-4181-9fda-b640046afbdd-kube-api-access-4rnxl" (OuterVolumeSpecName: "kube-api-access-4rnxl") pod "ae4d7f80-3a42-4181-9fda-b640046afbdd" (UID: "ae4d7f80-3a42-4181-9fda-b640046afbdd"). InnerVolumeSpecName "kube-api-access-4rnxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:23:57.204061 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.204039    2555 scope.go:117] "RemoveContainer" containerID="6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc"
Jul 31 00:23:57.204432 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:23:57.204410    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc\": container with ID starting with 6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc not found: ID does not exist" containerID="6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc"
Jul 31 00:23:57.204508 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.204444    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc"} err="failed to get container status \"6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc\": rpc error: code = NotFound desc = could not find container \"6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc\": container with ID starting with 6f3d66286147ebd9b6285deeca2f548ef89e82ec7431ab0051e2c04fa8cfe1cc not found: ID does not exist"
Jul 31 00:23:57.291137 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.291043    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4d7f80-3a42-4181-9fda-b640046afbdd-webhook-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:23:57.291137 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.291076    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rnxl\" (UniqueName: \"kubernetes.io/projected/ae4d7f80-3a42-4181-9fda-b640046afbdd-kube-api-access-4rnxl\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:23:57.508834 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.508791    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-x8zst"]
Jul 31 00:23:57.514236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.514202    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-x8zst"]
Jul 31 00:23:57.867495 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:57.867460    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4d7f80-3a42-4181-9fda-b640046afbdd" path="/var/lib/kubelet/pods/ae4d7f80-3a42-4181-9fda-b640046afbdd/volumes"
Jul 31 00:23:58.312458 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.312421    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-96hf9"]
Jul 31 00:23:58.312837 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.312823    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4d7f80-3a42-4181-9fda-b640046afbdd" containerName="manager"
Jul 31 00:23:58.312883 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.312838    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4d7f80-3a42-4181-9fda-b640046afbdd" containerName="manager"
Jul 31 00:23:58.312929 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.312919    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4d7f80-3a42-4181-9fda-b640046afbdd" containerName="manager"
Jul 31 00:23:58.317384 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.317361    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.319692 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.319664    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bsnn2\""
Jul 31 00:23:58.319880 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.319671    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 00:23:58.319880 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.319677    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 00:23:58.323031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.323001    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-96hf9"]
Jul 31 00:23:58.502443 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.502405    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9hg7\" (UniqueName: \"kubernetes.io/projected/256331ef-b2ba-48fc-adc9-6595f719bc07-kube-api-access-j9hg7\") pod \"maas-controller-5c9699fb4f-96hf9\" (UID: \"256331ef-b2ba-48fc-adc9-6595f719bc07\") " pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.502643 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.502475    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/256331ef-b2ba-48fc-adc9-6595f719bc07-webhook-cert\") pod \"maas-controller-5c9699fb4f-96hf9\" (UID: \"256331ef-b2ba-48fc-adc9-6595f719bc07\") " pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.603150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.603051    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9hg7\" (UniqueName: \"kubernetes.io/projected/256331ef-b2ba-48fc-adc9-6595f719bc07-kube-api-access-j9hg7\") pod \"maas-controller-5c9699fb4f-96hf9\" (UID: \"256331ef-b2ba-48fc-adc9-6595f719bc07\") " pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.603150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.603115    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/256331ef-b2ba-48fc-adc9-6595f719bc07-webhook-cert\") pod \"maas-controller-5c9699fb4f-96hf9\" (UID: \"256331ef-b2ba-48fc-adc9-6595f719bc07\") " pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.605876 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.605839    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/256331ef-b2ba-48fc-adc9-6595f719bc07-webhook-cert\") pod \"maas-controller-5c9699fb4f-96hf9\" (UID: \"256331ef-b2ba-48fc-adc9-6595f719bc07\") " pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.611682 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.611642    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9hg7\" (UniqueName: \"kubernetes.io/projected/256331ef-b2ba-48fc-adc9-6595f719bc07-kube-api-access-j9hg7\") pod \"maas-controller-5c9699fb4f-96hf9\" (UID: \"256331ef-b2ba-48fc-adc9-6595f719bc07\") " pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.630287 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.630246    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:23:58.779501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:58.779470    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9699fb4f-96hf9"]
Jul 31 00:23:58.782052 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:23:58.782024    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256331ef_b2ba_48fc_adc9_6595f719bc07.slice/crio-8e10b3d5958978522d8d8072ecd4e5e6f738bea85aaee2233579b137862cc88f WatchSource:0}: Error finding container 8e10b3d5958978522d8d8072ecd4e5e6f738bea85aaee2233579b137862cc88f: Status 404 returned error can't find the container with id 8e10b3d5958978522d8d8072ecd4e5e6f738bea85aaee2233579b137862cc88f
Jul 31 00:23:59.202107 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:23:59.202066    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-96hf9" event={"ID":"256331ef-b2ba-48fc-adc9-6595f719bc07","Type":"ContainerStarted","Data":"8e10b3d5958978522d8d8072ecd4e5e6f738bea85aaee2233579b137862cc88f"}
Jul 31 00:24:00.208305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:24:00.208268    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9699fb4f-96hf9" event={"ID":"256331ef-b2ba-48fc-adc9-6595f719bc07","Type":"ContainerStarted","Data":"7892c9672bf5798fc3c03cdc0c46eb71d61630d6aad6de49516647b1f40abbe5"}
Jul 31 00:24:00.208722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:24:00.208432    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:24:00.223166 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:24:00.223097    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c9699fb4f-96hf9" podStartSLOduration=1.556437162 podStartE2EDuration="2.223078381s" totalImagesPullingTime="666.641219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:24:00.220836248 +0000 UTC m=+1044.944802236" watchObservedRunningTime="2026-07-31 00:24:00.223078381 +0000 UTC m=+1044.947044348"
Jul 31 00:24:11.216284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:24:11.216245    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c9699fb4f-96hf9"
Jul 31 00:34:29.883021 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.882974    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"]
Jul 31 00:34:29.886577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.886555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:29.888652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.888629    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-209b6258-kserve-self-signed-certs\""
Jul 31 00:34:29.899585 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.899556    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"]
Jul 31 00:34:29.972901 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.972862    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-home\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:29.973146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.972945    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-tmp-dir\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:29.973146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.973013    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebe5e831-733a-4d12-9045-d34c7abca45e-tls-certs\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:29.973146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.973067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-dshm\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:29.973146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.973083    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-model-cache\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:29.973376 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:29.973197    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp9d2\" (UniqueName: \"kubernetes.io/projected/ebe5e831-733a-4d12-9045-d34c7abca45e-kube-api-access-zp9d2\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074357 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074317    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-dshm\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074357 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074364    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-model-cache\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074649 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp9d2\" (UniqueName: \"kubernetes.io/projected/ebe5e831-733a-4d12-9045-d34c7abca45e-kube-api-access-zp9d2\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074649 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074444    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-home\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074649 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074497    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-tmp-dir\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074649 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074553    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebe5e831-733a-4d12-9045-d34c7abca45e-tls-certs\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.074896 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.074850    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-model-cache\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.075271 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.075245    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-home\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.075836 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.075806    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-tmp-dir\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.077181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.077148    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-dshm\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.077281 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.077258    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebe5e831-733a-4d12-9045-d34c7abca45e-tls-certs\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.082867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.082837    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp9d2\" (UniqueName: \"kubernetes.io/projected/ebe5e831-733a-4d12-9045-d34c7abca45e-kube-api-access-zp9d2\") pod \"e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") " pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.196358 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.196308    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:30.341243 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:30.341197    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"]
Jul 31 00:34:30.343684 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:34:30.343653    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebe5e831_733a_4d12_9045_d34c7abca45e.slice/crio-6ab10ac744ba5181e27e0604748e38703f42251746c055bf4b51297c2e7de04d WatchSource:0}: Error finding container 6ab10ac744ba5181e27e0604748e38703f42251746c055bf4b51297c2e7de04d: Status 404 returned error can't find the container with id 6ab10ac744ba5181e27e0604748e38703f42251746c055bf4b51297c2e7de04d
Jul 31 00:34:31.297599 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:31.297549    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw" event={"ID":"ebe5e831-733a-4d12-9045-d34c7abca45e","Type":"ContainerStarted","Data":"2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7"}
Jul 31 00:34:31.297599 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:31.297599    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw" event={"ID":"ebe5e831-733a-4d12-9045-d34c7abca45e","Type":"ContainerStarted","Data":"6ab10ac744ba5181e27e0604748e38703f42251746c055bf4b51297c2e7de04d"}
Jul 31 00:34:31.312328 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:31.312270    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw" podStartSLOduration=2.312252034 podStartE2EDuration="2.312252034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:34:31.310915115 +0000 UTC m=+1676.034881102" watchObservedRunningTime="2026-07-31 00:34:31.312252034 +0000 UTC m=+1676.036218001"
Jul 31 00:34:40.197208 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:40.197168    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:40.197676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:40.197224    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:40.210173 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:40.210139    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:34:40.354487 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:34:40.354453    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:35:35.901019 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:35.900978    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"]
Jul 31 00:35:50.922960 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:50.922919    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw" podUID="ebe5e831-733a-4d12-9045-d34c7abca45e" containerName="main" containerID="cri-o://2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7" gracePeriod=45
Jul 31 00:35:51.169567 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.169542    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:35:51.211769 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.211724    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebe5e831-733a-4d12-9045-d34c7abca45e-tls-certs\") pod \"ebe5e831-733a-4d12-9045-d34c7abca45e\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") "
Jul 31 00:35:51.211769 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.211767    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-dshm\") pod \"ebe5e831-733a-4d12-9045-d34c7abca45e\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") "
Jul 31 00:35:51.211965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.211947    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-tmp-dir\") pod \"ebe5e831-733a-4d12-9045-d34c7abca45e\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") "
Jul 31 00:35:51.212020 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.211998    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp9d2\" (UniqueName: \"kubernetes.io/projected/ebe5e831-733a-4d12-9045-d34c7abca45e-kube-api-access-zp9d2\") pod \"ebe5e831-733a-4d12-9045-d34c7abca45e\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") "
Jul 31 00:35:51.212057 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.212042    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-model-cache\") pod \"ebe5e831-733a-4d12-9045-d34c7abca45e\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") "
Jul 31 00:35:51.212105 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.212080    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-home\") pod \"ebe5e831-733a-4d12-9045-d34c7abca45e\" (UID: \"ebe5e831-733a-4d12-9045-d34c7abca45e\") "
Jul 31 00:35:51.212212 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.212186    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ebe5e831-733a-4d12-9045-d34c7abca45e" (UID: "ebe5e831-733a-4d12-9045-d34c7abca45e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:35:51.212388 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.212358    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-tmp-dir\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:35:51.212388 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.212383    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-home" (OuterVolumeSpecName: "home") pod "ebe5e831-733a-4d12-9045-d34c7abca45e" (UID: "ebe5e831-733a-4d12-9045-d34c7abca45e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:35:51.212521 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.212404    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-model-cache" (OuterVolumeSpecName: "model-cache") pod "ebe5e831-733a-4d12-9045-d34c7abca45e" (UID: "ebe5e831-733a-4d12-9045-d34c7abca45e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:35:51.214367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.214347    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe5e831-733a-4d12-9045-d34c7abca45e-kube-api-access-zp9d2" (OuterVolumeSpecName: "kube-api-access-zp9d2") pod "ebe5e831-733a-4d12-9045-d34c7abca45e" (UID: "ebe5e831-733a-4d12-9045-d34c7abca45e"). InnerVolumeSpecName "kube-api-access-zp9d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:35:51.214492 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.214474    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe5e831-733a-4d12-9045-d34c7abca45e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ebe5e831-733a-4d12-9045-d34c7abca45e" (UID: "ebe5e831-733a-4d12-9045-d34c7abca45e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:35:51.214552 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.214490    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-dshm" (OuterVolumeSpecName: "dshm") pod "ebe5e831-733a-4d12-9045-d34c7abca45e" (UID: "ebe5e831-733a-4d12-9045-d34c7abca45e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:35:51.313211 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.313180    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-home\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:35:51.313211 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.313212    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebe5e831-733a-4d12-9045-d34c7abca45e-tls-certs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:35:51.313382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.313227    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-dshm\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:35:51.313382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.313239    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp9d2\" (UniqueName: \"kubernetes.io/projected/ebe5e831-733a-4d12-9045-d34c7abca45e-kube-api-access-zp9d2\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:35:51.313382 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.313252    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebe5e831-733a-4d12-9045-d34c7abca45e-model-cache\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:35:51.665722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.665636    2555 generic.go:356] "Generic (PLEG): container finished" podID="ebe5e831-733a-4d12-9045-d34c7abca45e" containerID="2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7" exitCode=0
Jul 31 00:35:51.665722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.665680    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"
Jul 31 00:35:51.665944 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.665733    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw" event={"ID":"ebe5e831-733a-4d12-9045-d34c7abca45e","Type":"ContainerDied","Data":"2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7"}
Jul 31 00:35:51.665944 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.665792    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw" event={"ID":"ebe5e831-733a-4d12-9045-d34c7abca45e","Type":"ContainerDied","Data":"6ab10ac744ba5181e27e0604748e38703f42251746c055bf4b51297c2e7de04d"}
Jul 31 00:35:51.665944 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.665812    2555 scope.go:117] "RemoveContainer" containerID="2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7"
Jul 31 00:35:51.674790 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.674772    2555 scope.go:117] "RemoveContainer" containerID="2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7"
Jul 31 00:35:51.675023 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:35:51.675005    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7\": container with ID starting with 2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7 not found: ID does not exist" containerID="2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7"
Jul 31 00:35:51.675088 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.675037    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7"} err="failed to get container status \"2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7\": rpc error: code = NotFound desc = could not find container \"2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7\": container with ID starting with 2863a53970e6814aadc680bfecc9d89be1191754c519f910e6f57491ef8476a7 not found: ID does not exist"
Jul 31 00:35:51.684413 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.684391    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"]
Jul 31 00:35:51.685963 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.685936    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-209b6258-kserve-cfbdbf9f9-hzvpw"]
Jul 31 00:35:51.867643 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:35:51.867611    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe5e831-733a-4d12-9045-d34c7abca45e" path="/var/lib/kubelet/pods/ebe5e831-733a-4d12-9045-d34c7abca45e/volumes"
Jul 31 00:39:52.329668 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.329633    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"]
Jul 31 00:39:52.332014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.330028    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe5e831-733a-4d12-9045-d34c7abca45e" containerName="main"
Jul 31 00:39:52.332014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.330040    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe5e831-733a-4d12-9045-d34c7abca45e" containerName="main"
Jul 31 00:39:52.332014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.330094    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebe5e831-733a-4d12-9045-d34c7abca45e" containerName="main"
Jul 31 00:39:52.332973 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.332958    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.335083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.335064    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2c8c8809\""
Jul 31 00:39:52.335189 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.335120    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2c8c8809-dockercfg-8hnm7\""
Jul 31 00:39:52.348128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.348107    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"]
Jul 31 00:39:52.372184 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.372153    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"]
Jul 31 00:39:52.375581 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.375564    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.384743 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.384717    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"]
Jul 31 00:39:52.426051 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.426022    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj75p\" (UniqueName: \"kubernetes.io/projected/d7ea7dc8-db37-4238-8b3c-098119aa6f99-kube-api-access-vj75p\") pod \"payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") " pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.426182 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.426067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9qk\" (UniqueName: \"kubernetes.io/projected/316a0bad-2ecc-49de-9c67-39684fd1858f-kube-api-access-zx9qk\") pod \"payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.426182 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.426148    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7ea7dc8-db37-4238-8b3c-098119aa6f99-plugins-config-volume\") pod \"payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") " pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.426299 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.426179    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316a0bad-2ecc-49de-9c67-39684fd1858f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.526982 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.526945    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj75p\" (UniqueName: \"kubernetes.io/projected/d7ea7dc8-db37-4238-8b3c-098119aa6f99-kube-api-access-vj75p\") pod \"payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") " pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.527166 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.526997    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9qk\" (UniqueName: \"kubernetes.io/projected/316a0bad-2ecc-49de-9c67-39684fd1858f-kube-api-access-zx9qk\") pod \"payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.527166 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.527050    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7ea7dc8-db37-4238-8b3c-098119aa6f99-plugins-config-volume\") pod \"payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") " pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.527166 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.527073    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316a0bad-2ecc-49de-9c67-39684fd1858f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.527846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.527822    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7ea7dc8-db37-4238-8b3c-098119aa6f99-plugins-config-volume\") pod \"payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") " pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.527956 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.527823    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316a0bad-2ecc-49de-9c67-39684fd1858f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.534651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.534623    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9qk\" (UniqueName: \"kubernetes.io/projected/316a0bad-2ecc-49de-9c67-39684fd1858f-kube-api-access-zx9qk\") pod \"payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.534740 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.534625    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj75p\" (UniqueName: \"kubernetes.io/projected/d7ea7dc8-db37-4238-8b3c-098119aa6f99-kube-api-access-vj75p\") pod \"payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") " pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.642739 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.642669    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:52.686510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.686483    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:52.785952 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.785909    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"]
Jul 31 00:39:52.789172 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:39:52.789146    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316a0bad_2ecc_49de_9c67_39684fd1858f.slice/crio-60c4c7933e0389c2ab8155d249c10f352209b0efdb7c6612797c8b68c0b01fb0 WatchSource:0}: Error finding container 60c4c7933e0389c2ab8155d249c10f352209b0efdb7c6612797c8b68c0b01fb0: Status 404 returned error can't find the container with id 60c4c7933e0389c2ab8155d249c10f352209b0efdb7c6612797c8b68c0b01fb0
Jul 31 00:39:52.835929 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:52.835878    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"]
Jul 31 00:39:52.839281 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:39:52.839257    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ea7dc8_db37_4238_8b3c_098119aa6f99.slice/crio-57b1dd8f723ec1da157b5a00dd5f594b36ba595997a0d140bc00add1d57e5f2a WatchSource:0}: Error finding container 57b1dd8f723ec1da157b5a00dd5f594b36ba595997a0d140bc00add1d57e5f2a: Status 404 returned error can't find the container with id 57b1dd8f723ec1da157b5a00dd5f594b36ba595997a0d140bc00add1d57e5f2a
Jul 31 00:39:53.782284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.782242    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4" event={"ID":"316a0bad-2ecc-49de-9c67-39684fd1858f","Type":"ContainerStarted","Data":"c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd"}
Jul 31 00:39:53.782777 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.782308    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4" event={"ID":"316a0bad-2ecc-49de-9c67-39684fd1858f","Type":"ContainerStarted","Data":"60c4c7933e0389c2ab8155d249c10f352209b0efdb7c6612797c8b68c0b01fb0"}
Jul 31 00:39:53.782777 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.782340    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:39:53.783846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.783824    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m" event={"ID":"d7ea7dc8-db37-4238-8b3c-098119aa6f99","Type":"ContainerStarted","Data":"55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610"}
Jul 31 00:39:53.783944 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.783864    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m" event={"ID":"d7ea7dc8-db37-4238-8b3c-098119aa6f99","Type":"ContainerStarted","Data":"57b1dd8f723ec1da157b5a00dd5f594b36ba595997a0d140bc00add1d57e5f2a"}
Jul 31 00:39:53.783944 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.783888    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:39:53.796101 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.796053    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4" podStartSLOduration=1.796037104 podStartE2EDuration="1.796037104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:39:53.794433278 +0000 UTC m=+1998.518399263" watchObservedRunningTime="2026-07-31 00:39:53.796037104 +0000 UTC m=+1998.520003070"
Jul 31 00:39:53.807676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:39:53.807631    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m" podStartSLOduration=1.807618455 podStartE2EDuration="1.807618455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:39:53.806726451 +0000 UTC m=+1998.530692445" watchObservedRunningTime="2026-07-31 00:39:53.807618455 +0000 UTC m=+1998.531584426"
Jul 31 00:40:04.790593 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:04.790565    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:40:04.791056 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:04.790633    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:40:32.310388 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.310350    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"]
Jul 31 00:40:32.310990 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.310617    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m" podUID="d7ea7dc8-db37-4238-8b3c-098119aa6f99" containerName="payload-processing" containerID="cri-o://55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610" gracePeriod=30
Jul 31 00:40:32.315008 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.314981    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"]
Jul 31 00:40:32.317708 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.315229    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4" podUID="316a0bad-2ecc-49de-9c67-39684fd1858f" containerName="payload-pre-processing" containerID="cri-o://c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd" gracePeriod=30
Jul 31 00:40:32.595820 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.595794    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:40:32.599621 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.599598    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:40:32.672977 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.672949    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj75p\" (UniqueName: \"kubernetes.io/projected/d7ea7dc8-db37-4238-8b3c-098119aa6f99-kube-api-access-vj75p\") pod \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") "
Jul 31 00:40:32.672977 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.672986    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx9qk\" (UniqueName: \"kubernetes.io/projected/316a0bad-2ecc-49de-9c67-39684fd1858f-kube-api-access-zx9qk\") pod \"316a0bad-2ecc-49de-9c67-39684fd1858f\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") "
Jul 31 00:40:32.673214 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.673005    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316a0bad-2ecc-49de-9c67-39684fd1858f-plugins-config-volume\") pod \"316a0bad-2ecc-49de-9c67-39684fd1858f\" (UID: \"316a0bad-2ecc-49de-9c67-39684fd1858f\") "
Jul 31 00:40:32.673214 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.673093    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7ea7dc8-db37-4238-8b3c-098119aa6f99-plugins-config-volume\") pod \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\" (UID: \"d7ea7dc8-db37-4238-8b3c-098119aa6f99\") "
Jul 31 00:40:32.673474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.673449    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/316a0bad-2ecc-49de-9c67-39684fd1858f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "316a0bad-2ecc-49de-9c67-39684fd1858f" (UID: "316a0bad-2ecc-49de-9c67-39684fd1858f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:40:32.673574 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.673464    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ea7dc8-db37-4238-8b3c-098119aa6f99-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d7ea7dc8-db37-4238-8b3c-098119aa6f99" (UID: "d7ea7dc8-db37-4238-8b3c-098119aa6f99"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:40:32.675360 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.675332    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/316a0bad-2ecc-49de-9c67-39684fd1858f-kube-api-access-zx9qk" (OuterVolumeSpecName: "kube-api-access-zx9qk") pod "316a0bad-2ecc-49de-9c67-39684fd1858f" (UID: "316a0bad-2ecc-49de-9c67-39684fd1858f"). InnerVolumeSpecName "kube-api-access-zx9qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:40:32.675457 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.675389    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ea7dc8-db37-4238-8b3c-098119aa6f99-kube-api-access-vj75p" (OuterVolumeSpecName: "kube-api-access-vj75p") pod "d7ea7dc8-db37-4238-8b3c-098119aa6f99" (UID: "d7ea7dc8-db37-4238-8b3c-098119aa6f99"). InnerVolumeSpecName "kube-api-access-vj75p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:40:32.773913 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.773887    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7ea7dc8-db37-4238-8b3c-098119aa6f99-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.773913 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.773908    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj75p\" (UniqueName: \"kubernetes.io/projected/d7ea7dc8-db37-4238-8b3c-098119aa6f99-kube-api-access-vj75p\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.773913 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.773918    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx9qk\" (UniqueName: \"kubernetes.io/projected/316a0bad-2ecc-49de-9c67-39684fd1858f-kube-api-access-zx9qk\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.774107 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.773927    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316a0bad-2ecc-49de-9c67-39684fd1858f-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.961888 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.961850    2555 generic.go:356] "Generic (PLEG): container finished" podID="316a0bad-2ecc-49de-9c67-39684fd1858f" containerID="c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd" exitCode=0
Jul 31 00:40:32.962062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.961905    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"
Jul 31 00:40:32.962062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.961938    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4" event={"ID":"316a0bad-2ecc-49de-9c67-39684fd1858f","Type":"ContainerDied","Data":"c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd"}
Jul 31 00:40:32.962062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.961991    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4" event={"ID":"316a0bad-2ecc-49de-9c67-39684fd1858f","Type":"ContainerDied","Data":"60c4c7933e0389c2ab8155d249c10f352209b0efdb7c6612797c8b68c0b01fb0"}
Jul 31 00:40:32.962062 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.962013    2555 scope.go:117] "RemoveContainer" containerID="c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd"
Jul 31 00:40:32.963333 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.963310    2555 generic.go:356] "Generic (PLEG): container finished" podID="d7ea7dc8-db37-4238-8b3c-098119aa6f99" containerID="55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610" exitCode=0
Jul 31 00:40:32.963439 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.963354    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"
Jul 31 00:40:32.963439 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.963387    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m" event={"ID":"d7ea7dc8-db37-4238-8b3c-098119aa6f99","Type":"ContainerDied","Data":"55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610"}
Jul 31 00:40:32.963439 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.963430    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m" event={"ID":"d7ea7dc8-db37-4238-8b3c-098119aa6f99","Type":"ContainerDied","Data":"57b1dd8f723ec1da157b5a00dd5f594b36ba595997a0d140bc00add1d57e5f2a"}
Jul 31 00:40:32.971449 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.971433    2555 scope.go:117] "RemoveContainer" containerID="c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd"
Jul 31 00:40:32.971722 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:40:32.971705    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd\": container with ID starting with c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd not found: ID does not exist" containerID="c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd"
Jul 31 00:40:32.971795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.971730    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd"} err="failed to get container status \"c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd\": rpc error: code = NotFound desc = could not find container \"c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd\": container with ID starting with c875f28b70d7c95cca469ec1422627203f83695758b5c3505dd784a14f509fdd not found: ID does not exist"
Jul 31 00:40:32.971795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.971747    2555 scope.go:117] "RemoveContainer" containerID="55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610"
Jul 31 00:40:32.979511 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.979494    2555 scope.go:117] "RemoveContainer" containerID="55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610"
Jul 31 00:40:32.979793 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:40:32.979776    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610\": container with ID starting with 55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610 not found: ID does not exist" containerID="55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610"
Jul 31 00:40:32.979843 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.979799    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610"} err="failed to get container status \"55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610\": rpc error: code = NotFound desc = could not find container \"55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610\": container with ID starting with 55e1867ea27fe51246e8f6f516d9452c1acf01ab05e872542fe83273ef32d610 not found: ID does not exist"
Jul 31 00:40:32.984742 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.984621    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"]
Jul 31 00:40:32.986516 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.986495    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2c8c8809-c545fdb6d-pwdn4"]
Jul 31 00:40:32.994343 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.994319    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"]
Jul 31 00:40:32.998387 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:32.998370    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2c8c8809-5d9d9868b6-zpf9m"]
Jul 31 00:40:33.871049 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:33.868175    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="316a0bad-2ecc-49de-9c67-39684fd1858f" path="/var/lib/kubelet/pods/316a0bad-2ecc-49de-9c67-39684fd1858f/volumes"
Jul 31 00:40:33.871049 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:33.868741    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7ea7dc8-db37-4238-8b3c-098119aa6f99" path="/var/lib/kubelet/pods/d7ea7dc8-db37-4238-8b3c-098119aa6f99/volumes"
Jul 31 00:40:36.718731 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.718699    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"]
Jul 31 00:40:36.719251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.719231    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7ea7dc8-db37-4238-8b3c-098119aa6f99" containerName="payload-processing"
Jul 31 00:40:36.719329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.719255    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ea7dc8-db37-4238-8b3c-098119aa6f99" containerName="payload-processing"
Jul 31 00:40:36.719329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.719283    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="316a0bad-2ecc-49de-9c67-39684fd1858f" containerName="payload-pre-processing"
Jul 31 00:40:36.719329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.719292    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="316a0bad-2ecc-49de-9c67-39684fd1858f" containerName="payload-pre-processing"
Jul 31 00:40:36.719480 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.719412    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7ea7dc8-db37-4238-8b3c-098119aa6f99" containerName="payload-processing"
Jul 31 00:40:36.719480 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.719423    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="316a0bad-2ecc-49de-9c67-39684fd1858f" containerName="payload-pre-processing"
Jul 31 00:40:36.724152 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.724132    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:36.726221 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.726187    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-5c18c4ee-dockercfg-8skb4\""
Jul 31 00:40:36.726332 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.726188    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-5c18c4ee\""
Jul 31 00:40:36.733349 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.733327    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"]
Jul 31 00:40:36.738792 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.738772    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"]
Jul 31 00:40:36.741950 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.741936    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:36.753451 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.753429    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"]
Jul 31 00:40:36.804140 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.804110    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft86t\" (UniqueName: \"kubernetes.io/projected/d5956063-e708-4032-b8d5-d170eb14e857-kube-api-access-ft86t\") pod \"payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:36.804294 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.804174    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5956063-e708-4032-b8d5-d170eb14e857-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:36.905226 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.905190    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrkv\" (UniqueName: \"kubernetes.io/projected/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-kube-api-access-hqrkv\") pod \"payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") " pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:36.905399 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.905239    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") " pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:36.905399 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.905287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5956063-e708-4032-b8d5-d170eb14e857-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:36.905533 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.905427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft86t\" (UniqueName: \"kubernetes.io/projected/d5956063-e708-4032-b8d5-d170eb14e857-kube-api-access-ft86t\") pod \"payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:36.906035 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.906013    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5956063-e708-4032-b8d5-d170eb14e857-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:36.912398 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:36.912375    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft86t\" (UniqueName: \"kubernetes.io/projected/d5956063-e708-4032-b8d5-d170eb14e857-kube-api-access-ft86t\") pod \"payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:37.006433 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.006356    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrkv\" (UniqueName: \"kubernetes.io/projected/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-kube-api-access-hqrkv\") pod \"payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") " pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:37.006433 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.006401    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") " pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:37.007076 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.007054    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") " pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:37.013400 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.013379    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrkv\" (UniqueName: \"kubernetes.io/projected/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-kube-api-access-hqrkv\") pod \"payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") " pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:37.036265 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.036238    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:37.051529 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.051501    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:37.180841 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.180816    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"]
Jul 31 00:40:37.184176 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:40:37.184150    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5956063_e708_4032_b8d5_d170eb14e857.slice/crio-02541ffe0604ad93802d96b9346d0d28bfd07568a8bcbf0715f330da4419b274 WatchSource:0}: Error finding container 02541ffe0604ad93802d96b9346d0d28bfd07568a8bcbf0715f330da4419b274: Status 404 returned error can't find the container with id 02541ffe0604ad93802d96b9346d0d28bfd07568a8bcbf0715f330da4419b274
Jul 31 00:40:37.204365 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.204338    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"]
Jul 31 00:40:37.207054 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:40:37.207028    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24b70d7_3c50_4ac0_aae2_bd0025cd7f3e.slice/crio-1bfcaa5f0acadce0e3f2457089d02e0e92c5b1f8257a8f44416f9af49aa24603 WatchSource:0}: Error finding container 1bfcaa5f0acadce0e3f2457089d02e0e92c5b1f8257a8f44416f9af49aa24603: Status 404 returned error can't find the container with id 1bfcaa5f0acadce0e3f2457089d02e0e92c5b1f8257a8f44416f9af49aa24603
Jul 31 00:40:37.990685 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.990644    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg" event={"ID":"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e","Type":"ContainerStarted","Data":"ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7"}
Jul 31 00:40:37.991183 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.990709    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg" event={"ID":"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e","Type":"ContainerStarted","Data":"1bfcaa5f0acadce0e3f2457089d02e0e92c5b1f8257a8f44416f9af49aa24603"}
Jul 31 00:40:37.991183 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.990785    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:40:37.992159 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.992133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m" event={"ID":"d5956063-e708-4032-b8d5-d170eb14e857","Type":"ContainerStarted","Data":"3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1"}
Jul 31 00:40:37.992265 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.992179    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m" event={"ID":"d5956063-e708-4032-b8d5-d170eb14e857","Type":"ContainerStarted","Data":"02541ffe0604ad93802d96b9346d0d28bfd07568a8bcbf0715f330da4419b274"}
Jul 31 00:40:37.992265 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:37.992220    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:38.007074 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:38.007027    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg" podStartSLOduration=2.007014521 podStartE2EDuration="2.007014521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:40:38.00523808 +0000 UTC m=+2042.729204070" watchObservedRunningTime="2026-07-31 00:40:38.007014521 +0000 UTC m=+2042.730980525"
Jul 31 00:40:38.018345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:38.018299    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m" podStartSLOduration=2.018287949 podStartE2EDuration="2.018287949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:40:38.016963605 +0000 UTC m=+2042.740929592" watchObservedRunningTime="2026-07-31 00:40:38.018287949 +0000 UTC m=+2042.742253916"
Jul 31 00:40:48.999228 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:48.999195    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:40:48.999605 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:40:48.999367    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:41:16.575902 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.575865    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"]
Jul 31 00:41:16.576565 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.576100    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg" podUID="c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" containerName="payload-processing" containerID="cri-o://ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7" gracePeriod=30
Jul 31 00:41:16.579564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.579533    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"]
Jul 31 00:41:16.579815 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.579789    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m" podUID="d5956063-e708-4032-b8d5-d170eb14e857" containerName="payload-pre-processing" containerID="cri-o://3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1" gracePeriod=30
Jul 31 00:41:16.865227 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.865196    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:41:16.870898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.870876    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:41:16.960218 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.960186    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-plugins-config-volume\") pod \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") "
Jul 31 00:41:16.960397 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.960292    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft86t\" (UniqueName: \"kubernetes.io/projected/d5956063-e708-4032-b8d5-d170eb14e857-kube-api-access-ft86t\") pod \"d5956063-e708-4032-b8d5-d170eb14e857\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") "
Jul 31 00:41:16.960397 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.960332    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5956063-e708-4032-b8d5-d170eb14e857-plugins-config-volume\") pod \"d5956063-e708-4032-b8d5-d170eb14e857\" (UID: \"d5956063-e708-4032-b8d5-d170eb14e857\") "
Jul 31 00:41:16.960397 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.960368    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqrkv\" (UniqueName: \"kubernetes.io/projected/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-kube-api-access-hqrkv\") pod \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\" (UID: \"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e\") "
Jul 31 00:41:16.960651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.960627    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" (UID: "c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:16.960739 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.960711    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5956063-e708-4032-b8d5-d170eb14e857-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d5956063-e708-4032-b8d5-d170eb14e857" (UID: "d5956063-e708-4032-b8d5-d170eb14e857"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:16.962552 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.962531    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5956063-e708-4032-b8d5-d170eb14e857-kube-api-access-ft86t" (OuterVolumeSpecName: "kube-api-access-ft86t") pod "d5956063-e708-4032-b8d5-d170eb14e857" (UID: "d5956063-e708-4032-b8d5-d170eb14e857"). InnerVolumeSpecName "kube-api-access-ft86t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:16.962620 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:16.962579    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-kube-api-access-hqrkv" (OuterVolumeSpecName: "kube-api-access-hqrkv") pod "c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" (UID: "c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e"). InnerVolumeSpecName "kube-api-access-hqrkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:17.061959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.061906    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft86t\" (UniqueName: \"kubernetes.io/projected/d5956063-e708-4032-b8d5-d170eb14e857-kube-api-access-ft86t\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.061959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.061939    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5956063-e708-4032-b8d5-d170eb14e857-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.061959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.061949    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqrkv\" (UniqueName: \"kubernetes.io/projected/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-kube-api-access-hqrkv\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.061959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.061958    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.176367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.176283    2555 generic.go:356] "Generic (PLEG): container finished" podID="c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" containerID="ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7" exitCode=0
Jul 31 00:41:17.176367 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.176328    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"
Jul 31 00:41:17.176585 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.176364    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg" event={"ID":"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e","Type":"ContainerDied","Data":"ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7"}
Jul 31 00:41:17.176585 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.176463    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg" event={"ID":"c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e","Type":"ContainerDied","Data":"1bfcaa5f0acadce0e3f2457089d02e0e92c5b1f8257a8f44416f9af49aa24603"}
Jul 31 00:41:17.176585 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.176499    2555 scope.go:117] "RemoveContainer" containerID="ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7"
Jul 31 00:41:17.177822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.177796    2555 generic.go:356] "Generic (PLEG): container finished" podID="d5956063-e708-4032-b8d5-d170eb14e857" containerID="3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1" exitCode=0
Jul 31 00:41:17.177939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.177828    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m" event={"ID":"d5956063-e708-4032-b8d5-d170eb14e857","Type":"ContainerDied","Data":"3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1"}
Jul 31 00:41:17.177939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.177851    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"
Jul 31 00:41:17.177939 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.177861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m" event={"ID":"d5956063-e708-4032-b8d5-d170eb14e857","Type":"ContainerDied","Data":"02541ffe0604ad93802d96b9346d0d28bfd07568a8bcbf0715f330da4419b274"}
Jul 31 00:41:17.186246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.186233    2555 scope.go:117] "RemoveContainer" containerID="ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7"
Jul 31 00:41:17.186493 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:41:17.186476    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7\": container with ID starting with ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7 not found: ID does not exist" containerID="ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7"
Jul 31 00:41:17.186577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.186500    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7"} err="failed to get container status \"ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7\": rpc error: code = NotFound desc = could not find container \"ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7\": container with ID starting with ec55b313020e769e01c4bf9bf00d87d5bd329188fa17da2a5c98411cae6e7eb7 not found: ID does not exist"
Jul 31 00:41:17.186577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.186516    2555 scope.go:117] "RemoveContainer" containerID="3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1"
Jul 31 00:41:17.195264 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.195139    2555 scope.go:117] "RemoveContainer" containerID="3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1"
Jul 31 00:41:17.195515 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:41:17.195493    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1\": container with ID starting with 3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1 not found: ID does not exist" containerID="3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1"
Jul 31 00:41:17.195568 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.195522    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1"} err="failed to get container status \"3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1\": rpc error: code = NotFound desc = could not find container \"3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1\": container with ID starting with 3ac2e1735f08823fec1dc2923bc1c691e187dc7febb070ad9ff77f334fbb69f1 not found: ID does not exist"
Jul 31 00:41:17.196396 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.196379    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"]
Jul 31 00:41:17.199787 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.199741    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5c18c4ee-6c84c5c685-v2fzg"]
Jul 31 00:41:17.208718 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.208697    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"]
Jul 31 00:41:17.210309 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.210287    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5c18c4ee-75b9b6dc44-h5j5m"]
Jul 31 00:41:17.866869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.866790    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" path="/var/lib/kubelet/pods/c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e/volumes"
Jul 31 00:41:17.867215 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:17.867138    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5956063-e708-4032-b8d5-d170eb14e857" path="/var/lib/kubelet/pods/d5956063-e708-4032-b8d5-d170eb14e857/volumes"
Jul 31 00:41:21.949500 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949462    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"]
Jul 31 00:41:21.950075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949850    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5956063-e708-4032-b8d5-d170eb14e857" containerName="payload-pre-processing"
Jul 31 00:41:21.950075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949864    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5956063-e708-4032-b8d5-d170eb14e857" containerName="payload-pre-processing"
Jul 31 00:41:21.950075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949886    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" containerName="payload-processing"
Jul 31 00:41:21.950075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949891    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" containerName="payload-processing"
Jul 31 00:41:21.950075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949941    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5956063-e708-4032-b8d5-d170eb14e857" containerName="payload-pre-processing"
Jul 31 00:41:21.950075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.949950    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c24b70d7-3c50-4ac0-aae2-bd0025cd7f3e" containerName="payload-processing"
Jul 31 00:41:21.954425 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.954408    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:21.956236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.956213    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-eee00287-dockercfg-8sx2x\""
Jul 31 00:41:21.956366 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.956251    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-eee00287\""
Jul 31 00:41:21.962829 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.962786    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"]
Jul 31 00:41:21.988822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.988798    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"]
Jul 31 00:41:21.992075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:21.992059    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.002353 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.002325    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"]
Jul 31 00:41:22.107118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.107088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a42b23e9-4c11-409a-a3b5-020001d8baea-plugins-config-volume\") pod \"payload-processing-e2e-ait-eee00287-79b867658d-55rdw\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") " pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.107268 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.107120    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.107268 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.107149    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f984\" (UniqueName: \"kubernetes.io/projected/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-kube-api-access-4f984\") pod \"payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.107268 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.107252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zcp2\" (UniqueName: \"kubernetes.io/projected/a42b23e9-4c11-409a-a3b5-020001d8baea-kube-api-access-5zcp2\") pod \"payload-processing-e2e-ait-eee00287-79b867658d-55rdw\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") " pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.207747 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.207668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a42b23e9-4c11-409a-a3b5-020001d8baea-plugins-config-volume\") pod \"payload-processing-e2e-ait-eee00287-79b867658d-55rdw\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") " pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.207747 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.207705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.207747 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.207730    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f984\" (UniqueName: \"kubernetes.io/projected/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-kube-api-access-4f984\") pod \"payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.208034 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.207788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zcp2\" (UniqueName: \"kubernetes.io/projected/a42b23e9-4c11-409a-a3b5-020001d8baea-kube-api-access-5zcp2\") pod \"payload-processing-e2e-ait-eee00287-79b867658d-55rdw\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") " pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.208512 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.208493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.208554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.208494    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a42b23e9-4c11-409a-a3b5-020001d8baea-plugins-config-volume\") pod \"payload-processing-e2e-ait-eee00287-79b867658d-55rdw\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") " pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.215369 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.215341    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zcp2\" (UniqueName: \"kubernetes.io/projected/a42b23e9-4c11-409a-a3b5-020001d8baea-kube-api-access-5zcp2\") pod \"payload-processing-e2e-ait-eee00287-79b867658d-55rdw\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") " pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.215369 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.215364    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f984\" (UniqueName: \"kubernetes.io/projected/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-kube-api-access-4f984\") pod \"payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.266344 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.266321    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:22.302898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.302869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:22.438712 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.438472    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"]
Jul 31 00:41:22.441324 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:41:22.441299    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaadcf9f_cd4a_4cd8_a7c8_2f4e50cd26cb.slice/crio-50d2753882c8532b5d55796e8efc26a7165631c8639a6f7a2befb76c23f016e7 WatchSource:0}: Error finding container 50d2753882c8532b5d55796e8efc26a7165631c8639a6f7a2befb76c23f016e7: Status 404 returned error can't find the container with id 50d2753882c8532b5d55796e8efc26a7165631c8639a6f7a2befb76c23f016e7
Jul 31 00:41:22.463118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:22.463092    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"]
Jul 31 00:41:22.472886 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:41:22.472859    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42b23e9_4c11_409a_a3b5_020001d8baea.slice/crio-4d334e758c195345131dfa6768d1511ef765bfbaea5329b3af7cef963ce0d415 WatchSource:0}: Error finding container 4d334e758c195345131dfa6768d1511ef765bfbaea5329b3af7cef963ce0d415: Status 404 returned error can't find the container with id 4d334e758c195345131dfa6768d1511ef765bfbaea5329b3af7cef963ce0d415
Jul 31 00:41:23.208348 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.208314    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw" event={"ID":"a42b23e9-4c11-409a-a3b5-020001d8baea","Type":"ContainerStarted","Data":"48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd"}
Jul 31 00:41:23.208749 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.208371    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw" event={"ID":"a42b23e9-4c11-409a-a3b5-020001d8baea","Type":"ContainerStarted","Data":"4d334e758c195345131dfa6768d1511ef765bfbaea5329b3af7cef963ce0d415"}
Jul 31 00:41:23.208749 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.208396    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:23.209823 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.209801    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45" event={"ID":"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb","Type":"ContainerStarted","Data":"a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d"}
Jul 31 00:41:23.209919 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.209838    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45" event={"ID":"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb","Type":"ContainerStarted","Data":"50d2753882c8532b5d55796e8efc26a7165631c8639a6f7a2befb76c23f016e7"}
Jul 31 00:41:23.209919 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.209859    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:23.224734 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.224678    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw" podStartSLOduration=2.224659986 podStartE2EDuration="2.224659986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:23.222750167 +0000 UTC m=+2087.946716137" watchObservedRunningTime="2026-07-31 00:41:23.224659986 +0000 UTC m=+2087.948625956"
Jul 31 00:41:23.243434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:23.243369    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45" podStartSLOduration=2.243356391 podStartE2EDuration="2.243356391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:23.242553549 +0000 UTC m=+2087.966519521" watchObservedRunningTime="2026-07-31 00:41:23.243356391 +0000 UTC m=+2087.967322357"
Jul 31 00:41:34.216963 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:34.216931    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:34.217393 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:34.217159    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:51.891146 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:51.891110    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"]
Jul 31 00:41:51.891716 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:51.891387    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw" podUID="a42b23e9-4c11-409a-a3b5-020001d8baea" containerName="payload-processing" containerID="cri-o://48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd" gracePeriod=30
Jul 31 00:41:51.898002 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:51.897974    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"]
Jul 31 00:41:51.898374 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:51.898346    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45" podUID="aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" containerName="payload-pre-processing" containerID="cri-o://a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d" gracePeriod=30
Jul 31 00:41:52.157235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.157211    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:52.188822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.188798    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:52.272564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.272533    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f984\" (UniqueName: \"kubernetes.io/projected/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-kube-api-access-4f984\") pod \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") "
Jul 31 00:41:52.272727 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.272587    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-plugins-config-volume\") pod \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\" (UID: \"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb\") "
Jul 31 00:41:52.272727 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.272638    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zcp2\" (UniqueName: \"kubernetes.io/projected/a42b23e9-4c11-409a-a3b5-020001d8baea-kube-api-access-5zcp2\") pod \"a42b23e9-4c11-409a-a3b5-020001d8baea\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") "
Jul 31 00:41:52.272727 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.272663    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a42b23e9-4c11-409a-a3b5-020001d8baea-plugins-config-volume\") pod \"a42b23e9-4c11-409a-a3b5-020001d8baea\" (UID: \"a42b23e9-4c11-409a-a3b5-020001d8baea\") "
Jul 31 00:41:52.273033 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.273000    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" (UID: "aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:52.273097 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.273050    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42b23e9-4c11-409a-a3b5-020001d8baea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a42b23e9-4c11-409a-a3b5-020001d8baea" (UID: "a42b23e9-4c11-409a-a3b5-020001d8baea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:52.274853 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.274832    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42b23e9-4c11-409a-a3b5-020001d8baea-kube-api-access-5zcp2" (OuterVolumeSpecName: "kube-api-access-5zcp2") pod "a42b23e9-4c11-409a-a3b5-020001d8baea" (UID: "a42b23e9-4c11-409a-a3b5-020001d8baea"). InnerVolumeSpecName "kube-api-access-5zcp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:52.274916 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.274877    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-kube-api-access-4f984" (OuterVolumeSpecName: "kube-api-access-4f984") pod "aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" (UID: "aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb"). InnerVolumeSpecName "kube-api-access-4f984". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:52.357077 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.357047    2555 generic.go:356] "Generic (PLEG): container finished" podID="aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" containerID="a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d" exitCode=0
Jul 31 00:41:52.357212 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.357097    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"
Jul 31 00:41:52.357212 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.357133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45" event={"ID":"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb","Type":"ContainerDied","Data":"a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d"}
Jul 31 00:41:52.357212 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.357187    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45" event={"ID":"aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb","Type":"ContainerDied","Data":"50d2753882c8532b5d55796e8efc26a7165631c8639a6f7a2befb76c23f016e7"}
Jul 31 00:41:52.357381 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.357210    2555 scope.go:117] "RemoveContainer" containerID="a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d"
Jul 31 00:41:52.358541 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.358521    2555 generic.go:356] "Generic (PLEG): container finished" podID="a42b23e9-4c11-409a-a3b5-020001d8baea" containerID="48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd" exitCode=0
Jul 31 00:41:52.358629 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.358576    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"
Jul 31 00:41:52.358629 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.358606    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw" event={"ID":"a42b23e9-4c11-409a-a3b5-020001d8baea","Type":"ContainerDied","Data":"48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd"}
Jul 31 00:41:52.358716 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.358660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw" event={"ID":"a42b23e9-4c11-409a-a3b5-020001d8baea","Type":"ContainerDied","Data":"4d334e758c195345131dfa6768d1511ef765bfbaea5329b3af7cef963ce0d415"}
Jul 31 00:41:52.366667 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.366654    2555 scope.go:117] "RemoveContainer" containerID="a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d"
Jul 31 00:41:52.367027 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:41:52.367010    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d\": container with ID starting with a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d not found: ID does not exist" containerID="a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d"
Jul 31 00:41:52.367112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.367040    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d"} err="failed to get container status \"a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d\": rpc error: code = NotFound desc = could not find container \"a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d\": container with ID starting with a16584efd1c88f6b30831f3b393af34a0cab65c0fe39717036f69f2179d1834d not found: ID does not exist"
Jul 31 00:41:52.367112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.367061    2555 scope.go:117] "RemoveContainer" containerID="48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd"
Jul 31 00:41:52.374258 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.374239    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f984\" (UniqueName: \"kubernetes.io/projected/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-kube-api-access-4f984\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:52.374345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.374259    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:52.374345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.374270    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zcp2\" (UniqueName: \"kubernetes.io/projected/a42b23e9-4c11-409a-a3b5-020001d8baea-kube-api-access-5zcp2\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:52.374345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.374278    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a42b23e9-4c11-409a-a3b5-020001d8baea-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:41:52.374769 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.374742    2555 scope.go:117] "RemoveContainer" containerID="48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd"
Jul 31 00:41:52.375030 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:41:52.375011    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd\": container with ID starting with 48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd not found: ID does not exist" containerID="48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd"
Jul 31 00:41:52.375093 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.375038    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd"} err="failed to get container status \"48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd\": rpc error: code = NotFound desc = could not find container \"48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd\": container with ID starting with 48b032f34aa103e326935696bf563e948c1a5b4726e8d9ad9214cf9ecfbb71cd not found: ID does not exist"
Jul 31 00:41:52.377548 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.377526    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"]
Jul 31 00:41:52.382506 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.382487    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eee00287-5f5db69696-mxv45"]
Jul 31 00:41:52.390345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.390327    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"]
Jul 31 00:41:52.395991 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:52.395944    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eee00287-79b867658d-55rdw"]
Jul 31 00:41:53.866635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:53.866601    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42b23e9-4c11-409a-a3b5-020001d8baea" path="/var/lib/kubelet/pods/a42b23e9-4c11-409a-a3b5-020001d8baea/volumes"
Jul 31 00:41:53.867030 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:53.866966    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" path="/var/lib/kubelet/pods/aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb/volumes"
Jul 31 00:41:57.762699 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.762670    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"]
Jul 31 00:41:57.763105 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.763091    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42b23e9-4c11-409a-a3b5-020001d8baea" containerName="payload-processing"
Jul 31 00:41:57.763150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.763107    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42b23e9-4c11-409a-a3b5-020001d8baea" containerName="payload-processing"
Jul 31 00:41:57.763150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.763117    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" containerName="payload-pre-processing"
Jul 31 00:41:57.763150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.763123    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" containerName="payload-pre-processing"
Jul 31 00:41:57.763239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.763188    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42b23e9-4c11-409a-a3b5-020001d8baea" containerName="payload-processing"
Jul 31 00:41:57.763239 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.763199    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaadcf9f-cd4a-4cd8-a7c8-2f4e50cd26cb" containerName="payload-pre-processing"
Jul 31 00:41:57.767514 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.767499    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:57.769225 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.769204    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-eeb90a6e-dockercfg-42j8n\""
Jul 31 00:41:57.769349 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.769336    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-eeb90a6e\""
Jul 31 00:41:57.776386 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.776365    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"]
Jul 31 00:41:57.796170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.796142    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"]
Jul 31 00:41:57.799415 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.799398    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:57.807682 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.807660    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"]
Jul 31 00:41:57.925153 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.925119    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0dadb30-e9e3-4376-b03d-58491498d29c-plugins-config-volume\") pod \"payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") " pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:57.925153 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.925155    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h46m\" (UniqueName: \"kubernetes.io/projected/f0dadb30-e9e3-4376-b03d-58491498d29c-kube-api-access-2h46m\") pod \"payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") " pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:57.925384 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.925189    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtl9\" (UniqueName: \"kubernetes.io/projected/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-kube-api-access-xwtl9\") pod \"payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:57.925384 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:57.925237    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.026339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.026262    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0dadb30-e9e3-4376-b03d-58491498d29c-plugins-config-volume\") pod \"payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") " pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:58.026339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.026300    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h46m\" (UniqueName: \"kubernetes.io/projected/f0dadb30-e9e3-4376-b03d-58491498d29c-kube-api-access-2h46m\") pod \"payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") " pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:58.026543 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.026432    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtl9\" (UniqueName: \"kubernetes.io/projected/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-kube-api-access-xwtl9\") pod \"payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.026543 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.026481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.027023 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.027005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0dadb30-e9e3-4376-b03d-58491498d29c-plugins-config-volume\") pod \"payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") " pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:58.027136 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.027121    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.036725 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.036703    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h46m\" (UniqueName: \"kubernetes.io/projected/f0dadb30-e9e3-4376-b03d-58491498d29c-kube-api-access-2h46m\") pod \"payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") " pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:58.036884 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.036775    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtl9\" (UniqueName: \"kubernetes.io/projected/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-kube-api-access-xwtl9\") pod \"payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.078937 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.078907    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.110194 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.110169    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:41:58.223738 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.223711    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"]
Jul 31 00:41:58.225868 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:41:58.225842    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a20bd58_1cd7_4d84_93b7_d26ff98fc564.slice/crio-d051d80eb1293830eb855f2257533ed4b5137027e7467854c735c43308108305 WatchSource:0}: Error finding container d051d80eb1293830eb855f2257533ed4b5137027e7467854c735c43308108305: Status 404 returned error can't find the container with id d051d80eb1293830eb855f2257533ed4b5137027e7467854c735c43308108305
Jul 31 00:41:58.390354 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.390315    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs" event={"ID":"0a20bd58-1cd7-4d84-93b7-d26ff98fc564","Type":"ContainerStarted","Data":"208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58"}
Jul 31 00:41:58.390506 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.390377    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs" event={"ID":"0a20bd58-1cd7-4d84-93b7-d26ff98fc564","Type":"ContainerStarted","Data":"d051d80eb1293830eb855f2257533ed4b5137027e7467854c735c43308108305"}
Jul 31 00:41:58.390506 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.390415    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:41:58.463653 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.463607    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs" podStartSLOduration=1.463587414 podStartE2EDuration="1.463587414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:58.403119009 +0000 UTC m=+2123.127084998" watchObservedRunningTime="2026-07-31 00:41:58.463587414 +0000 UTC m=+2123.187553380"
Jul 31 00:41:58.464405 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:58.464386    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"]
Jul 31 00:41:58.466170 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:41:58.466141    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0dadb30_e9e3_4376_b03d_58491498d29c.slice/crio-194d1ce5593e5b1d1cfbdb90f65ab462033c7ead7fda96c415434d050a2fcc91 WatchSource:0}: Error finding container 194d1ce5593e5b1d1cfbdb90f65ab462033c7ead7fda96c415434d050a2fcc91: Status 404 returned error can't find the container with id 194d1ce5593e5b1d1cfbdb90f65ab462033c7ead7fda96c415434d050a2fcc91
Jul 31 00:41:59.396316 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:59.396271    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql" event={"ID":"f0dadb30-e9e3-4376-b03d-58491498d29c","Type":"ContainerStarted","Data":"0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1"}
Jul 31 00:41:59.396833 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:59.396381    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql" event={"ID":"f0dadb30-e9e3-4376-b03d-58491498d29c","Type":"ContainerStarted","Data":"194d1ce5593e5b1d1cfbdb90f65ab462033c7ead7fda96c415434d050a2fcc91"}
Jul 31 00:41:59.410883 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:41:59.410835    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql" podStartSLOduration=2.410821458 podStartE2EDuration="2.410821458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:59.408742704 +0000 UTC m=+2124.132708681" watchObservedRunningTime="2026-07-31 00:41:59.410821458 +0000 UTC m=+2124.134787425"
Jul 31 00:42:00.401372 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:00.401343    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:42:09.398924 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:09.398890    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:42:11.409269 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:11.409238    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:42:27.652031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.651942    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"]
Jul 31 00:42:27.652618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.652202    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql" podUID="f0dadb30-e9e3-4376-b03d-58491498d29c" containerName="payload-processing" containerID="cri-o://0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1" gracePeriod=30
Jul 31 00:42:27.658282 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.658250    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"]
Jul 31 00:42:27.658483 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.658454    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs" podUID="0a20bd58-1cd7-4d84-93b7-d26ff98fc564" containerName="payload-pre-processing" containerID="cri-o://208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58" gracePeriod=30
Jul 31 00:42:27.926636 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.926609    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:42:27.944941 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.944913    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:42:27.974831 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.974803    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-plugins-config-volume\") pod \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") "
Jul 31 00:42:27.974831 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.974833    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0dadb30-e9e3-4376-b03d-58491498d29c-plugins-config-volume\") pod \"f0dadb30-e9e3-4376-b03d-58491498d29c\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") "
Jul 31 00:42:27.975060 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.974856    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h46m\" (UniqueName: \"kubernetes.io/projected/f0dadb30-e9e3-4376-b03d-58491498d29c-kube-api-access-2h46m\") pod \"f0dadb30-e9e3-4376-b03d-58491498d29c\" (UID: \"f0dadb30-e9e3-4376-b03d-58491498d29c\") "
Jul 31 00:42:27.975060 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.974963    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwtl9\" (UniqueName: \"kubernetes.io/projected/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-kube-api-access-xwtl9\") pod \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\" (UID: \"0a20bd58-1cd7-4d84-93b7-d26ff98fc564\") "
Jul 31 00:42:27.975267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.975242    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0dadb30-e9e3-4376-b03d-58491498d29c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0dadb30-e9e3-4376-b03d-58491498d29c" (UID: "f0dadb30-e9e3-4376-b03d-58491498d29c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:42:27.975327 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.975268    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a20bd58-1cd7-4d84-93b7-d26ff98fc564" (UID: "0a20bd58-1cd7-4d84-93b7-d26ff98fc564"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:42:27.977169 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.977150    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0dadb30-e9e3-4376-b03d-58491498d29c-kube-api-access-2h46m" (OuterVolumeSpecName: "kube-api-access-2h46m") pod "f0dadb30-e9e3-4376-b03d-58491498d29c" (UID: "f0dadb30-e9e3-4376-b03d-58491498d29c"). InnerVolumeSpecName "kube-api-access-2h46m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:42:27.977169 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:27.977160    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-kube-api-access-xwtl9" (OuterVolumeSpecName: "kube-api-access-xwtl9") pod "0a20bd58-1cd7-4d84-93b7-d26ff98fc564" (UID: "0a20bd58-1cd7-4d84-93b7-d26ff98fc564"). InnerVolumeSpecName "kube-api-access-xwtl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:42:28.075848 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.075816    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwtl9\" (UniqueName: \"kubernetes.io/projected/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-kube-api-access-xwtl9\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.075848 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.075845    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a20bd58-1cd7-4d84-93b7-d26ff98fc564-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.075848 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.075854    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0dadb30-e9e3-4376-b03d-58491498d29c-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.075848 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.075865    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h46m\" (UniqueName: \"kubernetes.io/projected/f0dadb30-e9e3-4376-b03d-58491498d29c-kube-api-access-2h46m\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.531580 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.531543    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0dadb30-e9e3-4376-b03d-58491498d29c" containerID="0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1" exitCode=0
Jul 31 00:42:28.531795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.531588    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"
Jul 31 00:42:28.531795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.531635    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql" event={"ID":"f0dadb30-e9e3-4376-b03d-58491498d29c","Type":"ContainerDied","Data":"0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1"}
Jul 31 00:42:28.531795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.531687    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql" event={"ID":"f0dadb30-e9e3-4376-b03d-58491498d29c","Type":"ContainerDied","Data":"194d1ce5593e5b1d1cfbdb90f65ab462033c7ead7fda96c415434d050a2fcc91"}
Jul 31 00:42:28.531795 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.531712    2555 scope.go:117] "RemoveContainer" containerID="0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1"
Jul 31 00:42:28.532948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.532800    2555 generic.go:356] "Generic (PLEG): container finished" podID="0a20bd58-1cd7-4d84-93b7-d26ff98fc564" containerID="208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58" exitCode=0
Jul 31 00:42:28.532948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.532839    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"
Jul 31 00:42:28.532948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.532881    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs" event={"ID":"0a20bd58-1cd7-4d84-93b7-d26ff98fc564","Type":"ContainerDied","Data":"208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58"}
Jul 31 00:42:28.532948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.532919    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs" event={"ID":"0a20bd58-1cd7-4d84-93b7-d26ff98fc564","Type":"ContainerDied","Data":"d051d80eb1293830eb855f2257533ed4b5137027e7467854c735c43308108305"}
Jul 31 00:42:28.540914 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.540880    2555 scope.go:117] "RemoveContainer" containerID="0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1"
Jul 31 00:42:28.541170 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:42:28.541151    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1\": container with ID starting with 0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1 not found: ID does not exist" containerID="0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1"
Jul 31 00:42:28.541262 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.541182    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1"} err="failed to get container status \"0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1\": rpc error: code = NotFound desc = could not find container \"0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1\": container with ID starting with 0906742c8e0ba00e99b05dea51478a85cbb1ecee0b1f55d71512b0c94a5d25b1 not found: ID does not exist"
Jul 31 00:42:28.541262 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.541205    2555 scope.go:117] "RemoveContainer" containerID="208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58"
Jul 31 00:42:28.549351 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.549335    2555 scope.go:117] "RemoveContainer" containerID="208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58"
Jul 31 00:42:28.549581 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:42:28.549564    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58\": container with ID starting with 208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58 not found: ID does not exist" containerID="208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58"
Jul 31 00:42:28.549631 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.549590    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58"} err="failed to get container status \"208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58\": rpc error: code = NotFound desc = could not find container \"208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58\": container with ID starting with 208e8a3817939270686e4536ba157ac376325388159bb57616ffb0108de98f58 not found: ID does not exist"
Jul 31 00:42:28.553827 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.553806    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"]
Jul 31 00:42:28.557359 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.557338    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eeb90a6e-68cc885dcd-6vxql"]
Jul 31 00:42:28.565926 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.565903    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"]
Jul 31 00:42:28.573570 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:28.573551    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eeb90a6e-5c746dfb48-m69fs"]
Jul 31 00:42:29.866600 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:29.866565    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a20bd58-1cd7-4d84-93b7-d26ff98fc564" path="/var/lib/kubelet/pods/0a20bd58-1cd7-4d84-93b7-d26ff98fc564/volumes"
Jul 31 00:42:29.866991 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:42:29.866944    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0dadb30-e9e3-4376-b03d-58491498d29c" path="/var/lib/kubelet/pods/f0dadb30-e9e3-4376-b03d-58491498d29c/volumes"
Jul 31 00:44:29.738053 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.737981    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"]
Jul 31 00:44:29.738486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.738369    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a20bd58-1cd7-4d84-93b7-d26ff98fc564" containerName="payload-pre-processing"
Jul 31 00:44:29.738486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.738381    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a20bd58-1cd7-4d84-93b7-d26ff98fc564" containerName="payload-pre-processing"
Jul 31 00:44:29.738486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.738391    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0dadb30-e9e3-4376-b03d-58491498d29c" containerName="payload-processing"
Jul 31 00:44:29.738486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.738397    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0dadb30-e9e3-4376-b03d-58491498d29c" containerName="payload-processing"
Jul 31 00:44:29.738486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.738457    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0dadb30-e9e3-4376-b03d-58491498d29c" containerName="payload-processing"
Jul 31 00:44:29.738486 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.738464    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a20bd58-1cd7-4d84-93b7-d26ff98fc564" containerName="payload-pre-processing"
Jul 31 00:44:29.740954 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.740933    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.742885 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.742867    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-632e9fcf\""
Jul 31 00:44:29.743028 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.742868    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-632e9fcf-dockercfg-w2gxg\""
Jul 31 00:44:29.752061 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.752040    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"]
Jul 31 00:44:29.761191 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.761168    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"]
Jul 31 00:44:29.764454 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.764437    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:29.774779 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.774727    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"]
Jul 31 00:44:29.840320 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.840284    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7657b4c5-3900-4079-866f-bacce9538113-plugins-config-volume\") pod \"payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") " pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:29.840510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.840334    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqf64\" (UniqueName: \"kubernetes.io/projected/7657b4c5-3900-4079-866f-bacce9538113-kube-api-access-dqf64\") pod \"payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") " pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:29.840510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.840365    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lcxl\" (UniqueName: \"kubernetes.io/projected/d897e26d-ffb8-40e7-ab67-626a09af0ba3-kube-api-access-6lcxl\") pod \"payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.840510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.840399    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d897e26d-ffb8-40e7-ab67-626a09af0ba3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.941770 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.941706    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7657b4c5-3900-4079-866f-bacce9538113-plugins-config-volume\") pod \"payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") " pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:29.941985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.941807    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqf64\" (UniqueName: \"kubernetes.io/projected/7657b4c5-3900-4079-866f-bacce9538113-kube-api-access-dqf64\") pod \"payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") " pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:29.941985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.941838    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lcxl\" (UniqueName: \"kubernetes.io/projected/d897e26d-ffb8-40e7-ab67-626a09af0ba3-kube-api-access-6lcxl\") pod \"payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.942133 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.942105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d897e26d-ffb8-40e7-ab67-626a09af0ba3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.942584 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.942564    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7657b4c5-3900-4079-866f-bacce9538113-plugins-config-volume\") pod \"payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") " pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:29.942940 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.942918    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d897e26d-ffb8-40e7-ab67-626a09af0ba3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.949797 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.949746    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lcxl\" (UniqueName: \"kubernetes.io/projected/d897e26d-ffb8-40e7-ab67-626a09af0ba3-kube-api-access-6lcxl\") pod \"payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:29.949912 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:29.949797    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqf64\" (UniqueName: \"kubernetes.io/projected/7657b4c5-3900-4079-866f-bacce9538113-kube-api-access-dqf64\") pod \"payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") " pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:30.051547 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:30.051464    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:30.075305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:30.075279    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:30.401052 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:30.400965    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"]
Jul 31 00:44:30.403811 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:44:30.403786    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd897e26d_ffb8_40e7_ab67_626a09af0ba3.slice/crio-2e06bad9d88ffd9e9afbf7ef74d39906dd6d27f643c74fe9287e10b535efbe73 WatchSource:0}: Error finding container 2e06bad9d88ffd9e9afbf7ef74d39906dd6d27f643c74fe9287e10b535efbe73: Status 404 returned error can't find the container with id 2e06bad9d88ffd9e9afbf7ef74d39906dd6d27f643c74fe9287e10b535efbe73
Jul 31 00:44:30.428341 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:30.428316    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"]
Jul 31 00:44:30.435844 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:44:30.435817    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7657b4c5_3900_4079_866f_bacce9538113.slice/crio-5a34c6fe590d63354c9c664e3b87bb17095ad26a726bbca5a0064016d7ac1251 WatchSource:0}: Error finding container 5a34c6fe590d63354c9c664e3b87bb17095ad26a726bbca5a0064016d7ac1251: Status 404 returned error can't find the container with id 5a34c6fe590d63354c9c664e3b87bb17095ad26a726bbca5a0064016d7ac1251
Jul 31 00:44:31.105668 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.105623    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt" event={"ID":"7657b4c5-3900-4079-866f-bacce9538113","Type":"ContainerStarted","Data":"34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d"}
Jul 31 00:44:31.106150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.105688    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:31.106150 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.105711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt" event={"ID":"7657b4c5-3900-4079-866f-bacce9538113","Type":"ContainerStarted","Data":"5a34c6fe590d63354c9c664e3b87bb17095ad26a726bbca5a0064016d7ac1251"}
Jul 31 00:44:31.107213 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.107189    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m" event={"ID":"d897e26d-ffb8-40e7-ab67-626a09af0ba3","Type":"ContainerStarted","Data":"d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833"}
Jul 31 00:44:31.107348 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.107236    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m" event={"ID":"d897e26d-ffb8-40e7-ab67-626a09af0ba3","Type":"ContainerStarted","Data":"2e06bad9d88ffd9e9afbf7ef74d39906dd6d27f643c74fe9287e10b535efbe73"}
Jul 31 00:44:31.107348 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.107265    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:44:31.130685 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.130641    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m" podStartSLOduration=2.130627111 podStartE2EDuration="2.130627111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:44:31.129664012 +0000 UTC m=+2275.853629978" watchObservedRunningTime="2026-07-31 00:44:31.130627111 +0000 UTC m=+2275.854593079"
Jul 31 00:44:31.130842 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:31.130714    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt" podStartSLOduration=2.130710079 podStartE2EDuration="2.130710079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:44:31.117968242 +0000 UTC m=+2275.841934227" watchObservedRunningTime="2026-07-31 00:44:31.130710079 +0000 UTC m=+2275.854676046"
Jul 31 00:44:42.114549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:42.114519    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:44:42.114932 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:44:42.114684    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:45:00.207816 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.207774    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"]
Jul 31 00:45:00.211288 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.211268    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:00.213383 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.213363    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:45:00.217558 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.217531    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"]
Jul 31 00:45:00.303903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.303873    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d1c532-9842-4940-8425-f411c5f742ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h\" (UID: \"90d1c532-9842-4940-8425-f411c5f742ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:00.405188 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.405152    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d1c532-9842-4940-8425-f411c5f742ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h\" (UID: \"90d1c532-9842-4940-8425-f411c5f742ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:00.405794 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.405772    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d1c532-9842-4940-8425-f411c5f742ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h\" (UID: \"90d1c532-9842-4940-8425-f411c5f742ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:00.524224 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.524145    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:00.662246 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.662212    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"]
Jul 31 00:45:00.664521 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:45:00.664484    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d1c532_9842_4940_8425_f411c5f742ad.slice/crio-93c6bab2c58a15229b400ca2fe3d9e6284f7de5dc91851d21911f9ff1054a95d WatchSource:0}: Error finding container 93c6bab2c58a15229b400ca2fe3d9e6284f7de5dc91851d21911f9ff1054a95d: Status 404 returned error can't find the container with id 93c6bab2c58a15229b400ca2fe3d9e6284f7de5dc91851d21911f9ff1054a95d
Jul 31 00:45:00.666603 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:00.666586    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:45:01.254211 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:01.254176    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h" event={"ID":"90d1c532-9842-4940-8425-f411c5f742ad","Type":"ContainerStarted","Data":"93c6bab2c58a15229b400ca2fe3d9e6284f7de5dc91851d21911f9ff1054a95d"}
Jul 31 00:45:18.333286 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:18.333246    2555 generic.go:356] "Generic (PLEG): container finished" podID="90d1c532-9842-4940-8425-f411c5f742ad" containerID="7b6b11710ce33d6d233d9401a32bc4833e00f31a082c1e4b1383f6a69f5a639c" exitCode=0
Jul 31 00:45:18.333683 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:18.333332    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h" event={"ID":"90d1c532-9842-4940-8425-f411c5f742ad","Type":"ContainerDied","Data":"7b6b11710ce33d6d233d9401a32bc4833e00f31a082c1e4b1383f6a69f5a639c"}
Jul 31 00:45:19.470656 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:19.470630    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:19.578614 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:19.578575    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d1c532-9842-4940-8425-f411c5f742ad-maas-api-service-ca\") pod \"90d1c532-9842-4940-8425-f411c5f742ad\" (UID: \"90d1c532-9842-4940-8425-f411c5f742ad\") "
Jul 31 00:45:19.579018 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:19.578991    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90d1c532-9842-4940-8425-f411c5f742ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90d1c532-9842-4940-8425-f411c5f742ad" (UID: "90d1c532-9842-4940-8425-f411c5f742ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:45:19.679813 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:19.679781    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90d1c532-9842-4940-8425-f411c5f742ad-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:45:20.344096 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:20.344059    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"
Jul 31 00:45:20.344096 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:20.344091    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h" event={"ID":"90d1c532-9842-4940-8425-f411c5f742ad","Type":"ContainerDied","Data":"93c6bab2c58a15229b400ca2fe3d9e6284f7de5dc91851d21911f9ff1054a95d"}
Jul 31 00:45:20.344308 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:20.344132    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93c6bab2c58a15229b400ca2fe3d9e6284f7de5dc91851d21911f9ff1054a95d"
Jul 31 00:45:30.737509 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:30.737429    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"]
Jul 31 00:45:30.738510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:30.738250    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt" podUID="7657b4c5-3900-4079-866f-bacce9538113" containerName="payload-processing" containerID="cri-o://34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d" gracePeriod=30
Jul 31 00:45:30.744707 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:30.744668    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"]
Jul 31 00:45:30.745051 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:30.745019    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m" podUID="d897e26d-ffb8-40e7-ab67-626a09af0ba3" containerName="payload-pre-processing" containerID="cri-o://d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833" gracePeriod=30
Jul 31 00:45:30.881469 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:30.881433    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"]
Jul 31 00:45:30.884855 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:30.884825    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-632e9fcf-b7z5h"]
Jul 31 00:45:31.022183 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.022157    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:45:31.024901 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.024872    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:45:31.071599 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.071576    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7657b4c5-3900-4079-866f-bacce9538113-plugins-config-volume\") pod \"7657b4c5-3900-4079-866f-bacce9538113\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") "
Jul 31 00:45:31.071779 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.071638    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqf64\" (UniqueName: \"kubernetes.io/projected/7657b4c5-3900-4079-866f-bacce9538113-kube-api-access-dqf64\") pod \"7657b4c5-3900-4079-866f-bacce9538113\" (UID: \"7657b4c5-3900-4079-866f-bacce9538113\") "
Jul 31 00:45:31.071779 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.071666    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lcxl\" (UniqueName: \"kubernetes.io/projected/d897e26d-ffb8-40e7-ab67-626a09af0ba3-kube-api-access-6lcxl\") pod \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") "
Jul 31 00:45:31.071779 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.071709    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d897e26d-ffb8-40e7-ab67-626a09af0ba3-plugins-config-volume\") pod \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\" (UID: \"d897e26d-ffb8-40e7-ab67-626a09af0ba3\") "
Jul 31 00:45:31.072050 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.072023    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7657b4c5-3900-4079-866f-bacce9538113-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7657b4c5-3900-4079-866f-bacce9538113" (UID: "7657b4c5-3900-4079-866f-bacce9538113"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:45:31.072164 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.072140    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d897e26d-ffb8-40e7-ab67-626a09af0ba3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d897e26d-ffb8-40e7-ab67-626a09af0ba3" (UID: "d897e26d-ffb8-40e7-ab67-626a09af0ba3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:45:31.073819 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.073799    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7657b4c5-3900-4079-866f-bacce9538113-kube-api-access-dqf64" (OuterVolumeSpecName: "kube-api-access-dqf64") pod "7657b4c5-3900-4079-866f-bacce9538113" (UID: "7657b4c5-3900-4079-866f-bacce9538113"). InnerVolumeSpecName "kube-api-access-dqf64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:45:31.073929 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.073910    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d897e26d-ffb8-40e7-ab67-626a09af0ba3-kube-api-access-6lcxl" (OuterVolumeSpecName: "kube-api-access-6lcxl") pod "d897e26d-ffb8-40e7-ab67-626a09af0ba3" (UID: "d897e26d-ffb8-40e7-ab67-626a09af0ba3"). InnerVolumeSpecName "kube-api-access-6lcxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:45:31.172872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.172832    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lcxl\" (UniqueName: \"kubernetes.io/projected/d897e26d-ffb8-40e7-ab67-626a09af0ba3-kube-api-access-6lcxl\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.172872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.172867    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d897e26d-ffb8-40e7-ab67-626a09af0ba3-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.172872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.172877    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7657b4c5-3900-4079-866f-bacce9538113-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.172872 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.172886    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqf64\" (UniqueName: \"kubernetes.io/projected/7657b4c5-3900-4079-866f-bacce9538113-kube-api-access-dqf64\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.398989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.398901    2555 generic.go:356] "Generic (PLEG): container finished" podID="d897e26d-ffb8-40e7-ab67-626a09af0ba3" containerID="d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833" exitCode=0
Jul 31 00:45:31.398989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.398947    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"
Jul 31 00:45:31.398989 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.398951    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m" event={"ID":"d897e26d-ffb8-40e7-ab67-626a09af0ba3","Type":"ContainerDied","Data":"d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833"}
Jul 31 00:45:31.399231 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.399006    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m" event={"ID":"d897e26d-ffb8-40e7-ab67-626a09af0ba3","Type":"ContainerDied","Data":"2e06bad9d88ffd9e9afbf7ef74d39906dd6d27f643c74fe9287e10b535efbe73"}
Jul 31 00:45:31.399231 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.399028    2555 scope.go:117] "RemoveContainer" containerID="d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833"
Jul 31 00:45:31.400596 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.400559    2555 generic.go:356] "Generic (PLEG): container finished" podID="7657b4c5-3900-4079-866f-bacce9538113" containerID="34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d" exitCode=0
Jul 31 00:45:31.400741 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.400597    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"
Jul 31 00:45:31.400741 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.400610    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt" event={"ID":"7657b4c5-3900-4079-866f-bacce9538113","Type":"ContainerDied","Data":"34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d"}
Jul 31 00:45:31.400741 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.400647    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt" event={"ID":"7657b4c5-3900-4079-866f-bacce9538113","Type":"ContainerDied","Data":"5a34c6fe590d63354c9c664e3b87bb17095ad26a726bbca5a0064016d7ac1251"}
Jul 31 00:45:31.408804 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.408777    2555 scope.go:117] "RemoveContainer" containerID="d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833"
Jul 31 00:45:31.409062 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:45:31.409044    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833\": container with ID starting with d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833 not found: ID does not exist" containerID="d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833"
Jul 31 00:45:31.409132 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.409081    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833"} err="failed to get container status \"d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833\": rpc error: code = NotFound desc = could not find container \"d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833\": container with ID starting with d7cbf55a92b74b3a016cea84759f7453e702ca99e44fabea044529959583e833 not found: ID does not exist"
Jul 31 00:45:31.409132 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.409097    2555 scope.go:117] "RemoveContainer" containerID="34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d"
Jul 31 00:45:31.417001 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.416983    2555 scope.go:117] "RemoveContainer" containerID="34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d"
Jul 31 00:45:31.417238 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:45:31.417221    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d\": container with ID starting with 34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d not found: ID does not exist" containerID="34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d"
Jul 31 00:45:31.417288 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.417245    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d"} err="failed to get container status \"34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d\": rpc error: code = NotFound desc = could not find container \"34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d\": container with ID starting with 34e429e9507f97157a85d253a8b881ec0aa27745ed7d4694b79adf62cffa638d not found: ID does not exist"
Jul 31 00:45:31.420956 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.420932    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"]
Jul 31 00:45:31.424440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.424420    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-632e9fcf-64b57b9688-5xt8m"]
Jul 31 00:45:31.432635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.432618    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"]
Jul 31 00:45:31.434613 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.434594    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-632e9fcf-54bc47ff4-lqcxt"]
Jul 31 00:45:31.867535 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.867493    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7657b4c5-3900-4079-866f-bacce9538113" path="/var/lib/kubelet/pods/7657b4c5-3900-4079-866f-bacce9538113/volumes"
Jul 31 00:45:31.868035 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.868006    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d1c532-9842-4940-8425-f411c5f742ad" path="/var/lib/kubelet/pods/90d1c532-9842-4940-8425-f411c5f742ad/volumes"
Jul 31 00:45:31.868389 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:45:31.868369    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d897e26d-ffb8-40e7-ab67-626a09af0ba3" path="/var/lib/kubelet/pods/d897e26d-ffb8-40e7-ab67-626a09af0ba3/volumes"
Jul 31 00:47:56.841321 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841278    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"]
Jul 31 00:47:56.841803 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841788    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7657b4c5-3900-4079-866f-bacce9538113" containerName="payload-processing"
Jul 31 00:47:56.841867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841805    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7657b4c5-3900-4079-866f-bacce9538113" containerName="payload-processing"
Jul 31 00:47:56.841867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841818    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d897e26d-ffb8-40e7-ab67-626a09af0ba3" containerName="payload-pre-processing"
Jul 31 00:47:56.841867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841824    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d897e26d-ffb8-40e7-ab67-626a09af0ba3" containerName="payload-pre-processing"
Jul 31 00:47:56.841867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841834    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d1c532-9842-4940-8425-f411c5f742ad" containerName="revoke-keys"
Jul 31 00:47:56.841867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841840    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d1c532-9842-4940-8425-f411c5f742ad" containerName="revoke-keys"
Jul 31 00:47:56.842054 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841907    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d1c532-9842-4940-8425-f411c5f742ad" containerName="revoke-keys"
Jul 31 00:47:56.842054 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841913    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7657b4c5-3900-4079-866f-bacce9538113" containerName="payload-processing"
Jul 31 00:47:56.842054 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.841921    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d897e26d-ffb8-40e7-ab67-626a09af0ba3" containerName="payload-pre-processing"
Jul 31 00:47:56.845056 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.845027    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:56.847083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.847059    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3f92bdba\""
Jul 31 00:47:56.847083 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.847073    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3f92bdba-dockercfg-jn5n5\""
Jul 31 00:47:56.855645 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.855621    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"]
Jul 31 00:47:56.867333 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.867308    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"]
Jul 31 00:47:56.870791 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.870775    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:56.878843 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.878792    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"]
Jul 31 00:47:56.942414 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.942377    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szpd7\" (UniqueName: \"kubernetes.io/projected/fd6830ea-e535-47fc-9e16-f1f607396ecf-kube-api-access-szpd7\") pod \"payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:56.942414 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.942414    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-plugins-config-volume\") pod \"payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") " pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:56.942631 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.942438    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd6830ea-e535-47fc-9e16-f1f607396ecf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:56.942631 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:56.942520    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgbm\" (UniqueName: \"kubernetes.io/projected/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-kube-api-access-tdgbm\") pod \"payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") " pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:57.043731 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.043681    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szpd7\" (UniqueName: \"kubernetes.io/projected/fd6830ea-e535-47fc-9e16-f1f607396ecf-kube-api-access-szpd7\") pod \"payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:57.043943 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.043748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-plugins-config-volume\") pod \"payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") " pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:57.043943 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.043799    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd6830ea-e535-47fc-9e16-f1f607396ecf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:57.043943 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.043889    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgbm\" (UniqueName: \"kubernetes.io/projected/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-kube-api-access-tdgbm\") pod \"payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") " pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:57.044959 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.044928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-plugins-config-volume\") pod \"payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") " pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:57.045112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.044928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd6830ea-e535-47fc-9e16-f1f607396ecf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:57.051343 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.051316    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgbm\" (UniqueName: \"kubernetes.io/projected/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-kube-api-access-tdgbm\") pod \"payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") " pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:57.051626 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.051605    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szpd7\" (UniqueName: \"kubernetes.io/projected/fd6830ea-e535-47fc-9e16-f1f607396ecf-kube-api-access-szpd7\") pod \"payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:57.156487 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.156403    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:57.184965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.184923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:57.315145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.315111    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"]
Jul 31 00:47:57.317651 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:47:57.317599    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6830ea_e535_47fc_9e16_f1f607396ecf.slice/crio-6e045c9e368102604048927a1870122745926cf023828fb09612f2fa63c60b1b WatchSource:0}: Error finding container 6e045c9e368102604048927a1870122745926cf023828fb09612f2fa63c60b1b: Status 404 returned error can't find the container with id 6e045c9e368102604048927a1870122745926cf023828fb09612f2fa63c60b1b
Jul 31 00:47:57.338743 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:57.338699    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"]
Jul 31 00:47:57.341852 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:47:57.341825    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7432a7d1_75f7_4dcf_b5bf_e754b6bc0d7e.slice/crio-4bf5f004d28c3b634c39cb2820fecf943f4f17a48c06f4d5e8da77a98a92dbf2 WatchSource:0}: Error finding container 4bf5f004d28c3b634c39cb2820fecf943f4f17a48c06f4d5e8da77a98a92dbf2: Status 404 returned error can't find the container with id 4bf5f004d28c3b634c39cb2820fecf943f4f17a48c06f4d5e8da77a98a92dbf2
Jul 31 00:47:58.071715 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.071682    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h" event={"ID":"fd6830ea-e535-47fc-9e16-f1f607396ecf","Type":"ContainerStarted","Data":"9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3"}
Jul 31 00:47:58.072159 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.071892    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:47:58.072159 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.071937    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h" event={"ID":"fd6830ea-e535-47fc-9e16-f1f607396ecf","Type":"ContainerStarted","Data":"6e045c9e368102604048927a1870122745926cf023828fb09612f2fa63c60b1b"}
Jul 31 00:47:58.073434 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.073412    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr" event={"ID":"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e","Type":"ContainerStarted","Data":"36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f"}
Jul 31 00:47:58.073532 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.073449    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr" event={"ID":"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e","Type":"ContainerStarted","Data":"4bf5f004d28c3b634c39cb2820fecf943f4f17a48c06f4d5e8da77a98a92dbf2"}
Jul 31 00:47:58.073532 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.073469    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:47:58.087383 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.087346    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h" podStartSLOduration=2.087334002 podStartE2EDuration="2.087334002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:47:58.085553195 +0000 UTC m=+2482.809519164" watchObservedRunningTime="2026-07-31 00:47:58.087334002 +0000 UTC m=+2482.811299968"
Jul 31 00:47:58.101703 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:47:58.101547    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr" podStartSLOduration=2.101526981 podStartE2EDuration="2.101526981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:47:58.098307591 +0000 UTC m=+2482.822273610" watchObservedRunningTime="2026-07-31 00:47:58.101526981 +0000 UTC m=+2482.825492948"
Jul 31 00:48:09.080971 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:09.080938    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:48:09.081467 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:09.081010    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:48:21.781743 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.781711    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"]
Jul 31 00:48:21.785227 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.785207    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.787274 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.787255    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3f92bdba\"/\"openshift-service-ca.crt\""
Jul 31 00:48:21.787739 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.787722    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3f92bdba\"/\"kube-root-ca.crt\""
Jul 31 00:48:21.787843 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.787781    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3f92bdba\"/\"e2e-lifecycle-model-3f92bdba-kserve-self-signed-certs\""
Jul 31 00:48:21.787843 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.787804    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3f92bdba\"/\"default-dockercfg-cv6vj\""
Jul 31 00:48:21.795892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.795863    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"]
Jul 31 00:48:21.866227 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.866201    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svd29\" (UniqueName: \"kubernetes.io/projected/57a0855c-37e2-4261-a08b-1022ace5f4a0-kube-api-access-svd29\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.866368 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.866241    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-dshm\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.866368 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.866259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-tmp-dir\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.866482 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.866382    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a0855c-37e2-4261-a08b-1022ace5f4a0-tls-certs\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.866482 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.866416    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-home\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.866559 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.866492    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-model-cache\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967424 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967387    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a0855c-37e2-4261-a08b-1022ace5f4a0-tls-certs\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967436    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-home\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967479    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-model-cache\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967525    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svd29\" (UniqueName: \"kubernetes.io/projected/57a0855c-37e2-4261-a08b-1022ace5f4a0-kube-api-access-svd29\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967597    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-dshm\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967625 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967619    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-tmp-dir\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.967980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967869    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-home\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.968045 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.967974    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-model-cache\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.968183 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.968160    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-tmp-dir\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.970037 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.970013    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-dshm\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.970264 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.970243    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a0855c-37e2-4261-a08b-1022ace5f4a0-tls-certs\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:21.974301 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:21.974279    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svd29\" (UniqueName: \"kubernetes.io/projected/57a0855c-37e2-4261-a08b-1022ace5f4a0-kube-api-access-svd29\") pod \"e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") " pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:22.097120 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:22.097054    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:22.228487 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:22.228432    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"]
Jul 31 00:48:22.230926 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:48:22.230900    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57a0855c_37e2_4261_a08b_1022ace5f4a0.slice/crio-1e3476bb3a4f67634d5397ec60c1a5b8a886887cab4d09ee2aa08d1cbeec66ac WatchSource:0}: Error finding container 1e3476bb3a4f67634d5397ec60c1a5b8a886887cab4d09ee2aa08d1cbeec66ac: Status 404 returned error can't find the container with id 1e3476bb3a4f67634d5397ec60c1a5b8a886887cab4d09ee2aa08d1cbeec66ac
Jul 31 00:48:23.197293 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:23.197258    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g" event={"ID":"57a0855c-37e2-4261-a08b-1022ace5f4a0","Type":"ContainerStarted","Data":"e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44"}
Jul 31 00:48:23.197293 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:23.197298    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g" event={"ID":"57a0855c-37e2-4261-a08b-1022ace5f4a0","Type":"ContainerStarted","Data":"1e3476bb3a4f67634d5397ec60c1a5b8a886887cab4d09ee2aa08d1cbeec66ac"}
Jul 31 00:48:23.212822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:23.212778    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g" podStartSLOduration=2.212745141 podStartE2EDuration="2.212745141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:48:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:48:23.211054441 +0000 UTC m=+2507.935020407" watchObservedRunningTime="2026-07-31 00:48:23.212745141 +0000 UTC m=+2507.936711152"
Jul 31 00:48:32.097986 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:32.097895    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:32.098500 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:32.097962    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:32.110906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:32.110883    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:48:32.251355 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:48:32.251331    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:49:10.061318 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.061283    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"]
Jul 31 00:49:10.061976 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.061561    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr" podUID="7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" containerName="payload-processing" containerID="cri-o://36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f" gracePeriod=30
Jul 31 00:49:10.068371 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.068333    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"]
Jul 31 00:49:10.068676 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.068621    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h" podUID="fd6830ea-e535-47fc-9e16-f1f607396ecf" containerName="payload-pre-processing" containerID="cri-o://9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3" gracePeriod=30
Jul 31 00:49:10.335230 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.335200    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:49:10.338213 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.338193    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:49:10.427300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.427259    2555 generic.go:356] "Generic (PLEG): container finished" podID="fd6830ea-e535-47fc-9e16-f1f607396ecf" containerID="9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3" exitCode=0
Jul 31 00:49:10.427300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.427301    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"
Jul 31 00:49:10.427556 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.427348    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h" event={"ID":"fd6830ea-e535-47fc-9e16-f1f607396ecf","Type":"ContainerDied","Data":"9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3"}
Jul 31 00:49:10.427556 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.427409    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h" event={"ID":"fd6830ea-e535-47fc-9e16-f1f607396ecf","Type":"ContainerDied","Data":"6e045c9e368102604048927a1870122745926cf023828fb09612f2fa63c60b1b"}
Jul 31 00:49:10.427556 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.427439    2555 scope.go:117] "RemoveContainer" containerID="9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3"
Jul 31 00:49:10.428652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.428636    2555 generic.go:356] "Generic (PLEG): container finished" podID="7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" containerID="36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f" exitCode=0
Jul 31 00:49:10.428734 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.428671    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"
Jul 31 00:49:10.428817 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.428731    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr" event={"ID":"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e","Type":"ContainerDied","Data":"36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f"}
Jul 31 00:49:10.428817 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.428799    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr" event={"ID":"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e","Type":"ContainerDied","Data":"4bf5f004d28c3b634c39cb2820fecf943f4f17a48c06f4d5e8da77a98a92dbf2"}
Jul 31 00:49:10.435819 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.435802    2555 scope.go:117] "RemoveContainer" containerID="9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3"
Jul 31 00:49:10.436082 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:49:10.436065    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3\": container with ID starting with 9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3 not found: ID does not exist" containerID="9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3"
Jul 31 00:49:10.436134 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.436091    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3"} err="failed to get container status \"9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3\": rpc error: code = NotFound desc = could not find container \"9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3\": container with ID starting with 9a9d6ec2126e811af7f7afe5ded859863272c50062d7beb338f0b330630adac3 not found: ID does not exist"
Jul 31 00:49:10.436134 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.436108    2555 scope.go:117] "RemoveContainer" containerID="36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f"
Jul 31 00:49:10.443555 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.443536    2555 scope.go:117] "RemoveContainer" containerID="36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f"
Jul 31 00:49:10.443818 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:49:10.443795    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f\": container with ID starting with 36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f not found: ID does not exist" containerID="36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f"
Jul 31 00:49:10.443885 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.443831    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f"} err="failed to get container status \"36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f\": rpc error: code = NotFound desc = could not find container \"36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f\": container with ID starting with 36825cd87921f55b27bad00b2fc161d79b15990319d8df2ba3c71453304ade1f not found: ID does not exist"
Jul 31 00:49:10.482121 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.482094    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szpd7\" (UniqueName: \"kubernetes.io/projected/fd6830ea-e535-47fc-9e16-f1f607396ecf-kube-api-access-szpd7\") pod \"fd6830ea-e535-47fc-9e16-f1f607396ecf\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") "
Jul 31 00:49:10.482223 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.482126    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd6830ea-e535-47fc-9e16-f1f607396ecf-plugins-config-volume\") pod \"fd6830ea-e535-47fc-9e16-f1f607396ecf\" (UID: \"fd6830ea-e535-47fc-9e16-f1f607396ecf\") "
Jul 31 00:49:10.482223 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.482153    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-plugins-config-volume\") pod \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") "
Jul 31 00:49:10.482334 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.482232    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdgbm\" (UniqueName: \"kubernetes.io/projected/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-kube-api-access-tdgbm\") pod \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\" (UID: \"7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e\") "
Jul 31 00:49:10.482529 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.482504    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6830ea-e535-47fc-9e16-f1f607396ecf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd6830ea-e535-47fc-9e16-f1f607396ecf" (UID: "fd6830ea-e535-47fc-9e16-f1f607396ecf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:49:10.482529 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.482522    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" (UID: "7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:49:10.484308 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.484289    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6830ea-e535-47fc-9e16-f1f607396ecf-kube-api-access-szpd7" (OuterVolumeSpecName: "kube-api-access-szpd7") pod "fd6830ea-e535-47fc-9e16-f1f607396ecf" (UID: "fd6830ea-e535-47fc-9e16-f1f607396ecf"). InnerVolumeSpecName "kube-api-access-szpd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:49:10.484384 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.484325    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-kube-api-access-tdgbm" (OuterVolumeSpecName: "kube-api-access-tdgbm") pod "7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" (UID: "7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e"). InnerVolumeSpecName "kube-api-access-tdgbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:49:10.583961 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.583895    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szpd7\" (UniqueName: \"kubernetes.io/projected/fd6830ea-e535-47fc-9e16-f1f607396ecf-kube-api-access-szpd7\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.583961 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.583919    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd6830ea-e535-47fc-9e16-f1f607396ecf-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.583961 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.583929    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.583961 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.583939    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdgbm\" (UniqueName: \"kubernetes.io/projected/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e-kube-api-access-tdgbm\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.750247 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.750221    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"]
Jul 31 00:49:10.755352 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.755324    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3f92bdba-84df9d75c4-phvlr"]
Jul 31 00:49:10.763930 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.763889    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"]
Jul 31 00:49:10.765410 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:10.765388    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3f92bdba-7fd85b84d-8fm9h"]
Jul 31 00:49:11.867404 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:11.867368    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" path="/var/lib/kubelet/pods/7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e/volumes"
Jul 31 00:49:11.867794 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:11.867710    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd6830ea-e535-47fc-9e16-f1f607396ecf" path="/var/lib/kubelet/pods/fd6830ea-e535-47fc-9e16-f1f607396ecf/volumes"
Jul 31 00:49:18.664142 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:18.664101    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"]
Jul 31 00:49:33.684064 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.684024    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g" podUID="57a0855c-37e2-4261-a08b-1022ace5f4a0" containerName="main" containerID="cri-o://e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44" gracePeriod=45
Jul 31 00:49:33.937796 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.937735    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:49:33.979475 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979448    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-dshm\") pod \"57a0855c-37e2-4261-a08b-1022ace5f4a0\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") "
Jul 31 00:49:33.979641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979531    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a0855c-37e2-4261-a08b-1022ace5f4a0-tls-certs\") pod \"57a0855c-37e2-4261-a08b-1022ace5f4a0\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") "
Jul 31 00:49:33.979641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979573    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-model-cache\") pod \"57a0855c-37e2-4261-a08b-1022ace5f4a0\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") "
Jul 31 00:49:33.979641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979610    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svd29\" (UniqueName: \"kubernetes.io/projected/57a0855c-37e2-4261-a08b-1022ace5f4a0-kube-api-access-svd29\") pod \"57a0855c-37e2-4261-a08b-1022ace5f4a0\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") "
Jul 31 00:49:33.979641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979631    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-tmp-dir\") pod \"57a0855c-37e2-4261-a08b-1022ace5f4a0\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") "
Jul 31 00:49:33.979958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979667    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-home\") pod \"57a0855c-37e2-4261-a08b-1022ace5f4a0\" (UID: \"57a0855c-37e2-4261-a08b-1022ace5f4a0\") "
Jul 31 00:49:33.979958 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.979886    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "57a0855c-37e2-4261-a08b-1022ace5f4a0" (UID: "57a0855c-37e2-4261-a08b-1022ace5f4a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:49:33.980086 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.980013    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-model-cache\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:33.980140 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.980097    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-home" (OuterVolumeSpecName: "home") pod "57a0855c-37e2-4261-a08b-1022ace5f4a0" (UID: "57a0855c-37e2-4261-a08b-1022ace5f4a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:49:33.980318 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.980225    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57a0855c-37e2-4261-a08b-1022ace5f4a0" (UID: "57a0855c-37e2-4261-a08b-1022ace5f4a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:49:33.982211 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.982184    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a0855c-37e2-4261-a08b-1022ace5f4a0-kube-api-access-svd29" (OuterVolumeSpecName: "kube-api-access-svd29") pod "57a0855c-37e2-4261-a08b-1022ace5f4a0" (UID: "57a0855c-37e2-4261-a08b-1022ace5f4a0"). InnerVolumeSpecName "kube-api-access-svd29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:49:33.982393 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.982370    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a0855c-37e2-4261-a08b-1022ace5f4a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57a0855c-37e2-4261-a08b-1022ace5f4a0" (UID: "57a0855c-37e2-4261-a08b-1022ace5f4a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:49:33.982393 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:33.982376    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-dshm" (OuterVolumeSpecName: "dshm") pod "57a0855c-37e2-4261-a08b-1022ace5f4a0" (UID: "57a0855c-37e2-4261-a08b-1022ace5f4a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:49:34.081440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.081403    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-tmp-dir\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:34.081440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.081431    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-home\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:34.081440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.081443    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a0855c-37e2-4261-a08b-1022ace5f4a0-dshm\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:34.081664 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.081453    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a0855c-37e2-4261-a08b-1022ace5f4a0-tls-certs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:34.081664 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.081467    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svd29\" (UniqueName: \"kubernetes.io/projected/57a0855c-37e2-4261-a08b-1022ace5f4a0-kube-api-access-svd29\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:49:34.552491 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.552453    2555 generic.go:356] "Generic (PLEG): container finished" podID="57a0855c-37e2-4261-a08b-1022ace5f4a0" containerID="e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44" exitCode=0
Jul 31 00:49:34.552644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.552500    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"
Jul 31 00:49:34.552644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.552567    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g" event={"ID":"57a0855c-37e2-4261-a08b-1022ace5f4a0","Type":"ContainerDied","Data":"e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44"}
Jul 31 00:49:34.552644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.552618    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g" event={"ID":"57a0855c-37e2-4261-a08b-1022ace5f4a0","Type":"ContainerDied","Data":"1e3476bb3a4f67634d5397ec60c1a5b8a886887cab4d09ee2aa08d1cbeec66ac"}
Jul 31 00:49:34.552644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.552642    2555 scope.go:117] "RemoveContainer" containerID="e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44"
Jul 31 00:49:34.562374 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.562351    2555 scope.go:117] "RemoveContainer" containerID="e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44"
Jul 31 00:49:34.562649 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:49:34.562627    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44\": container with ID starting with e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44 not found: ID does not exist" containerID="e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44"
Jul 31 00:49:34.562700 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.562664    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44"} err="failed to get container status \"e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44\": rpc error: code = NotFound desc = could not find container \"e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44\": container with ID starting with e014dea9c0d034f74c8c73848b938f6f43dfefb0eb9dd1f63e42bd7bfaee4f44 not found: ID does not exist"
Jul 31 00:49:34.572462 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.572437    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"]
Jul 31 00:49:34.576205 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:34.576183    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3f92bdba/e2e-lifecycle-model-3f92bdba-kserve-859d979587-zv75g"]
Jul 31 00:49:35.873200 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:49:35.870075    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57a0855c-37e2-4261-a08b-1022ace5f4a0" path="/var/lib/kubelet/pods/57a0855c-37e2-4261-a08b-1022ace5f4a0/volumes"
Jul 31 00:51:36.089340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:36.089247    2555 scope.go:117] "RemoveContainer" containerID="7b6b11710ce33d6d233d9401a32bc4833e00f31a082c1e4b1383f6a69f5a639c"
Jul 31 00:51:41.972547 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972509    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"]
Jul 31 00:51:41.972950 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972916    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a0855c-37e2-4261-a08b-1022ace5f4a0" containerName="main"
Jul 31 00:51:41.972950 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972929    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a0855c-37e2-4261-a08b-1022ace5f4a0" containerName="main"
Jul 31 00:51:41.972950 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972949    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" containerName="payload-processing"
Jul 31 00:51:41.973058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972955    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" containerName="payload-processing"
Jul 31 00:51:41.973058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972965    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6830ea-e535-47fc-9e16-f1f607396ecf" containerName="payload-pre-processing"
Jul 31 00:51:41.973058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.972971    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6830ea-e535-47fc-9e16-f1f607396ecf" containerName="payload-pre-processing"
Jul 31 00:51:41.973058 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.973049    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6830ea-e535-47fc-9e16-f1f607396ecf" containerName="payload-pre-processing"
Jul 31 00:51:41.973179 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.973063    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7432a7d1-75f7-4dcf-b5bf-e754b6bc0d7e" containerName="payload-processing"
Jul 31 00:51:41.973179 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.973076    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a0855c-37e2-4261-a08b-1022ace5f4a0" containerName="main"
Jul 31 00:51:41.977284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.977267    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:41.979093 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.979076    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c23a2c\""
Jul 31 00:51:41.986060 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:41.986027    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"]
Jul 31 00:51:42.015623 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.015599    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"]
Jul 31 00:51:42.019099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.019084    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.020915 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.020895    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c23a2c-dockercfg-2wkk7\""
Jul 31 00:51:42.027898 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.027878    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"]
Jul 31 00:51:42.086954 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.086926    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc35875a-eafc-4890-bc47-955c5e8ac544-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.087106 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.087054    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvf4t\" (UniqueName: \"kubernetes.io/projected/dc35875a-eafc-4890-bc47-955c5e8ac544-kube-api-access-dvf4t\") pod \"payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.188357 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.188323    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvf4t\" (UniqueName: \"kubernetes.io/projected/dc35875a-eafc-4890-bc47-955c5e8ac544-kube-api-access-dvf4t\") pod \"payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.188554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.188377    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b42bf7-c468-49e0-ba35-46ec11d1739e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.188554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.188402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc35875a-eafc-4890-bc47-955c5e8ac544-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.188554 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.188462    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlb7q\" (UniqueName: \"kubernetes.io/projected/d0b42bf7-c468-49e0-ba35-46ec11d1739e-kube-api-access-jlb7q\") pod \"payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.189131 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.189112    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc35875a-eafc-4890-bc47-955c5e8ac544-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.196650 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.196617    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvf4t\" (UniqueName: \"kubernetes.io/projected/dc35875a-eafc-4890-bc47-955c5e8ac544-kube-api-access-dvf4t\") pod \"payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.288947 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.288865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:42.289181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.289156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b42bf7-c468-49e0-ba35-46ec11d1739e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.289310 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.289201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlb7q\" (UniqueName: \"kubernetes.io/projected/d0b42bf7-c468-49e0-ba35-46ec11d1739e-kube-api-access-jlb7q\") pod \"payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.289846 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.289827    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b42bf7-c468-49e0-ba35-46ec11d1739e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.296413 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.296393    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlb7q\" (UniqueName: \"kubernetes.io/projected/d0b42bf7-c468-49e0-ba35-46ec11d1739e-kube-api-access-jlb7q\") pod \"payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.330345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.330316    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:42.441096 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.441065    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"]
Jul 31 00:51:42.442246 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:51:42.442212    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc35875a_eafc_4890_bc47_955c5e8ac544.slice/crio-4f8d39419dce17f12062fa66a0d85cf9683d2a7053048b216fd0a5d6a65e829a WatchSource:0}: Error finding container 4f8d39419dce17f12062fa66a0d85cf9683d2a7053048b216fd0a5d6a65e829a: Status 404 returned error can't find the container with id 4f8d39419dce17f12062fa66a0d85cf9683d2a7053048b216fd0a5d6a65e829a
Jul 31 00:51:42.482461 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:42.482429    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"]
Jul 31 00:51:42.486504 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:51:42.486466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b42bf7_c468_49e0_ba35_46ec11d1739e.slice/crio-6f439f68573ed602bdd1dcfcdbf631cc05955f2bc7e305cfb95899386cfd3912 WatchSource:0}: Error finding container 6f439f68573ed602bdd1dcfcdbf631cc05955f2bc7e305cfb95899386cfd3912: Status 404 returned error can't find the container with id 6f439f68573ed602bdd1dcfcdbf631cc05955f2bc7e305cfb95899386cfd3912
Jul 31 00:51:43.143208 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.143161    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx" event={"ID":"dc35875a-eafc-4890-bc47-955c5e8ac544","Type":"ContainerStarted","Data":"6109c77531475faba53a9cd0a085b95719299773c84dc27d69680d48bf32f96e"}
Jul 31 00:51:43.143690 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.143342    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:51:43.143690 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.143384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx" event={"ID":"dc35875a-eafc-4890-bc47-955c5e8ac544","Type":"ContainerStarted","Data":"4f8d39419dce17f12062fa66a0d85cf9683d2a7053048b216fd0a5d6a65e829a"}
Jul 31 00:51:43.144980 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.144955    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47" event={"ID":"d0b42bf7-c468-49e0-ba35-46ec11d1739e","Type":"ContainerStarted","Data":"a7fe6a29dd14928d0adfb982af36adf1dba786ac13b6f55afab8411264ad5708"}
Jul 31 00:51:43.145125 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.144998    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47" event={"ID":"d0b42bf7-c468-49e0-ba35-46ec11d1739e","Type":"ContainerStarted","Data":"6f439f68573ed602bdd1dcfcdbf631cc05955f2bc7e305cfb95899386cfd3912"}
Jul 31 00:51:43.145125 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.145020    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:43.157908 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.157861    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx" podStartSLOduration=2.157848242 podStartE2EDuration="2.157848242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:51:43.155884266 +0000 UTC m=+2707.879850230" watchObservedRunningTime="2026-07-31 00:51:43.157848242 +0000 UTC m=+2707.881814209"
Jul 31 00:51:43.170711 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:43.170666    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47" podStartSLOduration=1.17064948 podStartE2EDuration="1.17064948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:51:43.1698351 +0000 UTC m=+2707.893801080" watchObservedRunningTime="2026-07-31 00:51:43.17064948 +0000 UTC m=+2707.894615447"
Jul 31 00:51:54.151957 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:54.151919    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:51:54.152348 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:51:54.152082    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:52:10.451578 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.451545    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"]
Jul 31 00:52:10.455436 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.455420    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.457209 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.457190    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-0fc38b-dockercfg-6x2lh\""
Jul 31 00:52:10.457322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.457194    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-0fc38b\""
Jul 31 00:52:10.464669 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.464651    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"]
Jul 31 00:52:10.483787 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.483745    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"]
Jul 31 00:52:10.487462 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.487446    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.497744 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.497725    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"]
Jul 31 00:52:10.512364 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.512344    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmthd\" (UniqueName: \"kubernetes.io/projected/8c26db33-2348-4db9-ba49-7d1faae73791-kube-api-access-pmthd\") pod \"payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.512465 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.512388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c26db33-2348-4db9-ba49-7d1faae73791-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.613113 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.613080    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmthd\" (UniqueName: \"kubernetes.io/projected/8c26db33-2348-4db9-ba49-7d1faae73791-kube-api-access-pmthd\") pod \"payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.613305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.613142    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztqlh\" (UniqueName: \"kubernetes.io/projected/7b35016e-be48-41b7-a264-b1150fe2c506-kube-api-access-ztqlh\") pod \"payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.613305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.613189    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c26db33-2348-4db9-ba49-7d1faae73791-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.613305 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.613234    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b35016e-be48-41b7-a264-b1150fe2c506-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.613867 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.613847    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c26db33-2348-4db9-ba49-7d1faae73791-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.620040 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.620010    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmthd\" (UniqueName: \"kubernetes.io/projected/8c26db33-2348-4db9-ba49-7d1faae73791-kube-api-access-pmthd\") pod \"payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.714136 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.714080    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b35016e-be48-41b7-a264-b1150fe2c506-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.714228 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.714139    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztqlh\" (UniqueName: \"kubernetes.io/projected/7b35016e-be48-41b7-a264-b1150fe2c506-kube-api-access-ztqlh\") pod \"payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.714707 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.714690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b35016e-be48-41b7-a264-b1150fe2c506-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.721992 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.721967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztqlh\" (UniqueName: \"kubernetes.io/projected/7b35016e-be48-41b7-a264-b1150fe2c506-kube-api-access-ztqlh\") pod \"payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.767743 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.767714    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:10.797907 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.797878    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:10.944788 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:10.944749    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"]
Jul 31 00:52:10.946924 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:52:10.946896    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b35016e_be48_41b7_a264_b1150fe2c506.slice/crio-6cb9d99e39e866a51f98700c6592efec93b2206281553caceb9d67a0af66a45d WatchSource:0}: Error finding container 6cb9d99e39e866a51f98700c6592efec93b2206281553caceb9d67a0af66a45d: Status 404 returned error can't find the container with id 6cb9d99e39e866a51f98700c6592efec93b2206281553caceb9d67a0af66a45d
Jul 31 00:52:11.121628 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.121558    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"]
Jul 31 00:52:11.123705 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:52:11.123683    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c26db33_2348_4db9_ba49_7d1faae73791.slice/crio-fe57c9dc0aa4b62c0085559bfba6cb7070702147937811fd68a61ccafcfa2050 WatchSource:0}: Error finding container fe57c9dc0aa4b62c0085559bfba6cb7070702147937811fd68a61ccafcfa2050: Status 404 returned error can't find the container with id fe57c9dc0aa4b62c0085559bfba6cb7070702147937811fd68a61ccafcfa2050
Jul 31 00:52:11.277704 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.277610    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" event={"ID":"8c26db33-2348-4db9-ba49-7d1faae73791","Type":"ContainerStarted","Data":"13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23"}
Jul 31 00:52:11.277704 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.277675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" event={"ID":"8c26db33-2348-4db9-ba49-7d1faae73791","Type":"ContainerStarted","Data":"fe57c9dc0aa4b62c0085559bfba6cb7070702147937811fd68a61ccafcfa2050"}
Jul 31 00:52:11.278049 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.277708    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:52:11.279172 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.279144    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz" event={"ID":"7b35016e-be48-41b7-a264-b1150fe2c506","Type":"ContainerStarted","Data":"3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81"}
Jul 31 00:52:11.279282 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.279200    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:11.279282 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.279225    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz" event={"ID":"7b35016e-be48-41b7-a264-b1150fe2c506","Type":"ContainerStarted","Data":"6cb9d99e39e866a51f98700c6592efec93b2206281553caceb9d67a0af66a45d"}
Jul 31 00:52:11.291207 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.291163    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" podStartSLOduration=1.291149184 podStartE2EDuration="1.291149184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:52:11.289583522 +0000 UTC m=+2736.013549488" watchObservedRunningTime="2026-07-31 00:52:11.291149184 +0000 UTC m=+2736.015115151"
Jul 31 00:52:11.303719 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:11.303680    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz" podStartSLOduration=1.303666018 podStartE2EDuration="1.303666018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:52:11.30240547 +0000 UTC m=+2736.026371459" watchObservedRunningTime="2026-07-31 00:52:11.303666018 +0000 UTC m=+2736.027631986"
Jul 31 00:52:22.286174 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:22.286128    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" podUID="8c26db33-2348-4db9-ba49-7d1faae73791" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.59:9004: connect: connection refused"
Jul 31 00:52:22.286584 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:22.286554    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:52:32.284957 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:52:32.284927    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:53:12.288010 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.287926    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"]
Jul 31 00:53:12.292098 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.292076    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.294598 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.294575    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0fc38b\"/\"kube-root-ca.crt\""
Jul 31 00:53:12.294723 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.294576    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0fc38b\"/\"openshift-service-ca.crt\""
Jul 31 00:53:12.294723 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.294576    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0fc38b\"/\"test-model-0fc38b-kserve-self-signed-certs\""
Jul 31 00:53:12.294877 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.294603    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0fc38b\"/\"default-dockercfg-hd6dj\""
Jul 31 00:53:12.299924 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.299902    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"]
Jul 31 00:53:12.344333 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.344306    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-dshm\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.344474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.344337    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-model-cache\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.344474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.344364    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-home\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.344474 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.344441    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kf87\" (UniqueName: \"kubernetes.io/projected/8894df91-a216-4fa5-8b6f-035846331658-kube-api-access-5kf87\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.344583 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.344481    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-tmp-dir\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.344583 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.344516    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8894df91-a216-4fa5-8b6f-035846331658-tls-certs\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.445997 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.445958    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kf87\" (UniqueName: \"kubernetes.io/projected/8894df91-a216-4fa5-8b6f-035846331658-kube-api-access-5kf87\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.445997 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446000    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-tmp-dir\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446037    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8894df91-a216-4fa5-8b6f-035846331658-tls-certs\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446088    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-dshm\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446159    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-model-cache\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-home\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446557 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446538    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-tmp-dir\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446643 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446570    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-home\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.446643 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.446587    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-model-cache\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.448483 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.448463    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-dshm\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.448646 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.448627    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8894df91-a216-4fa5-8b6f-035846331658-tls-certs\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.452678 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.452656    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kf87\" (UniqueName: \"kubernetes.io/projected/8894df91-a216-4fa5-8b6f-035846331658-kube-api-access-5kf87\") pod \"test-model-0fc38b-kserve-6c8d689545-l62gm\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") " pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.604878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.604799    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:12.738777 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:12.738693    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"]
Jul 31 00:53:12.741197 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:53:12.741168    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8894df91_a216_4fa5_8b6f_035846331658.slice/crio-4b61da3642fde525c4ccd0bcefdf13c09f87ee474658a77996e893481ac99032 WatchSource:0}: Error finding container 4b61da3642fde525c4ccd0bcefdf13c09f87ee474658a77996e893481ac99032: Status 404 returned error can't find the container with id 4b61da3642fde525c4ccd0bcefdf13c09f87ee474658a77996e893481ac99032
Jul 31 00:53:13.580084 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:13.580046    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm" event={"ID":"8894df91-a216-4fa5-8b6f-035846331658","Type":"ContainerStarted","Data":"4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82"}
Jul 31 00:53:13.580084 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:13.580088    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm" event={"ID":"8894df91-a216-4fa5-8b6f-035846331658","Type":"ContainerStarted","Data":"4b61da3642fde525c4ccd0bcefdf13c09f87ee474658a77996e893481ac99032"}
Jul 31 00:53:13.595457 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:13.595403    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm" podStartSLOduration=1.595388902 podStartE2EDuration="1.595388902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:53:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:53:13.59395127 +0000 UTC m=+2798.317917237" watchObservedRunningTime="2026-07-31 00:53:13.595388902 +0000 UTC m=+2798.319354869"
Jul 31 00:53:22.605535 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:22.605498    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:22.605970 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:22.605572    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:22.618211 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:22.618186    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:53:22.640355 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:53:22.640332    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:54:00.933426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:00.933387    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"]
Jul 31 00:54:01.075924 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.075892    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"]
Jul 31 00:54:01.079469 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.079449    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:01.081125 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.081105    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:54:01.085231 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.085209    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"]
Jul 31 00:54:01.155588 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.155554    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b44d4b8f-b64f-498e-bd1d-af6ad84c8485-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd\" (UID: \"b44d4b8f-b64f-498e-bd1d-af6ad84c8485\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:01.256634 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.256559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b44d4b8f-b64f-498e-bd1d-af6ad84c8485-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd\" (UID: \"b44d4b8f-b64f-498e-bd1d-af6ad84c8485\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:01.257192 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.257163    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b44d4b8f-b64f-498e-bd1d-af6ad84c8485-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd\" (UID: \"b44d4b8f-b64f-498e-bd1d-af6ad84c8485\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:01.390355 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.390324    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:01.525345 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.525319    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"]
Jul 31 00:54:01.527652 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:54:01.527628    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44d4b8f_b64f_498e_bd1d_af6ad84c8485.slice/crio-3dda263b4e5548610a27860de84f6977c6124a6de0a2046807c52441ea99beb7 WatchSource:0}: Error finding container 3dda263b4e5548610a27860de84f6977c6124a6de0a2046807c52441ea99beb7: Status 404 returned error can't find the container with id 3dda263b4e5548610a27860de84f6977c6124a6de0a2046807c52441ea99beb7
Jul 31 00:54:01.821099 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:01.821027    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd" event={"ID":"b44d4b8f-b64f-498e-bd1d-af6ad84c8485","Type":"ContainerStarted","Data":"3dda263b4e5548610a27860de84f6977c6124a6de0a2046807c52441ea99beb7"}
Jul 31 00:54:02.827452 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:02.827417    2555 generic.go:356] "Generic (PLEG): container finished" podID="b44d4b8f-b64f-498e-bd1d-af6ad84c8485" containerID="7fc1a6c495ce8ed3f4deccbc4a43b0cf1726c8bc927a4753c5e3a5e90fa0a5cd" exitCode=0
Jul 31 00:54:02.827879 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:02.827469    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd" event={"ID":"b44d4b8f-b64f-498e-bd1d-af6ad84c8485","Type":"ContainerDied","Data":"7fc1a6c495ce8ed3f4deccbc4a43b0cf1726c8bc927a4753c5e3a5e90fa0a5cd"}
Jul 31 00:54:03.969921 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:03.969893    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:04.079869 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:04.079836    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b44d4b8f-b64f-498e-bd1d-af6ad84c8485-maas-api-service-ca\") pod \"b44d4b8f-b64f-498e-bd1d-af6ad84c8485\" (UID: \"b44d4b8f-b64f-498e-bd1d-af6ad84c8485\") "
Jul 31 00:54:04.080293 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:04.080263    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b44d4b8f-b64f-498e-bd1d-af6ad84c8485-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b44d4b8f-b64f-498e-bd1d-af6ad84c8485" (UID: "b44d4b8f-b64f-498e-bd1d-af6ad84c8485"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:04.180473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:04.180451    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b44d4b8f-b64f-498e-bd1d-af6ad84c8485-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:04.838935 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:04.838897    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd" event={"ID":"b44d4b8f-b64f-498e-bd1d-af6ad84c8485","Type":"ContainerDied","Data":"3dda263b4e5548610a27860de84f6977c6124a6de0a2046807c52441ea99beb7"}
Jul 31 00:54:04.839100 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:04.838970    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dda263b4e5548610a27860de84f6977c6124a6de0a2046807c52441ea99beb7"
Jul 31 00:54:04.839100 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:04.838909    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"
Jul 31 00:54:11.644985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.644954    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"]
Jul 31 00:54:11.645443 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.645195    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47" podUID="d0b42bf7-c468-49e0-ba35-46ec11d1739e" containerName="payload-processing" containerID="cri-o://a7fe6a29dd14928d0adfb982af36adf1dba786ac13b6f55afab8411264ad5708" gracePeriod=30
Jul 31 00:54:11.651725 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.651699    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"]
Jul 31 00:54:11.651985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.651934    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx" podUID="dc35875a-eafc-4890-bc47-955c5e8ac544" containerName="payload-pre-processing" containerID="cri-o://6109c77531475faba53a9cd0a085b95719299773c84dc27d69680d48bf32f96e" gracePeriod=30
Jul 31 00:54:11.791354 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.791313    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"]
Jul 31 00:54:11.793383 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.793360    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c23a2c-4zdqd"]
Jul 31 00:54:11.868651 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.868614    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b44d4b8f-b64f-498e-bd1d-af6ad84c8485" path="/var/lib/kubelet/pods/b44d4b8f-b64f-498e-bd1d-af6ad84c8485/volumes"
Jul 31 00:54:11.874184 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.874154    2555 generic.go:356] "Generic (PLEG): container finished" podID="dc35875a-eafc-4890-bc47-955c5e8ac544" containerID="6109c77531475faba53a9cd0a085b95719299773c84dc27d69680d48bf32f96e" exitCode=0
Jul 31 00:54:11.874344 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.874246    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx" event={"ID":"dc35875a-eafc-4890-bc47-955c5e8ac544","Type":"ContainerDied","Data":"6109c77531475faba53a9cd0a085b95719299773c84dc27d69680d48bf32f96e"}
Jul 31 00:54:11.876094 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.876073    2555 generic.go:356] "Generic (PLEG): container finished" podID="d0b42bf7-c468-49e0-ba35-46ec11d1739e" containerID="a7fe6a29dd14928d0adfb982af36adf1dba786ac13b6f55afab8411264ad5708" exitCode=0
Jul 31 00:54:11.876216 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.876142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47" event={"ID":"d0b42bf7-c468-49e0-ba35-46ec11d1739e","Type":"ContainerDied","Data":"a7fe6a29dd14928d0adfb982af36adf1dba786ac13b6f55afab8411264ad5708"}
Jul 31 00:54:11.925736 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.925712    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:54:11.928593 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:11.928575    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:54:12.045251 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.045218    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b42bf7-c468-49e0-ba35-46ec11d1739e-plugins-config-volume\") pod \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") "
Jul 31 00:54:12.045420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.045282    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc35875a-eafc-4890-bc47-955c5e8ac544-plugins-config-volume\") pod \"dc35875a-eafc-4890-bc47-955c5e8ac544\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") "
Jul 31 00:54:12.045420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.045320    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlb7q\" (UniqueName: \"kubernetes.io/projected/d0b42bf7-c468-49e0-ba35-46ec11d1739e-kube-api-access-jlb7q\") pod \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\" (UID: \"d0b42bf7-c468-49e0-ba35-46ec11d1739e\") "
Jul 31 00:54:12.045420 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.045357    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvf4t\" (UniqueName: \"kubernetes.io/projected/dc35875a-eafc-4890-bc47-955c5e8ac544-kube-api-access-dvf4t\") pod \"dc35875a-eafc-4890-bc47-955c5e8ac544\" (UID: \"dc35875a-eafc-4890-bc47-955c5e8ac544\") "
Jul 31 00:54:12.045672 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.045647    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35875a-eafc-4890-bc47-955c5e8ac544-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc35875a-eafc-4890-bc47-955c5e8ac544" (UID: "dc35875a-eafc-4890-bc47-955c5e8ac544"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:12.045672 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.045654    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b42bf7-c468-49e0-ba35-46ec11d1739e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0b42bf7-c468-49e0-ba35-46ec11d1739e" (UID: "d0b42bf7-c468-49e0-ba35-46ec11d1739e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:12.047464 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.047444    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b42bf7-c468-49e0-ba35-46ec11d1739e-kube-api-access-jlb7q" (OuterVolumeSpecName: "kube-api-access-jlb7q") pod "d0b42bf7-c468-49e0-ba35-46ec11d1739e" (UID: "d0b42bf7-c468-49e0-ba35-46ec11d1739e"). InnerVolumeSpecName "kube-api-access-jlb7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:12.047566 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.047546    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc35875a-eafc-4890-bc47-955c5e8ac544-kube-api-access-dvf4t" (OuterVolumeSpecName: "kube-api-access-dvf4t") pod "dc35875a-eafc-4890-bc47-955c5e8ac544" (UID: "dc35875a-eafc-4890-bc47-955c5e8ac544"). InnerVolumeSpecName "kube-api-access-dvf4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:12.146770 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.146734    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvf4t\" (UniqueName: \"kubernetes.io/projected/dc35875a-eafc-4890-bc47-955c5e8ac544-kube-api-access-dvf4t\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:12.146890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.146779    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b42bf7-c468-49e0-ba35-46ec11d1739e-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:12.146890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.146788    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc35875a-eafc-4890-bc47-955c5e8ac544-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:12.146890 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.146797    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlb7q\" (UniqueName: \"kubernetes.io/projected/d0b42bf7-c468-49e0-ba35-46ec11d1739e-kube-api-access-jlb7q\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:12.882042 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.882010    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"
Jul 31 00:54:12.882042 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.882027    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx" event={"ID":"dc35875a-eafc-4890-bc47-955c5e8ac544","Type":"ContainerDied","Data":"4f8d39419dce17f12062fa66a0d85cf9683d2a7053048b216fd0a5d6a65e829a"}
Jul 31 00:54:12.882561 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.882082    2555 scope.go:117] "RemoveContainer" containerID="6109c77531475faba53a9cd0a085b95719299773c84dc27d69680d48bf32f96e"
Jul 31 00:54:12.883509 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.883408    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47" event={"ID":"d0b42bf7-c468-49e0-ba35-46ec11d1739e","Type":"ContainerDied","Data":"6f439f68573ed602bdd1dcfcdbf631cc05955f2bc7e305cfb95899386cfd3912"}
Jul 31 00:54:12.883509 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.883423    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"
Jul 31 00:54:12.891948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.891935    2555 scope.go:117] "RemoveContainer" containerID="a7fe6a29dd14928d0adfb982af36adf1dba786ac13b6f55afab8411264ad5708"
Jul 31 00:54:12.905112 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.905090    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"]
Jul 31 00:54:12.908398 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.908378    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c23a2c-68477865bd-lbdkx"]
Jul 31 00:54:12.917128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.917081    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"]
Jul 31 00:54:12.920425 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:12.920405    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c23a2c-d56cc8586-xtc47"]
Jul 31 00:54:13.872639 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:13.867708    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b42bf7-c468-49e0-ba35-46ec11d1739e" path="/var/lib/kubelet/pods/d0b42bf7-c468-49e0-ba35-46ec11d1739e/volumes"
Jul 31 00:54:13.872639 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:13.868325    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc35875a-eafc-4890-bc47-955c5e8ac544" path="/var/lib/kubelet/pods/dc35875a-eafc-4890-bc47-955c5e8ac544/volumes"
Jul 31 00:54:15.953574 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:15.953507    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm" podUID="8894df91-a216-4fa5-8b6f-035846331658" containerName="main" containerID="cri-o://4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82" gracePeriod=45
Jul 31 00:54:16.197166 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.197138    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:54:16.284985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.284907    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-dshm\") pod \"8894df91-a216-4fa5-8b6f-035846331658\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") "
Jul 31 00:54:16.284985 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.284942    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-home\") pod \"8894df91-a216-4fa5-8b6f-035846331658\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") "
Jul 31 00:54:16.285181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285002    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8894df91-a216-4fa5-8b6f-035846331658-tls-certs\") pod \"8894df91-a216-4fa5-8b6f-035846331658\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") "
Jul 31 00:54:16.285181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285050    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kf87\" (UniqueName: \"kubernetes.io/projected/8894df91-a216-4fa5-8b6f-035846331658-kube-api-access-5kf87\") pod \"8894df91-a216-4fa5-8b6f-035846331658\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") "
Jul 31 00:54:16.285181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285082    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-model-cache\") pod \"8894df91-a216-4fa5-8b6f-035846331658\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") "
Jul 31 00:54:16.285181 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285111    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-tmp-dir\") pod \"8894df91-a216-4fa5-8b6f-035846331658\" (UID: \"8894df91-a216-4fa5-8b6f-035846331658\") "
Jul 31 00:54:16.285390 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285288    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-home" (OuterVolumeSpecName: "home") pod "8894df91-a216-4fa5-8b6f-035846331658" (UID: "8894df91-a216-4fa5-8b6f-035846331658"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:16.285455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285405    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-model-cache" (OuterVolumeSpecName: "model-cache") pod "8894df91-a216-4fa5-8b6f-035846331658" (UID: "8894df91-a216-4fa5-8b6f-035846331658"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:16.285455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285410    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8894df91-a216-4fa5-8b6f-035846331658" (UID: "8894df91-a216-4fa5-8b6f-035846331658"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:16.285455 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.285425    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-home\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:16.287268 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.287237    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-dshm" (OuterVolumeSpecName: "dshm") pod "8894df91-a216-4fa5-8b6f-035846331658" (UID: "8894df91-a216-4fa5-8b6f-035846331658"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:16.287362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.287295    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8894df91-a216-4fa5-8b6f-035846331658-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8894df91-a216-4fa5-8b6f-035846331658" (UID: "8894df91-a216-4fa5-8b6f-035846331658"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:54:16.287404 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.287371    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8894df91-a216-4fa5-8b6f-035846331658-kube-api-access-5kf87" (OuterVolumeSpecName: "kube-api-access-5kf87") pod "8894df91-a216-4fa5-8b6f-035846331658" (UID: "8894df91-a216-4fa5-8b6f-035846331658"). InnerVolumeSpecName "kube-api-access-5kf87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:16.386706 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.386674    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-dshm\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:16.386706 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.386702    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8894df91-a216-4fa5-8b6f-035846331658-tls-certs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:16.386706 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.386713    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kf87\" (UniqueName: \"kubernetes.io/projected/8894df91-a216-4fa5-8b6f-035846331658-kube-api-access-5kf87\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:16.386965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.386723    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-model-cache\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:16.386965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.386733    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8894df91-a216-4fa5-8b6f-035846331658-tmp-dir\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:16.905289 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.905251    2555 generic.go:356] "Generic (PLEG): container finished" podID="8894df91-a216-4fa5-8b6f-035846331658" containerID="4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82" exitCode=0
Jul 31 00:54:16.905289 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.905288    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm" event={"ID":"8894df91-a216-4fa5-8b6f-035846331658","Type":"ContainerDied","Data":"4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82"}
Jul 31 00:54:16.905501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.905293    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"
Jul 31 00:54:16.905501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.905327    2555 scope.go:117] "RemoveContainer" containerID="4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82"
Jul 31 00:54:16.905501 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.905316    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm" event={"ID":"8894df91-a216-4fa5-8b6f-035846331658","Type":"ContainerDied","Data":"4b61da3642fde525c4ccd0bcefdf13c09f87ee474658a77996e893481ac99032"}
Jul 31 00:54:16.914220 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.914202    2555 scope.go:117] "RemoveContainer" containerID="4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82"
Jul 31 00:54:16.914464 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:54:16.914446    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82\": container with ID starting with 4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82 not found: ID does not exist" containerID="4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82"
Jul 31 00:54:16.914510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.914473    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82"} err="failed to get container status \"4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82\": rpc error: code = NotFound desc = could not find container \"4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82\": container with ID starting with 4439d22bacbda3f1dec24783d800511baa0335c5d16b3e1d6b75cd3775c44c82 not found: ID does not exist"
Jul 31 00:54:16.923873 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.923853    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"]
Jul 31 00:54:16.927390 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:16.927370    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-0fc38b/test-model-0fc38b-kserve-6c8d689545-l62gm"]
Jul 31 00:54:17.867340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:17.867306    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8894df91-a216-4fa5-8b6f-035846331658" path="/var/lib/kubelet/pods/8894df91-a216-4fa5-8b6f-035846331658/volumes"
Jul 31 00:54:18.563722 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.563679    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"]
Jul 31 00:54:18.564373 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564351    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b42bf7-c468-49e0-ba35-46ec11d1739e" containerName="payload-processing"
Jul 31 00:54:18.564426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564376    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b42bf7-c468-49e0-ba35-46ec11d1739e" containerName="payload-processing"
Jul 31 00:54:18.564426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564391    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8894df91-a216-4fa5-8b6f-035846331658" containerName="main"
Jul 31 00:54:18.564426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564401    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8894df91-a216-4fa5-8b6f-035846331658" containerName="main"
Jul 31 00:54:18.564426 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564417    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b44d4b8f-b64f-498e-bd1d-af6ad84c8485" containerName="revoke-keys"
Jul 31 00:54:18.564552 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564427    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44d4b8f-b64f-498e-bd1d-af6ad84c8485" containerName="revoke-keys"
Jul 31 00:54:18.564552 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564463    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35875a-eafc-4890-bc47-955c5e8ac544" containerName="payload-pre-processing"
Jul 31 00:54:18.564552 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564472    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35875a-eafc-4890-bc47-955c5e8ac544" containerName="payload-pre-processing"
Jul 31 00:54:18.564652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564556    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35875a-eafc-4890-bc47-955c5e8ac544" containerName="payload-pre-processing"
Jul 31 00:54:18.564652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564567    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b44d4b8f-b64f-498e-bd1d-af6ad84c8485" containerName="revoke-keys"
Jul 31 00:54:18.564652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564582    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8894df91-a216-4fa5-8b6f-035846331658" containerName="main"
Jul 31 00:54:18.564652 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.564591    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b42bf7-c468-49e0-ba35-46ec11d1739e" containerName="payload-processing"
Jul 31 00:54:18.569252 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.569231    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:18.571056 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.571031    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:54:18.572322 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.572294    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"]
Jul 31 00:54:18.709311 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.709279    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2442c214-14a6-43be-975f-4e199be57f10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq\" (UID: \"2442c214-14a6-43be-975f-4e199be57f10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:18.810118 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.810085    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2442c214-14a6-43be-975f-4e199be57f10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq\" (UID: \"2442c214-14a6-43be-975f-4e199be57f10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:18.810643 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.810624    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2442c214-14a6-43be-975f-4e199be57f10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq\" (UID: \"2442c214-14a6-43be-975f-4e199be57f10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:18.882339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:18.882266    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:19.020631 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:19.016071    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"]
Jul 31 00:54:19.024808 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:54:19.024778    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2442c214_14a6_43be_975f_4e199be57f10.slice/crio-42d59a54b158ce2c1479c0ebe5ecc5da654cf893b951f34aa7564d74eb5bb8ce WatchSource:0}: Error finding container 42d59a54b158ce2c1479c0ebe5ecc5da654cf893b951f34aa7564d74eb5bb8ce: Status 404 returned error can't find the container with id 42d59a54b158ce2c1479c0ebe5ecc5da654cf893b951f34aa7564d74eb5bb8ce
Jul 31 00:54:19.922105 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:19.922010    2555 generic.go:356] "Generic (PLEG): container finished" podID="2442c214-14a6-43be-975f-4e199be57f10" containerID="2f3af9d0be970509319b5fea05de04675c82be0bfb1461b584d3dce5f3fea685" exitCode=0
Jul 31 00:54:19.922482 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:19.922104    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq" event={"ID":"2442c214-14a6-43be-975f-4e199be57f10","Type":"ContainerDied","Data":"2f3af9d0be970509319b5fea05de04675c82be0bfb1461b584d3dce5f3fea685"}
Jul 31 00:54:19.922482 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:19.922165    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq" event={"ID":"2442c214-14a6-43be-975f-4e199be57f10","Type":"ContainerStarted","Data":"42d59a54b158ce2c1479c0ebe5ecc5da654cf893b951f34aa7564d74eb5bb8ce"}
Jul 31 00:54:21.056565 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.056536    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:21.130370 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.130342    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2442c214-14a6-43be-975f-4e199be57f10-maas-api-service-ca\") pod \"2442c214-14a6-43be-975f-4e199be57f10\" (UID: \"2442c214-14a6-43be-975f-4e199be57f10\") "
Jul 31 00:54:21.130704 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.130682    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2442c214-14a6-43be-975f-4e199be57f10-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2442c214-14a6-43be-975f-4e199be57f10" (UID: "2442c214-14a6-43be-975f-4e199be57f10"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:21.231284 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.231261    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2442c214-14a6-43be-975f-4e199be57f10-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:21.931555 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.931527    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq" event={"ID":"2442c214-14a6-43be-975f-4e199be57f10","Type":"ContainerDied","Data":"42d59a54b158ce2c1479c0ebe5ecc5da654cf893b951f34aa7564d74eb5bb8ce"}
Jul 31 00:54:21.931555 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.931558    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"
Jul 31 00:54:21.931778 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:21.931573    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42d59a54b158ce2c1479c0ebe5ecc5da654cf893b951f34aa7564d74eb5bb8ce"
Jul 31 00:54:29.220158 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.220072    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"]
Jul 31 00:54:29.220728 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.220364    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz" podUID="7b35016e-be48-41b7-a264-b1150fe2c506" containerName="payload-processing" containerID="cri-o://3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81" gracePeriod=30
Jul 31 00:54:29.228704 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.228675    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"]
Jul 31 00:54:29.228963 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.228935    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" podUID="8c26db33-2348-4db9-ba49-7d1faae73791" containerName="payload-pre-processing" containerID="cri-o://13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23" gracePeriod=30
Jul 31 00:54:29.344922 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.344892    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"]
Jul 31 00:54:29.347549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.347305    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0fc38b-brfcq"]
Jul 31 00:54:29.491831 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.491808    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:54:29.510304 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.510282    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:54:29.601942 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.601910    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmthd\" (UniqueName: \"kubernetes.io/projected/8c26db33-2348-4db9-ba49-7d1faae73791-kube-api-access-pmthd\") pod \"8c26db33-2348-4db9-ba49-7d1faae73791\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") "
Jul 31 00:54:29.602087 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.601962    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztqlh\" (UniqueName: \"kubernetes.io/projected/7b35016e-be48-41b7-a264-b1150fe2c506-kube-api-access-ztqlh\") pod \"7b35016e-be48-41b7-a264-b1150fe2c506\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") "
Jul 31 00:54:29.602169 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.602150    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c26db33-2348-4db9-ba49-7d1faae73791-plugins-config-volume\") pod \"8c26db33-2348-4db9-ba49-7d1faae73791\" (UID: \"8c26db33-2348-4db9-ba49-7d1faae73791\") "
Jul 31 00:54:29.602219 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.602184    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b35016e-be48-41b7-a264-b1150fe2c506-plugins-config-volume\") pod \"7b35016e-be48-41b7-a264-b1150fe2c506\" (UID: \"7b35016e-be48-41b7-a264-b1150fe2c506\") "
Jul 31 00:54:29.602559 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.602533    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b35016e-be48-41b7-a264-b1150fe2c506-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b35016e-be48-41b7-a264-b1150fe2c506" (UID: "7b35016e-be48-41b7-a264-b1150fe2c506"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:29.602559 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.602547    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c26db33-2348-4db9-ba49-7d1faae73791-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8c26db33-2348-4db9-ba49-7d1faae73791" (UID: "8c26db33-2348-4db9-ba49-7d1faae73791"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:29.604245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.604221    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c26db33-2348-4db9-ba49-7d1faae73791-kube-api-access-pmthd" (OuterVolumeSpecName: "kube-api-access-pmthd") pod "8c26db33-2348-4db9-ba49-7d1faae73791" (UID: "8c26db33-2348-4db9-ba49-7d1faae73791"). InnerVolumeSpecName "kube-api-access-pmthd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:29.604245 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.604235    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b35016e-be48-41b7-a264-b1150fe2c506-kube-api-access-ztqlh" (OuterVolumeSpecName: "kube-api-access-ztqlh") pod "7b35016e-be48-41b7-a264-b1150fe2c506" (UID: "7b35016e-be48-41b7-a264-b1150fe2c506"). InnerVolumeSpecName "kube-api-access-ztqlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:29.703904 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.703876    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c26db33-2348-4db9-ba49-7d1faae73791-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:29.703904 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.703899    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b35016e-be48-41b7-a264-b1150fe2c506-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:29.703904 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.703907    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmthd\" (UniqueName: \"kubernetes.io/projected/8c26db33-2348-4db9-ba49-7d1faae73791-kube-api-access-pmthd\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:29.704103 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.703918    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztqlh\" (UniqueName: \"kubernetes.io/projected/7b35016e-be48-41b7-a264-b1150fe2c506-kube-api-access-ztqlh\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:54:29.866592 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.866513    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2442c214-14a6-43be-975f-4e199be57f10" path="/var/lib/kubelet/pods/2442c214-14a6-43be-975f-4e199be57f10/volumes"
Jul 31 00:54:29.974716 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.974688    2555 generic.go:356] "Generic (PLEG): container finished" podID="7b35016e-be48-41b7-a264-b1150fe2c506" containerID="3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81" exitCode=0
Jul 31 00:54:29.974906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.974734    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"
Jul 31 00:54:29.974906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.974780    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz" event={"ID":"7b35016e-be48-41b7-a264-b1150fe2c506","Type":"ContainerDied","Data":"3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81"}
Jul 31 00:54:29.974906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.974833    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz" event={"ID":"7b35016e-be48-41b7-a264-b1150fe2c506","Type":"ContainerDied","Data":"6cb9d99e39e866a51f98700c6592efec93b2206281553caceb9d67a0af66a45d"}
Jul 31 00:54:29.974906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.974867    2555 scope.go:117] "RemoveContainer" containerID="3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81"
Jul 31 00:54:29.976249 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.976229    2555 generic.go:356] "Generic (PLEG): container finished" podID="8c26db33-2348-4db9-ba49-7d1faae73791" containerID="13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23" exitCode=0
Jul 31 00:54:29.976361 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.976260    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" event={"ID":"8c26db33-2348-4db9-ba49-7d1faae73791","Type":"ContainerDied","Data":"13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23"}
Jul 31 00:54:29.976361 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.976271    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"
Jul 31 00:54:29.976361 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.976298    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz" event={"ID":"8c26db33-2348-4db9-ba49-7d1faae73791","Type":"ContainerDied","Data":"fe57c9dc0aa4b62c0085559bfba6cb7070702147937811fd68a61ccafcfa2050"}
Jul 31 00:54:29.984381 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.984368    2555 scope.go:117] "RemoveContainer" containerID="3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81"
Jul 31 00:54:29.984608 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:54:29.984593    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81\": container with ID starting with 3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81 not found: ID does not exist" containerID="3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81"
Jul 31 00:54:29.984654 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.984615    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81"} err="failed to get container status \"3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81\": rpc error: code = NotFound desc = could not find container \"3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81\": container with ID starting with 3ba0628eeb5a4ca6304275f70449e7ce52e3b73d1d90f8d988d4cbe850bcca81 not found: ID does not exist"
Jul 31 00:54:29.984654 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.984632    2555 scope.go:117] "RemoveContainer" containerID="13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23"
Jul 31 00:54:29.994816 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.993917    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"]
Jul 31 00:54:29.996321 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.996297    2555 scope.go:117] "RemoveContainer" containerID="13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23"
Jul 31 00:54:29.996636 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:54:29.996612    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23\": container with ID starting with 13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23 not found: ID does not exist" containerID="13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23"
Jul 31 00:54:29.996689 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.996645    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23"} err="failed to get container status \"13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23\": rpc error: code = NotFound desc = could not find container \"13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23\": container with ID starting with 13da50eb78e3c21e4e82614a93fff81a1ae9f4f04f9759967e5673efa5d3db23 not found: ID does not exist"
Jul 31 00:54:29.997649 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:29.997630    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0fc38b-77dbdcc5dd-7fwbz"]
Jul 31 00:54:30.005461 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:30.005442    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"]
Jul 31 00:54:30.009559 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:30.009528    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0fc38b-b7d7dfb8-l7qtz"]
Jul 31 00:54:31.866646 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:31.866609    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b35016e-be48-41b7-a264-b1150fe2c506" path="/var/lib/kubelet/pods/7b35016e-be48-41b7-a264-b1150fe2c506/volumes"
Jul 31 00:54:31.867042 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:31.866978    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c26db33-2348-4db9-ba49-7d1faae73791" path="/var/lib/kubelet/pods/8c26db33-2348-4db9-ba49-7d1faae73791/volumes"
Jul 31 00:54:41.071964 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.071928    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"]
Jul 31 00:54:41.072340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072303    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b35016e-be48-41b7-a264-b1150fe2c506" containerName="payload-processing"
Jul 31 00:54:41.072340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072322    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b35016e-be48-41b7-a264-b1150fe2c506" containerName="payload-processing"
Jul 31 00:54:41.072340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072331    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2442c214-14a6-43be-975f-4e199be57f10" containerName="revoke-keys"
Jul 31 00:54:41.072340 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072337    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2442c214-14a6-43be-975f-4e199be57f10" containerName="revoke-keys"
Jul 31 00:54:41.072477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072353    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c26db33-2348-4db9-ba49-7d1faae73791" containerName="payload-pre-processing"
Jul 31 00:54:41.072477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072359    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c26db33-2348-4db9-ba49-7d1faae73791" containerName="payload-pre-processing"
Jul 31 00:54:41.072477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072417    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b35016e-be48-41b7-a264-b1150fe2c506" containerName="payload-processing"
Jul 31 00:54:41.072477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072426    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c26db33-2348-4db9-ba49-7d1faae73791" containerName="payload-pre-processing"
Jul 31 00:54:41.072477 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.072433    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2442c214-14a6-43be-975f-4e199be57f10" containerName="revoke-keys"
Jul 31 00:54:41.076587 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.076571    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.078260 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.078235    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-943c1a\""
Jul 31 00:54:41.084814 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.084722    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"]
Jul 31 00:54:41.111903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.111874    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58acf132-ce32-42c4-95d2-d25d9c800443-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.112063 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.111937    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9tl\" (UniqueName: \"kubernetes.io/projected/58acf132-ce32-42c4-95d2-d25d9c800443-kube-api-access-kq9tl\") pod \"payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.113702 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.113681    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"]
Jul 31 00:54:41.116952 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.116938    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.119538 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.119512    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-943c1a-dockercfg-bzwz8\""
Jul 31 00:54:41.126051 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.126030    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"]
Jul 31 00:54:41.213296 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.213257    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58acf132-ce32-42c4-95d2-d25d9c800443-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.213296 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.213303    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xls66\" (UniqueName: \"kubernetes.io/projected/a3ccc490-4c61-4c37-8934-a60fd272332c-kube-api-access-xls66\") pod \"payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") " pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.213558 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.213428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9tl\" (UniqueName: \"kubernetes.io/projected/58acf132-ce32-42c4-95d2-d25d9c800443-kube-api-access-kq9tl\") pod \"payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.213558 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.213506    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ccc490-4c61-4c37-8934-a60fd272332c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") " pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.214075 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.214052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58acf132-ce32-42c4-95d2-d25d9c800443-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.223104 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.223086    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9tl\" (UniqueName: \"kubernetes.io/projected/58acf132-ce32-42c4-95d2-d25d9c800443-kube-api-access-kq9tl\") pod \"payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.314662 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.314626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ccc490-4c61-4c37-8934-a60fd272332c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") " pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.314840 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.314745    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xls66\" (UniqueName: \"kubernetes.io/projected/a3ccc490-4c61-4c37-8934-a60fd272332c-kube-api-access-xls66\") pod \"payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") " pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.315362 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.315339    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ccc490-4c61-4c37-8934-a60fd272332c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") " pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.321712 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.321680    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xls66\" (UniqueName: \"kubernetes.io/projected/a3ccc490-4c61-4c37-8934-a60fd272332c-kube-api-access-xls66\") pod \"payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") " pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.389677 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.389600    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:41.426696 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.426663    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:41.535300 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.535273    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"]
Jul 31 00:54:41.537859 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:54:41.537824    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58acf132_ce32_42c4_95d2_d25d9c800443.slice/crio-a98a10b2ff2a8ac87adb35274b1153437908f1a40006e80891d1b27adebfe671 WatchSource:0}: Error finding container a98a10b2ff2a8ac87adb35274b1153437908f1a40006e80891d1b27adebfe671: Status 404 returned error can't find the container with id a98a10b2ff2a8ac87adb35274b1153437908f1a40006e80891d1b27adebfe671
Jul 31 00:54:41.779864 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:41.779831    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"]
Jul 31 00:54:41.782488 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:54:41.782457    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ccc490_4c61_4c37_8934_a60fd272332c.slice/crio-65e915ce2cfcee4c7c8a634136a34eccfff4b7698c40b0bc4a1959674f347341 WatchSource:0}: Error finding container 65e915ce2cfcee4c7c8a634136a34eccfff4b7698c40b0bc4a1959674f347341: Status 404 returned error can't find the container with id 65e915ce2cfcee4c7c8a634136a34eccfff4b7698c40b0bc4a1959674f347341
Jul 31 00:54:42.035357 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.035264    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p" event={"ID":"a3ccc490-4c61-4c37-8934-a60fd272332c","Type":"ContainerStarted","Data":"009a5bd1b09841e26703af1c55745d2d78353be17ac45c4d9f0897e94898f682"}
Jul 31 00:54:42.035357 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.035329    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p" event={"ID":"a3ccc490-4c61-4c37-8934-a60fd272332c","Type":"ContainerStarted","Data":"65e915ce2cfcee4c7c8a634136a34eccfff4b7698c40b0bc4a1959674f347341"}
Jul 31 00:54:42.035577 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.035466    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:54:42.037196 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.037168    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58" event={"ID":"58acf132-ce32-42c4-95d2-d25d9c800443","Type":"ContainerStarted","Data":"db244a398026daa7df260a5c56809b8dc424678c23f7b95712aca5250e90a3a5"}
Jul 31 00:54:42.037344 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.037210    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58" event={"ID":"58acf132-ce32-42c4-95d2-d25d9c800443","Type":"ContainerStarted","Data":"a98a10b2ff2a8ac87adb35274b1153437908f1a40006e80891d1b27adebfe671"}
Jul 31 00:54:42.037344 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.037309    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:42.049360 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.049314    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p" podStartSLOduration=1.049296597 podStartE2EDuration="1.049296597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:54:42.048181324 +0000 UTC m=+2886.772147294" watchObservedRunningTime="2026-07-31 00:54:42.049296597 +0000 UTC m=+2886.773262566"
Jul 31 00:54:42.062529 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:42.062485    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58" podStartSLOduration=1.062470746 podStartE2EDuration="1.062470746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:54:42.060668458 +0000 UTC m=+2886.784634447" watchObservedRunningTime="2026-07-31 00:54:42.062470746 +0000 UTC m=+2886.786436713"
Jul 31 00:54:53.050204 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:53.050177    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:54:53.050596 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:54:53.050253    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:55:09.420566 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.420534    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"]
Jul 31 00:55:09.424149 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.424133    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.426222 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.426201    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-53f734-dockercfg-qq5w9\""
Jul 31 00:55:09.426321 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.426262    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-53f734\""
Jul 31 00:55:09.429883 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.429860    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"]
Jul 31 00:55:09.545906 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.545870    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"]
Jul 31 00:55:09.549255 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.549237    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.556041 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.556015    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8812a31a-e44d-452d-9944-fcf92a14c211-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.556170 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.556067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwg7\" (UniqueName: \"kubernetes.io/projected/8812a31a-e44d-452d-9944-fcf92a14c211-kube-api-access-wjwg7\") pod \"payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.557510 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.557490    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"]
Jul 31 00:55:09.656996 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.656968    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-plugins-config-volume\") pod \"payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") " pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.656996 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.656996    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p57h\" (UniqueName: \"kubernetes.io/projected/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-kube-api-access-4p57h\") pod \"payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") " pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.657235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.657059    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8812a31a-e44d-452d-9944-fcf92a14c211-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.657235 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.657086    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwg7\" (UniqueName: \"kubernetes.io/projected/8812a31a-e44d-452d-9944-fcf92a14c211-kube-api-access-wjwg7\") pod \"payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.657801 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.657782    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8812a31a-e44d-452d-9944-fcf92a14c211-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.665350 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.665320    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwg7\" (UniqueName: \"kubernetes.io/projected/8812a31a-e44d-452d-9944-fcf92a14c211-kube-api-access-wjwg7\") pod \"payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.737366 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.737341    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:09.757706 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.757680    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-plugins-config-volume\") pod \"payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") " pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.757858 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.757720    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p57h\" (UniqueName: \"kubernetes.io/projected/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-kube-api-access-4p57h\") pod \"payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") " pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.758641 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.758617    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-plugins-config-volume\") pod \"payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") " pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.765014 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.764996    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p57h\" (UniqueName: \"kubernetes.io/projected/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-kube-api-access-4p57h\") pod \"payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") " pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.860859 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.860830    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:09.880210 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:09.880167    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"]
Jul 31 00:55:09.882054 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:55:09.882026    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8812a31a_e44d_452d_9944_fcf92a14c211.slice/crio-40b8f7a027d3534372aebdbab99c97b6c9f4157590928fadd07d12de1406e0da WatchSource:0}: Error finding container 40b8f7a027d3534372aebdbab99c97b6c9f4157590928fadd07d12de1406e0da: Status 404 returned error can't find the container with id 40b8f7a027d3534372aebdbab99c97b6c9f4157590928fadd07d12de1406e0da
Jul 31 00:55:10.002332 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.002306    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"]
Jul 31 00:55:10.004539 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:55:10.004507    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ba8c88_5a0e_4441_ac9a_b3d3b9b7b145.slice/crio-12b33bbd47c837e3740fb2f9ef456167754d3e7aa120342db328d4dad2272c34 WatchSource:0}: Error finding container 12b33bbd47c837e3740fb2f9ef456167754d3e7aa120342db328d4dad2272c34: Status 404 returned error can't find the container with id 12b33bbd47c837e3740fb2f9ef456167754d3e7aa120342db328d4dad2272c34
Jul 31 00:55:10.179865 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.179830    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv" event={"ID":"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145","Type":"ContainerStarted","Data":"69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962"}
Jul 31 00:55:10.180047 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.179889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv" event={"ID":"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145","Type":"ContainerStarted","Data":"12b33bbd47c837e3740fb2f9ef456167754d3e7aa120342db328d4dad2272c34"}
Jul 31 00:55:10.180047 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.179923    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:10.181558 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.181530    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw" event={"ID":"8812a31a-e44d-452d-9944-fcf92a14c211","Type":"ContainerStarted","Data":"16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856"}
Jul 31 00:55:10.181692 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.181574    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw" event={"ID":"8812a31a-e44d-452d-9944-fcf92a14c211","Type":"ContainerStarted","Data":"40b8f7a027d3534372aebdbab99c97b6c9f4157590928fadd07d12de1406e0da"}
Jul 31 00:55:10.181692 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.181621    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:10.194579 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.194533    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv" podStartSLOduration=1.194517486 podStartE2EDuration="1.194517486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:55:10.192300994 +0000 UTC m=+2914.916266966" watchObservedRunningTime="2026-07-31 00:55:10.194517486 +0000 UTC m=+2914.918483431"
Jul 31 00:55:10.205698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:10.205655    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw" podStartSLOduration=1.205642512 podStartE2EDuration="1.205642512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:55:10.204589531 +0000 UTC m=+2914.928555499" watchObservedRunningTime="2026-07-31 00:55:10.205642512 +0000 UTC m=+2914.929608478"
Jul 31 00:55:21.189194 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:21.189161    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:55:21.189659 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:21.189345    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:55:56.271127 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.271042    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"]
Jul 31 00:55:56.271621 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.271289    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p" podUID="a3ccc490-4c61-4c37-8934-a60fd272332c" containerName="payload-processing" containerID="cri-o://009a5bd1b09841e26703af1c55745d2d78353be17ac45c4d9f0897e94898f682" gracePeriod=30
Jul 31 00:55:56.280446 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.280414    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"]
Jul 31 00:55:56.280716 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.280660    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58" podUID="58acf132-ce32-42c4-95d2-d25d9c800443" containerName="payload-pre-processing" containerID="cri-o://db244a398026daa7df260a5c56809b8dc424678c23f7b95712aca5250e90a3a5" gracePeriod=30
Jul 31 00:55:56.401727 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.401690    2555 generic.go:356] "Generic (PLEG): container finished" podID="a3ccc490-4c61-4c37-8934-a60fd272332c" containerID="009a5bd1b09841e26703af1c55745d2d78353be17ac45c4d9f0897e94898f682" exitCode=0
Jul 31 00:55:56.401878 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.401748    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p" event={"ID":"a3ccc490-4c61-4c37-8934-a60fd272332c","Type":"ContainerDied","Data":"009a5bd1b09841e26703af1c55745d2d78353be17ac45c4d9f0897e94898f682"}
Jul 31 00:55:56.403698 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.403671    2555 generic.go:356] "Generic (PLEG): container finished" podID="58acf132-ce32-42c4-95d2-d25d9c800443" containerID="db244a398026daa7df260a5c56809b8dc424678c23f7b95712aca5250e90a3a5" exitCode=0
Jul 31 00:55:56.403818 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.403710    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58" event={"ID":"58acf132-ce32-42c4-95d2-d25d9c800443","Type":"ContainerDied","Data":"db244a398026daa7df260a5c56809b8dc424678c23f7b95712aca5250e90a3a5"}
Jul 31 00:55:56.525335 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.525282    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:55:56.555123 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.555097    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:55:56.670296 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.670266    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9tl\" (UniqueName: \"kubernetes.io/projected/58acf132-ce32-42c4-95d2-d25d9c800443-kube-api-access-kq9tl\") pod \"58acf132-ce32-42c4-95d2-d25d9c800443\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") "
Jul 31 00:55:56.670473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.670336    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58acf132-ce32-42c4-95d2-d25d9c800443-plugins-config-volume\") pod \"58acf132-ce32-42c4-95d2-d25d9c800443\" (UID: \"58acf132-ce32-42c4-95d2-d25d9c800443\") "
Jul 31 00:55:56.670473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.670378    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ccc490-4c61-4c37-8934-a60fd272332c-plugins-config-volume\") pod \"a3ccc490-4c61-4c37-8934-a60fd272332c\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") "
Jul 31 00:55:56.670473 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.670421    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xls66\" (UniqueName: \"kubernetes.io/projected/a3ccc490-4c61-4c37-8934-a60fd272332c-kube-api-access-xls66\") pod \"a3ccc490-4c61-4c37-8934-a60fd272332c\" (UID: \"a3ccc490-4c61-4c37-8934-a60fd272332c\") "
Jul 31 00:55:56.670734 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.670699    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3ccc490-4c61-4c37-8934-a60fd272332c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3ccc490-4c61-4c37-8934-a60fd272332c" (UID: "a3ccc490-4c61-4c37-8934-a60fd272332c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:55:56.670873 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.670803    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58acf132-ce32-42c4-95d2-d25d9c800443-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58acf132-ce32-42c4-95d2-d25d9c800443" (UID: "58acf132-ce32-42c4-95d2-d25d9c800443"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:55:56.672653 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.672634    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3ccc490-4c61-4c37-8934-a60fd272332c-kube-api-access-xls66" (OuterVolumeSpecName: "kube-api-access-xls66") pod "a3ccc490-4c61-4c37-8934-a60fd272332c" (UID: "a3ccc490-4c61-4c37-8934-a60fd272332c"). InnerVolumeSpecName "kube-api-access-xls66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:55:56.672744 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.672715    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58acf132-ce32-42c4-95d2-d25d9c800443-kube-api-access-kq9tl" (OuterVolumeSpecName: "kube-api-access-kq9tl") pod "58acf132-ce32-42c4-95d2-d25d9c800443" (UID: "58acf132-ce32-42c4-95d2-d25d9c800443"). InnerVolumeSpecName "kube-api-access-kq9tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:55:56.771230 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.771201    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9tl\" (UniqueName: \"kubernetes.io/projected/58acf132-ce32-42c4-95d2-d25d9c800443-kube-api-access-kq9tl\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:55:56.771230 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.771224    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58acf132-ce32-42c4-95d2-d25d9c800443-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:55:56.771230 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.771235    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ccc490-4c61-4c37-8934-a60fd272332c-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:55:56.771424 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:56.771243    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xls66\" (UniqueName: \"kubernetes.io/projected/a3ccc490-4c61-4c37-8934-a60fd272332c-kube-api-access-xls66\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:55:57.409464 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.409433    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"
Jul 31 00:55:57.409971 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.409432    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p" event={"ID":"a3ccc490-4c61-4c37-8934-a60fd272332c","Type":"ContainerDied","Data":"65e915ce2cfcee4c7c8a634136a34eccfff4b7698c40b0bc4a1959674f347341"}
Jul 31 00:55:57.409971 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.409566    2555 scope.go:117] "RemoveContainer" containerID="009a5bd1b09841e26703af1c55745d2d78353be17ac45c4d9f0897e94898f682"
Jul 31 00:55:57.411031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.410834    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"
Jul 31 00:55:57.411031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.410856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58" event={"ID":"58acf132-ce32-42c4-95d2-d25d9c800443","Type":"ContainerDied","Data":"a98a10b2ff2a8ac87adb35274b1153437908f1a40006e80891d1b27adebfe671"}
Jul 31 00:55:57.418822 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.418786    2555 scope.go:117] "RemoveContainer" containerID="db244a398026daa7df260a5c56809b8dc424678c23f7b95712aca5250e90a3a5"
Jul 31 00:55:57.430070 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.430048    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"]
Jul 31 00:55:57.433874 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.433856    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-943c1a-5598b959bb-hvw5p"]
Jul 31 00:55:57.441081 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.441060    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"]
Jul 31 00:55:57.443498 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.443479    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-943c1a-9bfc5967b-57n58"]
Jul 31 00:55:57.867401 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.867369    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58acf132-ce32-42c4-95d2-d25d9c800443" path="/var/lib/kubelet/pods/58acf132-ce32-42c4-95d2-d25d9c800443/volumes"
Jul 31 00:55:57.867723 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:55:57.867711    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3ccc490-4c61-4c37-8934-a60fd272332c" path="/var/lib/kubelet/pods/a3ccc490-4c61-4c37-8934-a60fd272332c/volumes"
Jul 31 00:56:03.256046 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256010    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"]
Jul 31 00:56:03.256549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256393    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58acf132-ce32-42c4-95d2-d25d9c800443" containerName="payload-pre-processing"
Jul 31 00:56:03.256549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256405    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="58acf132-ce32-42c4-95d2-d25d9c800443" containerName="payload-pre-processing"
Jul 31 00:56:03.256549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256420    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3ccc490-4c61-4c37-8934-a60fd272332c" containerName="payload-processing"
Jul 31 00:56:03.256549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256425    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3ccc490-4c61-4c37-8934-a60fd272332c" containerName="payload-processing"
Jul 31 00:56:03.256549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256507    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3ccc490-4c61-4c37-8934-a60fd272332c" containerName="payload-processing"
Jul 31 00:56:03.256549 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.256514    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="58acf132-ce32-42c4-95d2-d25d9c800443" containerName="payload-pre-processing"
Jul 31 00:56:03.261498 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.261476    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:03.263626 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.263605    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:56:03.265278 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.265255    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"]
Jul 31 00:56:03.330682 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.330658    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8053a55d-2dcf-4fdf-8fd7-71ee65f48541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-53f734-2xrkr\" (UID: \"8053a55d-2dcf-4fdf-8fd7-71ee65f48541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:03.431599 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.431561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8053a55d-2dcf-4fdf-8fd7-71ee65f48541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-53f734-2xrkr\" (UID: \"8053a55d-2dcf-4fdf-8fd7-71ee65f48541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:03.432253 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.432229    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8053a55d-2dcf-4fdf-8fd7-71ee65f48541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-53f734-2xrkr\" (UID: \"8053a55d-2dcf-4fdf-8fd7-71ee65f48541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:03.573903 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.573830    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:03.707260 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:03.707227    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"]
Jul 31 00:56:03.712027 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:56:03.712002    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8053a55d_2dcf_4fdf_8fd7_71ee65f48541.slice/crio-24325e220a09bc32e4033876b2de6f87b5f8c9586e9d96bc47fd8b42c69aaf3b WatchSource:0}: Error finding container 24325e220a09bc32e4033876b2de6f87b5f8c9586e9d96bc47fd8b42c69aaf3b: Status 404 returned error can't find the container with id 24325e220a09bc32e4033876b2de6f87b5f8c9586e9d96bc47fd8b42c69aaf3b
Jul 31 00:56:04.451469 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:04.451288    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr" event={"ID":"8053a55d-2dcf-4fdf-8fd7-71ee65f48541","Type":"ContainerStarted","Data":"9bbd77236c4cddfead88ff60e31f883595723eb47acddad38fb5143ed17a5b3d"}
Jul 31 00:56:04.451469 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:04.451347    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr" event={"ID":"8053a55d-2dcf-4fdf-8fd7-71ee65f48541","Type":"ContainerStarted","Data":"24325e220a09bc32e4033876b2de6f87b5f8c9586e9d96bc47fd8b42c69aaf3b"}
Jul 31 00:56:04.466746 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:04.466703    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr" podStartSLOduration=1.46668949 podStartE2EDuration="1.46668949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:56:04.464395038 +0000 UTC m=+2969.188361018" watchObservedRunningTime="2026-07-31 00:56:04.46668949 +0000 UTC m=+2969.190655495"
Jul 31 00:56:04.488721 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:56:04.488695    2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8053a55d_2dcf_4fdf_8fd7_71ee65f48541.slice/crio-9bbd77236c4cddfead88ff60e31f883595723eb47acddad38fb5143ed17a5b3d.scope\": RecentStats: unable to find data in memory cache]"
Jul 31 00:56:05.458861 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:05.458828    2555 generic.go:356] "Generic (PLEG): container finished" podID="8053a55d-2dcf-4fdf-8fd7-71ee65f48541" containerID="9bbd77236c4cddfead88ff60e31f883595723eb47acddad38fb5143ed17a5b3d" exitCode=0
Jul 31 00:56:05.459238 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:05.458872    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr" event={"ID":"8053a55d-2dcf-4fdf-8fd7-71ee65f48541","Type":"ContainerDied","Data":"9bbd77236c4cddfead88ff60e31f883595723eb47acddad38fb5143ed17a5b3d"}
Jul 31 00:56:06.592892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:06.592868    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:06.653216 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:06.653190    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8053a55d-2dcf-4fdf-8fd7-71ee65f48541-maas-api-service-ca\") pod \"8053a55d-2dcf-4fdf-8fd7-71ee65f48541\" (UID: \"8053a55d-2dcf-4fdf-8fd7-71ee65f48541\") "
Jul 31 00:56:06.653496 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:06.653476    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8053a55d-2dcf-4fdf-8fd7-71ee65f48541-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8053a55d-2dcf-4fdf-8fd7-71ee65f48541" (UID: "8053a55d-2dcf-4fdf-8fd7-71ee65f48541"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:56:06.754515 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:06.754455    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8053a55d-2dcf-4fdf-8fd7-71ee65f48541-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:56:07.469502 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:07.469468    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"
Jul 31 00:56:07.469502 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:07.469478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr" event={"ID":"8053a55d-2dcf-4fdf-8fd7-71ee65f48541","Type":"ContainerDied","Data":"24325e220a09bc32e4033876b2de6f87b5f8c9586e9d96bc47fd8b42c69aaf3b"}
Jul 31 00:56:07.469677 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:07.469522    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24325e220a09bc32e4033876b2de6f87b5f8c9586e9d96bc47fd8b42c69aaf3b"
Jul 31 00:56:18.855188 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:18.855151    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"]
Jul 31 00:56:18.855617 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:18.855427    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv" podUID="35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" containerName="payload-processing" containerID="cri-o://69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962" gracePeriod=30
Jul 31 00:56:18.860645 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:18.860608    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"]
Jul 31 00:56:18.860877 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:18.860843    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw" podUID="8812a31a-e44d-452d-9944-fcf92a14c211" containerName="payload-pre-processing" containerID="cri-o://16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856" gracePeriod=30
Jul 31 00:56:18.985199 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:18.985157    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"]
Jul 31 00:56:18.987971 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:18.987947    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-53f734-2xrkr"]
Jul 31 00:56:19.134551 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.134528    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:56:19.137277 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.137259    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:56:19.147068 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147046    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8812a31a-e44d-452d-9944-fcf92a14c211-plugins-config-volume\") pod \"8812a31a-e44d-452d-9944-fcf92a14c211\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") "
Jul 31 00:56:19.147148 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147100    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p57h\" (UniqueName: \"kubernetes.io/projected/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-kube-api-access-4p57h\") pod \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") "
Jul 31 00:56:19.147188 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147156    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-plugins-config-volume\") pod \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\" (UID: \"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145\") "
Jul 31 00:56:19.147258 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147242    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjwg7\" (UniqueName: \"kubernetes.io/projected/8812a31a-e44d-452d-9944-fcf92a14c211-kube-api-access-wjwg7\") pod \"8812a31a-e44d-452d-9944-fcf92a14c211\" (UID: \"8812a31a-e44d-452d-9944-fcf92a14c211\") "
Jul 31 00:56:19.147463 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147436    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8812a31a-e44d-452d-9944-fcf92a14c211-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8812a31a-e44d-452d-9944-fcf92a14c211" (UID: "8812a31a-e44d-452d-9944-fcf92a14c211"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:56:19.147544 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147513    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" (UID: "35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:56:19.147544 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.147531    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8812a31a-e44d-452d-9944-fcf92a14c211-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.149690 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.149664    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-kube-api-access-4p57h" (OuterVolumeSpecName: "kube-api-access-4p57h") pod "35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" (UID: "35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145"). InnerVolumeSpecName "kube-api-access-4p57h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:56:19.149793 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.149667    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8812a31a-e44d-452d-9944-fcf92a14c211-kube-api-access-wjwg7" (OuterVolumeSpecName: "kube-api-access-wjwg7") pod "8812a31a-e44d-452d-9944-fcf92a14c211" (UID: "8812a31a-e44d-452d-9944-fcf92a14c211"). InnerVolumeSpecName "kube-api-access-wjwg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:56:19.248392 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.248361    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.248392 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.248392    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjwg7\" (UniqueName: \"kubernetes.io/projected/8812a31a-e44d-452d-9944-fcf92a14c211-kube-api-access-wjwg7\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.248392 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.248401    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p57h\" (UniqueName: \"kubernetes.io/projected/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145-kube-api-access-4p57h\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.527842 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.527807    2555 generic.go:356] "Generic (PLEG): container finished" podID="35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" containerID="69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962" exitCode=0
Jul 31 00:56:19.528016 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.527862    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"
Jul 31 00:56:19.528016 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.527900    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv" event={"ID":"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145","Type":"ContainerDied","Data":"69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962"}
Jul 31 00:56:19.528016 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.528002    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv" event={"ID":"35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145","Type":"ContainerDied","Data":"12b33bbd47c837e3740fb2f9ef456167754d3e7aa120342db328d4dad2272c34"}
Jul 31 00:56:19.528149 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.528039    2555 scope.go:117] "RemoveContainer" containerID="69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962"
Jul 31 00:56:19.529440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.529262    2555 generic.go:356] "Generic (PLEG): container finished" podID="8812a31a-e44d-452d-9944-fcf92a14c211" containerID="16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856" exitCode=0
Jul 31 00:56:19.529440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.529330    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"
Jul 31 00:56:19.529440 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.529332    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw" event={"ID":"8812a31a-e44d-452d-9944-fcf92a14c211","Type":"ContainerDied","Data":"16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856"}
Jul 31 00:56:19.529640 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.529444    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw" event={"ID":"8812a31a-e44d-452d-9944-fcf92a14c211","Type":"ContainerDied","Data":"40b8f7a027d3534372aebdbab99c97b6c9f4157590928fadd07d12de1406e0da"}
Jul 31 00:56:19.539575 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.539495    2555 scope.go:117] "RemoveContainer" containerID="69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962"
Jul 31 00:56:19.539803 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:56:19.539775    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962\": container with ID starting with 69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962 not found: ID does not exist" containerID="69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962"
Jul 31 00:56:19.539893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.539816    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962"} err="failed to get container status \"69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962\": rpc error: code = NotFound desc = could not find container \"69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962\": container with ID starting with 69c28b8e5633c5328844c4c776cf0d404d833d0b6c36a93e704aa677b497e962 not found: ID does not exist"
Jul 31 00:56:19.539893 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.539834    2555 scope.go:117] "RemoveContainer" containerID="16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856"
Jul 31 00:56:19.547645 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.547627    2555 scope.go:117] "RemoveContainer" containerID="16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856"
Jul 31 00:56:19.547958 ip-10-0-129-35 kubenswrapper[2555]: E0731 00:56:19.547940    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856\": container with ID starting with 16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856 not found: ID does not exist" containerID="16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856"
Jul 31 00:56:19.548001 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.547966    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856"} err="failed to get container status \"16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856\": rpc error: code = NotFound desc = could not find container \"16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856\": container with ID starting with 16e68e9e70a3719208716474e029a07a96caa66a55cdc153f833a219ea04a856 not found: ID does not exist"
Jul 31 00:56:19.551232 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.551213    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"]
Jul 31 00:56:19.554564 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.554548    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-53f734-859fb885bb-fdfxv"]
Jul 31 00:56:19.562685 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.562660    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"]
Jul 31 00:56:19.564618 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.564599    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-53f734-54794fb4b8-vfnmw"]
Jul 31 00:56:19.866682 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.866605    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" path="/var/lib/kubelet/pods/35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145/volumes"
Jul 31 00:56:19.867031 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.866961    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8053a55d-2dcf-4fdf-8fd7-71ee65f48541" path="/var/lib/kubelet/pods/8053a55d-2dcf-4fdf-8fd7-71ee65f48541/volumes"
Jul 31 00:56:19.867267 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:19.867254    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8812a31a-e44d-452d-9944-fcf92a14c211" path="/var/lib/kubelet/pods/8812a31a-e44d-452d-9944-fcf92a14c211/volumes"
Jul 31 00:56:30.595747 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.595715    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"]
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596092    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" containerName="payload-processing"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596105    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" containerName="payload-processing"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596120    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8053a55d-2dcf-4fdf-8fd7-71ee65f48541" containerName="revoke-keys"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596127    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8053a55d-2dcf-4fdf-8fd7-71ee65f48541" containerName="revoke-keys"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596143    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8812a31a-e44d-452d-9944-fcf92a14c211" containerName="payload-pre-processing"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596149    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8812a31a-e44d-452d-9944-fcf92a14c211" containerName="payload-pre-processing"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596204    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8053a55d-2dcf-4fdf-8fd7-71ee65f48541" containerName="revoke-keys"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596217    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8812a31a-e44d-452d-9944-fcf92a14c211" containerName="payload-pre-processing"
Jul 31 00:56:30.596236 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.596227    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="35ba8c88-5a0e-4441-ac9a-b3d3b9b7b145" containerName="payload-processing"
Jul 31 00:56:30.600892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.600867    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.603485 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.603465    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-6a2164-dockercfg-25z7t\""
Jul 31 00:56:30.603791 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.603771    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-6a2164\""
Jul 31 00:56:30.611051 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.611027    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"]
Jul 31 00:56:30.612666 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.612643    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"]
Jul 31 00:56:30.616176 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.616159    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.625519 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.625498    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"]
Jul 31 00:56:30.641892 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.641869    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmb6n\" (UniqueName: \"kubernetes.io/projected/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-kube-api-access-gmb6n\") pod \"payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.641983 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.641920    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.642025 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.641987    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682kl\" (UniqueName: \"kubernetes.io/projected/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-kube-api-access-682kl\") pod \"payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.642061 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.642022    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.742918 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.742881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682kl\" (UniqueName: \"kubernetes.io/projected/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-kube-api-access-682kl\") pod \"payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.743101 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.742955    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.743101 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.742999    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmb6n\" (UniqueName: \"kubernetes.io/projected/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-kube-api-access-gmb6n\") pod \"payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.743101 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.743069    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.744513 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.744483    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.744635 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.744551    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.751342 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.751307    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmb6n\" (UniqueName: \"kubernetes.io/projected/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-kube-api-access-gmb6n\") pod \"payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.755986 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.755962    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-682kl\" (UniqueName: \"kubernetes.io/projected/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-kube-api-access-682kl\") pod \"payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:30.911937 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.911851    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:30.926303 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:30.926277    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:31.062697 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.062655    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"]
Jul 31 00:56:31.065539 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:56:31.065516    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cceb1e7_6e7e_4ba5_af21_b9c65609a132.slice/crio-20b944bbf2e2f9d5bfcbe97c9d252330b780d86d19478a243a4e9fc0895a81cc WatchSource:0}: Error finding container 20b944bbf2e2f9d5bfcbe97c9d252330b780d86d19478a243a4e9fc0895a81cc: Status 404 returned error can't find the container with id 20b944bbf2e2f9d5bfcbe97c9d252330b780d86d19478a243a4e9fc0895a81cc
Jul 31 00:56:31.087151 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.087122    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"]
Jul 31 00:56:31.088668 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:56:31.088646    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4039ab_9b8e_4549_ad0d_5b42c69bfb40.slice/crio-954fcd4ea9939748ac057797be6d273a9bf61f5a25ac77e4f436e273851aaf3e WatchSource:0}: Error finding container 954fcd4ea9939748ac057797be6d273a9bf61f5a25ac77e4f436e273851aaf3e: Status 404 returned error can't find the container with id 954fcd4ea9939748ac057797be6d273a9bf61f5a25ac77e4f436e273851aaf3e
Jul 31 00:56:31.587611 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.587571    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b" event={"ID":"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40","Type":"ContainerStarted","Data":"55fb4f7c57bba6004e5dbcdd155ed4714d80c02e52beb14ff35c30fbfb8007aa"}
Jul 31 00:56:31.587829 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.587623    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b" event={"ID":"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40","Type":"ContainerStarted","Data":"954fcd4ea9939748ac057797be6d273a9bf61f5a25ac77e4f436e273851aaf3e"}
Jul 31 00:56:31.587829 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.587698    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:31.589072 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.589045    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j" event={"ID":"2cceb1e7-6e7e-4ba5-af21-b9c65609a132","Type":"ContainerStarted","Data":"089c6932132b31fe7cb5465eac30c6ec1479612140e0bbe14ade3ecbd0fd2b73"}
Jul 31 00:56:31.589128 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.589089    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j" event={"ID":"2cceb1e7-6e7e-4ba5-af21-b9c65609a132","Type":"ContainerStarted","Data":"20b944bbf2e2f9d5bfcbe97c9d252330b780d86d19478a243a4e9fc0895a81cc"}
Jul 31 00:56:31.589185 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.589131    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:31.601948 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.601906    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b" podStartSLOduration=1.60189195 podStartE2EDuration="1.60189195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:56:31.600574666 +0000 UTC m=+2996.324540635" watchObservedRunningTime="2026-07-31 00:56:31.60189195 +0000 UTC m=+2996.325857917"
Jul 31 00:56:31.613675 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:31.613640    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j" podStartSLOduration=1.613628412 podStartE2EDuration="1.613628412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:56:31.612740085 +0000 UTC m=+2996.336706052" watchObservedRunningTime="2026-07-31 00:56:31.613628412 +0000 UTC m=+2996.337594379"
Jul 31 00:56:42.596329 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:42.596297    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 00:56:42.596729 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:42.596454    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 00:56:59.029226 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.029187    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"]
Jul 31 00:56:59.032865 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.032840    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.034779 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.034737    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-b32567\""
Jul 31 00:56:59.034889 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.034811    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-b32567-dockercfg-mrs6x\""
Jul 31 00:56:59.046700 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.046678    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"]
Jul 31 00:56:59.067400 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.067380    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"]
Jul 31 00:56:59.070644 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.070627    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.080800 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.080781    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"]
Jul 31 00:56:59.190977 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.190943    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnmmr\" (UniqueName: \"kubernetes.io/projected/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-kube-api-access-gnmmr\") pod \"payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.191134 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.191036    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.191134 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.191099    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aeaf114f-0830-4519-adf2-07b9bd5192df-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") " pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.191134 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.191130    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6n5\" (UniqueName: \"kubernetes.io/projected/aeaf114f-0830-4519-adf2-07b9bd5192df-kube-api-access-df6n5\") pod \"payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") " pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.292557 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.292485    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.292714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.292585    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aeaf114f-0830-4519-adf2-07b9bd5192df-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") " pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.292714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.292616    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6n5\" (UniqueName: \"kubernetes.io/projected/aeaf114f-0830-4519-adf2-07b9bd5192df-kube-api-access-df6n5\") pod \"payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") " pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.292714 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.292650    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnmmr\" (UniqueName: \"kubernetes.io/projected/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-kube-api-access-gnmmr\") pod \"payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.293339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.293316    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aeaf114f-0830-4519-adf2-07b9bd5192df-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") " pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.293339 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.293335    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.299657 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.299625    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6n5\" (UniqueName: \"kubernetes.io/projected/aeaf114f-0830-4519-adf2-07b9bd5192df-kube-api-access-df6n5\") pod \"payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") " pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.299816 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.299798    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnmmr\" (UniqueName: \"kubernetes.io/projected/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-kube-api-access-gnmmr\") pod \"payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.342361 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.342324    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:56:59.380499 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.380471    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.522495 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.522466    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"]
Jul 31 00:56:59.524525 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:56:59.524499    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeaf114f_0830_4519_adf2_07b9bd5192df.slice/crio-99329d37f33c898ce11ff30e6ab9ec93fdb5e1087ab5ae70c04a4eca189585ec WatchSource:0}: Error finding container 99329d37f33c898ce11ff30e6ab9ec93fdb5e1087ab5ae70c04a4eca189585ec: Status 404 returned error can't find the container with id 99329d37f33c898ce11ff30e6ab9ec93fdb5e1087ab5ae70c04a4eca189585ec
Jul 31 00:56:59.698413 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.698379    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"]
Jul 31 00:56:59.701289 ip-10-0-129-35 kubenswrapper[2555]: W0731 00:56:59.701264    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e65e868_e85f_4e2f_b5d6_651a1d4d540d.slice/crio-2164755ef56794afb26f54c7a2c3a56dbc1ccdfdf8ca093241adef70b3e61951 WatchSource:0}: Error finding container 2164755ef56794afb26f54c7a2c3a56dbc1ccdfdf8ca093241adef70b3e61951: Status 404 returned error can't find the container with id 2164755ef56794afb26f54c7a2c3a56dbc1ccdfdf8ca093241adef70b3e61951
Jul 31 00:56:59.733997 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.733966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv" event={"ID":"aeaf114f-0830-4519-adf2-07b9bd5192df","Type":"ContainerStarted","Data":"5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3"}
Jul 31 00:56:59.734145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.734059    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv" event={"ID":"aeaf114f-0830-4519-adf2-07b9bd5192df","Type":"ContainerStarted","Data":"99329d37f33c898ce11ff30e6ab9ec93fdb5e1087ab5ae70c04a4eca189585ec"}
Jul 31 00:56:59.734145 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.734092    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:56:59.735401 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.735372    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77" event={"ID":"3e65e868-e85f-4e2f-b5d6-651a1d4d540d","Type":"ContainerStarted","Data":"2164755ef56794afb26f54c7a2c3a56dbc1ccdfdf8ca093241adef70b3e61951"}
Jul 31 00:56:59.751821 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:56:59.751749    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv" podStartSLOduration=0.751731227 podStartE2EDuration="751.731227ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:56:59.748345656 +0000 UTC m=+3024.472311626" watchObservedRunningTime="2026-07-31 00:56:59.751731227 +0000 UTC m=+3024.475697199"
Jul 31 00:57:00.742800 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:57:00.742742    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77" event={"ID":"3e65e868-e85f-4e2f-b5d6-651a1d4d540d","Type":"ContainerStarted","Data":"9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa"}
Jul 31 00:57:00.743277 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:57:00.743037    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 00:57:00.758080 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:57:00.758037    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77" podStartSLOduration=1.758023073 podStartE2EDuration="1.758023073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:57:00.756955587 +0000 UTC m=+3025.480921557" watchObservedRunningTime="2026-07-31 00:57:00.758023073 +0000 UTC m=+3025.481989040"
Jul 31 00:57:10.745095 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:57:10.745065    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 00:57:11.750965 ip-10-0-129-35 kubenswrapper[2555]: I0731 00:57:11.750933    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 01:00:00.142841 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.142801    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"]
Jul 31 01:00:00.146574 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.146552    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"]
Jul 31 01:00:00.146697 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.146656    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"
Jul 31 01:00:00.148511 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.148490    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 01:00:00.149711 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.149691    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"]
Jul 31 01:00:00.149839 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.149825    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"
Jul 31 01:00:00.152786 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.152768    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"
Jul 31 01:00:00.157373 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.157351    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"]
Jul 31 01:00:00.158075 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.158056    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"
Jul 31 01:00:00.160665 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.160630    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"]
Jul 31 01:00:00.168189 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.168172    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"
Jul 31 01:00:00.174620 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.174587    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"]
Jul 31 01:00:00.202883 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.202859    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"
Jul 31 01:00:00.318540 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.318514    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"]
Jul 31 01:00:00.376185 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.376085    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"]
Jul 31 01:00:00.378259 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:00:00.378233    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ef163b_0cc1_4843_bf16_047a840d12ba.slice/crio-279ce19306b8c2ac1d9501062a2f6ff06a7388617365d2e03da1327c21a0b195 WatchSource:0}: Error finding container 279ce19306b8c2ac1d9501062a2f6ff06a7388617365d2e03da1327c21a0b195: Status 404 returned error can't find the container with id 279ce19306b8c2ac1d9501062a2f6ff06a7388617365d2e03da1327c21a0b195
Jul 31 01:00:00.560621 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.560595    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"]
Jul 31 01:00:00.562229 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:00:00.562208    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea34723_312c_4a21_9172_7532615a9305.slice/crio-111f9f684e28f245f703d051dc245e48e55936d535daaf1089478c453d18a924 WatchSource:0}: Error finding container 111f9f684e28f245f703d051dc245e48e55936d535daaf1089478c453d18a924: Status 404 returned error can't find the container with id 111f9f684e28f245f703d051dc245e48e55936d535daaf1089478c453d18a924
Jul 31 01:00:00.615237 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.615206    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn" event={"ID":"3daac06a-44d8-4218-be5b-610da6001dd7","Type":"ContainerStarted","Data":"4eb47656f10611854aa6b621e767cfc2222b33a33f7302f0676f9cac39b8837c"}
Jul 31 01:00:00.616372 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.616344    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596" event={"ID":"2ea34723-312c-4a21-9172-7532615a9305","Type":"ContainerStarted","Data":"111f9f684e28f245f703d051dc245e48e55936d535daaf1089478c453d18a924"}
Jul 31 01:00:00.617392 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:00.617372    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr" event={"ID":"03ef163b-0cc1-4843-bf16-047a840d12ba","Type":"ContainerStarted","Data":"279ce19306b8c2ac1d9501062a2f6ff06a7388617365d2e03da1327c21a0b195"}
Jul 31 01:00:01.624474 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:01.624441    2555 generic.go:356] "Generic (PLEG): container finished" podID="2ea34723-312c-4a21-9172-7532615a9305" containerID="907d79c60778e9168d5ad9f6cf25bd6b4cee89015e0ff1739dd40f6d3e872743" exitCode=0
Jul 31 01:00:01.624869 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:01.624531    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596" event={"ID":"2ea34723-312c-4a21-9172-7532615a9305","Type":"ContainerDied","Data":"907d79c60778e9168d5ad9f6cf25bd6b4cee89015e0ff1739dd40f6d3e872743"}
Jul 31 01:00:01.626023 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:01.626002    2555 generic.go:356] "Generic (PLEG): container finished" podID="03ef163b-0cc1-4843-bf16-047a840d12ba" containerID="258dc4f44a82ef9c1b64590d7e390465bfe513a72e982930ae377a65264beba7" exitCode=0
Jul 31 01:00:01.626118 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:01.626064    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr" event={"ID":"03ef163b-0cc1-4843-bf16-047a840d12ba","Type":"ContainerDied","Data":"258dc4f44a82ef9c1b64590d7e390465bfe513a72e982930ae377a65264beba7"}
Jul 31 01:00:01.627578 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:01.627557    2555 generic.go:356] "Generic (PLEG): container finished" podID="3daac06a-44d8-4218-be5b-610da6001dd7" containerID="cdd2dfa5f77bfdfcef88bea23165709a8f599845cb7b24b49e6f44d41bcdf924" exitCode=0
Jul 31 01:00:01.627678 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:01.627583    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn" event={"ID":"3daac06a-44d8-4218-be5b-610da6001dd7","Type":"ContainerDied","Data":"cdd2dfa5f77bfdfcef88bea23165709a8f599845cb7b24b49e6f44d41bcdf924"}
Jul 31 01:00:02.781449 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:02.781420    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"
Jul 31 01:00:02.826080 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:02.826059    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"
Jul 31 01:00:02.829289 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:02.829271    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"
Jul 31 01:00:03.639963 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.639935    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"
Jul 31 01:00:03.640154 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.639966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596" event={"ID":"2ea34723-312c-4a21-9172-7532615a9305","Type":"ContainerDied","Data":"111f9f684e28f245f703d051dc245e48e55936d535daaf1089478c453d18a924"}
Jul 31 01:00:03.640154 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.640014    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="111f9f684e28f245f703d051dc245e48e55936d535daaf1089478c453d18a924"
Jul 31 01:00:03.641250 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.641232    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr"
Jul 31 01:00:03.641250 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.641236    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757660-nwrpr" event={"ID":"03ef163b-0cc1-4843-bf16-047a840d12ba","Type":"ContainerDied","Data":"279ce19306b8c2ac1d9501062a2f6ff06a7388617365d2e03da1327c21a0b195"}
Jul 31 01:00:03.641436 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.641265    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="279ce19306b8c2ac1d9501062a2f6ff06a7388617365d2e03da1327c21a0b195"
Jul 31 01:00:03.642698 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.642672    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"
Jul 31 01:00:03.642788 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.642664    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn" event={"ID":"3daac06a-44d8-4218-be5b-610da6001dd7","Type":"ContainerDied","Data":"4eb47656f10611854aa6b621e767cfc2222b33a33f7302f0676f9cac39b8837c"}
Jul 31 01:00:03.642840 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:03.642797    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eb47656f10611854aa6b621e767cfc2222b33a33f7302f0676f9cac39b8837c"
Jul 31 01:00:36.204475 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:36.204368    2555 scope.go:117] "RemoveContainer" containerID="2f3af9d0be970509319b5fea05de04675c82be0bfb1461b584d3dce5f3fea685"
Jul 31 01:00:36.213784 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:00:36.213740    2555 scope.go:117] "RemoveContainer" containerID="7fc1a6c495ce8ed3f4deccbc4a43b0cf1726c8bc927a4753c5e3a5e90fa0a5cd"
Jul 31 01:02:36.242054 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:36.242019    2555 scope.go:117] "RemoveContainer" containerID="9bbd77236c4cddfead88ff60e31f883595723eb47acddad38fb5143ed17a5b3d"
Jul 31 01:02:52.591503 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591471    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"]
Jul 31 01:02:52.591909 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591877    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ea34723-312c-4a21-9172-7532615a9305" containerName="cleanup"
Jul 31 01:02:52.591909 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591888    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea34723-312c-4a21-9172-7532615a9305" containerName="cleanup"
Jul 31 01:02:52.591909 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591899    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3daac06a-44d8-4218-be5b-610da6001dd7" containerName="cleanup"
Jul 31 01:02:52.591909 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591905    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3daac06a-44d8-4218-be5b-610da6001dd7" containerName="cleanup"
Jul 31 01:02:52.592047 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591923    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ef163b-0cc1-4843-bf16-047a840d12ba" containerName="cleanup"
Jul 31 01:02:52.592047 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591928    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ef163b-0cc1-4843-bf16-047a840d12ba" containerName="cleanup"
Jul 31 01:02:52.592047 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591989    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ea34723-312c-4a21-9172-7532615a9305" containerName="cleanup"
Jul 31 01:02:52.592047 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.591999    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3daac06a-44d8-4218-be5b-610da6001dd7" containerName="cleanup"
Jul 31 01:02:52.592047 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.592005    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ef163b-0cc1-4843-bf16-047a840d12ba" containerName="cleanup"
Jul 31 01:02:52.595175 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.595154    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.597180 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.597124    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2164\"/\"kube-root-ca.crt\""
Jul 31 01:02:52.597779 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.597743    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2164\"/\"sub-test-model-6a2164-kserve-self-signed-certs\""
Jul 31 01:02:52.597899 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.597788    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2164\"/\"openshift-service-ca.crt\""
Jul 31 01:02:52.597899 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.597772    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2164\"/\"default-dockercfg-7chb9\""
Jul 31 01:02:52.603359 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.603339    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"]
Jul 31 01:02:52.710101 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.710069    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-model-cache\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.710271 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.710128    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-tmp-dir\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.710271 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.710204    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82jr8\" (UniqueName: \"kubernetes.io/projected/c9fcb93c-435c-4e25-a909-c33c1491288e-kube-api-access-82jr8\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.710271 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.710251    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9fcb93c-435c-4e25-a909-c33c1491288e-tls-certs\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.710387 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.710272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-home\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.710387 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.710324    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-dshm\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.810906 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.810867    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-model-cache\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811079 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.810980    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-tmp-dir\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811079 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82jr8\" (UniqueName: \"kubernetes.io/projected/c9fcb93c-435c-4e25-a909-c33c1491288e-kube-api-access-82jr8\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811077    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9fcb93c-435c-4e25-a909-c33c1491288e-tls-certs\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811099    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-home\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811127    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-dshm\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811288 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811265    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-model-cache\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811367 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811348    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-tmp-dir\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.811436 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.811420    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-home\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.813504 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.813478    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-dshm\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.813657 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.813639    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9fcb93c-435c-4e25-a909-c33c1491288e-tls-certs\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.819037 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.819017    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82jr8\" (UniqueName: \"kubernetes.io/projected/c9fcb93c-435c-4e25-a909-c33c1491288e-kube-api-access-82jr8\") pod \"sub-test-model-6a2164-kserve-5f84686b4c-rr4bd\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") " pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:52.905634 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:52.905549    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:02:53.038827 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:53.038802    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"]
Jul 31 01:02:53.041489 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:02:53.041457    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9fcb93c_435c_4e25_a909_c33c1491288e.slice/crio-6c5d7fc607a558e5acf4790e1dc7ba504f7bc29610ff31347d5a22ab37ac7979 WatchSource:0}: Error finding container 6c5d7fc607a558e5acf4790e1dc7ba504f7bc29610ff31347d5a22ab37ac7979: Status 404 returned error can't find the container with id 6c5d7fc607a558e5acf4790e1dc7ba504f7bc29610ff31347d5a22ab37ac7979
Jul 31 01:02:53.464964 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:53.464921    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" event={"ID":"c9fcb93c-435c-4e25-a909-c33c1491288e","Type":"ContainerStarted","Data":"511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717"}
Jul 31 01:02:53.464964 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:53.464961    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" event={"ID":"c9fcb93c-435c-4e25-a909-c33c1491288e","Type":"ContainerStarted","Data":"6c5d7fc607a558e5acf4790e1dc7ba504f7bc29610ff31347d5a22ab37ac7979"}
Jul 31 01:02:53.480252 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:02:53.480197    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" podStartSLOduration=1.48018259 podStartE2EDuration="1.48018259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:02:53.477689811 +0000 UTC m=+3378.201655779" watchObservedRunningTime="2026-07-31 01:02:53.48018259 +0000 UTC m=+3378.204148596"
Jul 31 01:03:02.905874 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:03:02.905820    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:03:02.905874 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:03:02.905890    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:03:02.918486 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:03:02.918458    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:03:03.523811 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:03:03.523780    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:04:38.392675 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:38.392642    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"]
Jul 31 01:04:53.412768 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.412708    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" podUID="c9fcb93c-435c-4e25-a909-c33c1491288e" containerName="main" containerID="cri-o://511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717" gracePeriod=45
Jul 31 01:04:53.513418 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.513387    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" podUID="c9fcb93c-435c-4e25-a909-c33c1491288e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": dial tcp 10.134.0.76:8000: connect: connection refused"
Jul 31 01:04:53.663193 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.663129    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:04:53.774798 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.774741    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-model-cache\") pod \"c9fcb93c-435c-4e25-a909-c33c1491288e\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") "
Jul 31 01:04:53.774989 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.774809    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9fcb93c-435c-4e25-a909-c33c1491288e-tls-certs\") pod \"c9fcb93c-435c-4e25-a909-c33c1491288e\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") "
Jul 31 01:04:53.774989 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.774837    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-home\") pod \"c9fcb93c-435c-4e25-a909-c33c1491288e\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") "
Jul 31 01:04:53.774989 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.774864    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-tmp-dir\") pod \"c9fcb93c-435c-4e25-a909-c33c1491288e\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") "
Jul 31 01:04:53.774989 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.774909    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82jr8\" (UniqueName: \"kubernetes.io/projected/c9fcb93c-435c-4e25-a909-c33c1491288e-kube-api-access-82jr8\") pod \"c9fcb93c-435c-4e25-a909-c33c1491288e\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") "
Jul 31 01:04:53.774989 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.774953    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-dshm\") pod \"c9fcb93c-435c-4e25-a909-c33c1491288e\" (UID: \"c9fcb93c-435c-4e25-a909-c33c1491288e\") "
Jul 31 01:04:53.775223 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.775063    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9fcb93c-435c-4e25-a909-c33c1491288e" (UID: "c9fcb93c-435c-4e25-a909-c33c1491288e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:04:53.775223 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.775093    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-home" (OuterVolumeSpecName: "home") pod "c9fcb93c-435c-4e25-a909-c33c1491288e" (UID: "c9fcb93c-435c-4e25-a909-c33c1491288e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:04:53.775223 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.775109    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9fcb93c-435c-4e25-a909-c33c1491288e" (UID: "c9fcb93c-435c-4e25-a909-c33c1491288e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:04:53.775331 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.775280    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-model-cache\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:04:53.775331 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.775293    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-home\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:04:53.775331 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.775308    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-tmp-dir\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:04:53.777201 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.777179    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9fcb93c-435c-4e25-a909-c33c1491288e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9fcb93c-435c-4e25-a909-c33c1491288e" (UID: "c9fcb93c-435c-4e25-a909-c33c1491288e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:04:53.777302 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.777222    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-dshm" (OuterVolumeSpecName: "dshm") pod "c9fcb93c-435c-4e25-a909-c33c1491288e" (UID: "c9fcb93c-435c-4e25-a909-c33c1491288e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:04:53.777302 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.777281    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9fcb93c-435c-4e25-a909-c33c1491288e-kube-api-access-82jr8" (OuterVolumeSpecName: "kube-api-access-82jr8") pod "c9fcb93c-435c-4e25-a909-c33c1491288e" (UID: "c9fcb93c-435c-4e25-a909-c33c1491288e"). InnerVolumeSpecName "kube-api-access-82jr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:04:53.876376 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.876350    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9fcb93c-435c-4e25-a909-c33c1491288e-tls-certs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:04:53.876376 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.876376    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82jr8\" (UniqueName: \"kubernetes.io/projected/c9fcb93c-435c-4e25-a909-c33c1491288e-kube-api-access-82jr8\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:04:53.876525 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:53.876386    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9fcb93c-435c-4e25-a909-c33c1491288e-dshm\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:04:54.051137 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.051099    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9fcb93c-435c-4e25-a909-c33c1491288e" containerID="511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717" exitCode=0
Jul 31 01:04:54.051322 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.051146    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"
Jul 31 01:04:54.051322 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.051170    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" event={"ID":"c9fcb93c-435c-4e25-a909-c33c1491288e","Type":"ContainerDied","Data":"511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717"}
Jul 31 01:04:54.051322 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.051208    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd" event={"ID":"c9fcb93c-435c-4e25-a909-c33c1491288e","Type":"ContainerDied","Data":"6c5d7fc607a558e5acf4790e1dc7ba504f7bc29610ff31347d5a22ab37ac7979"}
Jul 31 01:04:54.051322 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.051231    2555 scope.go:117] "RemoveContainer" containerID="511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717"
Jul 31 01:04:54.059995 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.059965    2555 scope.go:117] "RemoveContainer" containerID="511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717"
Jul 31 01:04:54.060255 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:04:54.060231    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717\": container with ID starting with 511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717 not found: ID does not exist" containerID="511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717"
Jul 31 01:04:54.060307 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.060264    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717"} err="failed to get container status \"511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717\": rpc error: code = NotFound desc = could not find container \"511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717\": container with ID starting with 511f16bc869874ddde172acb04dcfc09e435eafa257ef4cf862ebd3aebe4d717 not found: ID does not exist"
Jul 31 01:04:54.064286 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.064265    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"]
Jul 31 01:04:54.068062 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:54.068037    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a2164/sub-test-model-6a2164-kserve-5f84686b4c-rr4bd"]
Jul 31 01:04:55.867540 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:04:55.867506    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9fcb93c-435c-4e25-a909-c33c1491288e" path="/var/lib/kubelet/pods/c9fcb93c-435c-4e25-a909-c33c1491288e/volumes"
Jul 31 01:05:01.186463 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.186425    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"]
Jul 31 01:05:01.187105 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.187085    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9fcb93c-435c-4e25-a909-c33c1491288e" containerName="main"
Jul 31 01:05:01.187191 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.187109    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9fcb93c-435c-4e25-a909-c33c1491288e" containerName="main"
Jul 31 01:05:01.187244 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.187208    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9fcb93c-435c-4e25-a909-c33c1491288e" containerName="main"
Jul 31 01:05:01.191488 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.191466    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.193350 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.193330    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b32567\"/\"kube-root-ca.crt\""
Jul 31 01:05:01.193810 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.193795    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b32567\"/\"default-dockercfg-bdwzj\""
Jul 31 01:05:01.193940 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.193825    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b32567\"/\"rate-test-model-b32567-kserve-self-signed-certs\""
Jul 31 01:05:01.193940 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.193848    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b32567\"/\"openshift-service-ca.crt\""
Jul 31 01:05:01.199724 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.199704    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"]
Jul 31 01:05:01.342531 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.342497    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwr5\" (UniqueName: \"kubernetes.io/projected/a03b4432-b994-484b-848c-a55578a3b759-kube-api-access-2rwr5\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.342701 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.342593    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-model-cache\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.342701 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.342615    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-home\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.342701 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.342646    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-dshm\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.342842 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.342721    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-tmp-dir\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.342842 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.342740    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03b4432-b994-484b-848c-a55578a3b759-tls-certs\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.443596 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-tmp-dir\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.443596 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03b4432-b994-484b-848c-a55578a3b759-tls-certs\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.443596 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443576    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwr5\" (UniqueName: \"kubernetes.io/projected/a03b4432-b994-484b-848c-a55578a3b759-kube-api-access-2rwr5\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.443908 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443621    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-model-cache\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.443908 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-home\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.443908 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443656    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-dshm\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.444073 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.443991    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-home\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.444073 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.444052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-tmp-dir\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.444175 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.444098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-model-cache\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.446168 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.446148    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-dshm\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.446303 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.446287    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03b4432-b994-484b-848c-a55578a3b759-tls-certs\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.450332 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.450309    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwr5\" (UniqueName: \"kubernetes.io/projected/a03b4432-b994-484b-848c-a55578a3b759-kube-api-access-2rwr5\") pod \"rate-test-model-b32567-kserve-5c84d4fb55-gptt9\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") " pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.501349 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.501313    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:01.630546 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:01.630516    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"]
Jul 31 01:05:01.632560 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:05:01.632526    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda03b4432_b994_484b_848c_a55578a3b759.slice/crio-532f0bec67c60f237816c75878ccc3da97612142b2e13db411b141fd072e958c WatchSource:0}: Error finding container 532f0bec67c60f237816c75878ccc3da97612142b2e13db411b141fd072e958c: Status 404 returned error can't find the container with id 532f0bec67c60f237816c75878ccc3da97612142b2e13db411b141fd072e958c
Jul 31 01:05:02.092240 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:02.092195    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9" event={"ID":"a03b4432-b994-484b-848c-a55578a3b759","Type":"ContainerStarted","Data":"cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f"}
Jul 31 01:05:02.092240 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:02.092244    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9" event={"ID":"a03b4432-b994-484b-848c-a55578a3b759","Type":"ContainerStarted","Data":"532f0bec67c60f237816c75878ccc3da97612142b2e13db411b141fd072e958c"}
Jul 31 01:05:02.108426 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:02.108373    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9" podStartSLOduration=1.108357502 podStartE2EDuration="1.108357502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:05:02.105950928 +0000 UTC m=+3506.829916895" watchObservedRunningTime="2026-07-31 01:05:02.108357502 +0000 UTC m=+3506.832323525"
Jul 31 01:05:11.501850 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:11.501795    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:11.502295 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:11.501869    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:11.515001 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:11.514977    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:05:12.151308 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:05:12.151280    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:06:17.463096 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:17.463064    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"]
Jul 31 01:06:32.483188 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.483080    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9" podUID="a03b4432-b994-484b-848c-a55578a3b759" containerName="main" containerID="cri-o://cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f" gracePeriod=45
Jul 31 01:06:32.727938 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.727915    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:06:32.860059 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.859990    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-home\") pod \"a03b4432-b994-484b-848c-a55578a3b759\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") "
Jul 31 01:06:32.860200 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860069    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-model-cache\") pod \"a03b4432-b994-484b-848c-a55578a3b759\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") "
Jul 31 01:06:32.860200 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860096    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-tmp-dir\") pod \"a03b4432-b994-484b-848c-a55578a3b759\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") "
Jul 31 01:06:32.860200 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860112    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03b4432-b994-484b-848c-a55578a3b759-tls-certs\") pod \"a03b4432-b994-484b-848c-a55578a3b759\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") "
Jul 31 01:06:32.860200 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860142    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rwr5\" (UniqueName: \"kubernetes.io/projected/a03b4432-b994-484b-848c-a55578a3b759-kube-api-access-2rwr5\") pod \"a03b4432-b994-484b-848c-a55578a3b759\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") "
Jul 31 01:06:32.860200 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860171    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-dshm\") pod \"a03b4432-b994-484b-848c-a55578a3b759\" (UID: \"a03b4432-b994-484b-848c-a55578a3b759\") "
Jul 31 01:06:32.860471 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860248    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-home" (OuterVolumeSpecName: "home") pod "a03b4432-b994-484b-848c-a55578a3b759" (UID: "a03b4432-b994-484b-848c-a55578a3b759"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:06:32.860471 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860369    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-model-cache" (OuterVolumeSpecName: "model-cache") pod "a03b4432-b994-484b-848c-a55578a3b759" (UID: "a03b4432-b994-484b-848c-a55578a3b759"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:06:32.860471 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860399    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a03b4432-b994-484b-848c-a55578a3b759" (UID: "a03b4432-b994-484b-848c-a55578a3b759"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:06:32.860611 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860468    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-model-cache\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:06:32.860611 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.860487    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-home\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:06:32.862580 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.862542    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a03b4432-b994-484b-848c-a55578a3b759-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a03b4432-b994-484b-848c-a55578a3b759" (UID: "a03b4432-b994-484b-848c-a55578a3b759"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:06:32.862677 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.862573    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-dshm" (OuterVolumeSpecName: "dshm") pod "a03b4432-b994-484b-848c-a55578a3b759" (UID: "a03b4432-b994-484b-848c-a55578a3b759"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:06:32.862677 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.862579    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03b4432-b994-484b-848c-a55578a3b759-kube-api-access-2rwr5" (OuterVolumeSpecName: "kube-api-access-2rwr5") pod "a03b4432-b994-484b-848c-a55578a3b759" (UID: "a03b4432-b994-484b-848c-a55578a3b759"). InnerVolumeSpecName "kube-api-access-2rwr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:06:32.961727 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.961694    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-tmp-dir\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:06:32.961727 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.961721    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03b4432-b994-484b-848c-a55578a3b759-tls-certs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:06:32.961921 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.961734    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rwr5\" (UniqueName: \"kubernetes.io/projected/a03b4432-b994-484b-848c-a55578a3b759-kube-api-access-2rwr5\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:06:32.961921 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:32.961746    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03b4432-b994-484b-848c-a55578a3b759-dshm\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:06:33.548208 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.548118    2555 generic.go:356] "Generic (PLEG): container finished" podID="a03b4432-b994-484b-848c-a55578a3b759" containerID="cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f" exitCode=0
Jul 31 01:06:33.548208 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.548159    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"
Jul 31 01:06:33.548741 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.548204    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9" event={"ID":"a03b4432-b994-484b-848c-a55578a3b759","Type":"ContainerDied","Data":"cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f"}
Jul 31 01:06:33.548741 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.548257    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9" event={"ID":"a03b4432-b994-484b-848c-a55578a3b759","Type":"ContainerDied","Data":"532f0bec67c60f237816c75878ccc3da97612142b2e13db411b141fd072e958c"}
Jul 31 01:06:33.548741 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.548275    2555 scope.go:117] "RemoveContainer" containerID="cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f"
Jul 31 01:06:33.557498 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.557479    2555 scope.go:117] "RemoveContainer" containerID="cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f"
Jul 31 01:06:33.557824 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:06:33.557797    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f\": container with ID starting with cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f not found: ID does not exist" containerID="cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f"
Jul 31 01:06:33.557968 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.557834    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f"} err="failed to get container status \"cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f\": rpc error: code = NotFound desc = could not find container \"cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f\": container with ID starting with cf69ffafc85525a4f0b3b2aa8eb6299dc5c582e5f326178c44ba7487c0ebe85f not found: ID does not exist"
Jul 31 01:06:33.568453 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.568431    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"]
Jul 31 01:06:33.571347 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.571327    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b32567/rate-test-model-b32567-kserve-5c84d4fb55-gptt9"]
Jul 31 01:06:33.867293 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:33.867220    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03b4432-b994-484b-848c-a55578a3b759" path="/var/lib/kubelet/pods/a03b4432-b994-484b-848c-a55578a3b759/volumes"
Jul 31 01:06:42.061907 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.061869    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"]
Jul 31 01:06:42.062318 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.062270    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03b4432-b994-484b-848c-a55578a3b759" containerName="main"
Jul 31 01:06:42.062318 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.062281    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03b4432-b994-484b-848c-a55578a3b759" containerName="main"
Jul 31 01:06:42.062400 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.062343    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a03b4432-b994-484b-848c-a55578a3b759" containerName="main"
Jul 31 01:06:42.066514 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.066496    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.068571 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.068552    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-2b1008-dockercfg-nbrjd\""
Jul 31 01:06:42.068673 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.068593    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-2b1008\""
Jul 31 01:06:42.075474 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.075452    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"]
Jul 31 01:06:42.094985 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.094937    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"]
Jul 31 01:06:42.098655 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.098639    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.111286 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.111262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"]
Jul 31 01:06:42.136476 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.136440    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmxxs\" (UniqueName: \"kubernetes.io/projected/9ed99196-61f1-432d-a584-df21ca05f29c-kube-api-access-wmxxs\") pod \"payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.136610 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.136492    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82aed3d1-4751-4928-b59d-46627783beea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.136610 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.136568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp927\" (UniqueName: \"kubernetes.io/projected/82aed3d1-4751-4928-b59d-46627783beea-kube-api-access-cp927\") pod \"payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.136700 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.136662    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ed99196-61f1-432d-a584-df21ca05f29c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.237686 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.237660    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp927\" (UniqueName: \"kubernetes.io/projected/82aed3d1-4751-4928-b59d-46627783beea-kube-api-access-cp927\") pod \"payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.237900 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.237711    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ed99196-61f1-432d-a584-df21ca05f29c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.237900 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.237769    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmxxs\" (UniqueName: \"kubernetes.io/projected/9ed99196-61f1-432d-a584-df21ca05f29c-kube-api-access-wmxxs\") pod \"payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.237900 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.237788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82aed3d1-4751-4928-b59d-46627783beea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.238699 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.238673    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82aed3d1-4751-4928-b59d-46627783beea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.238786 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.238707    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ed99196-61f1-432d-a584-df21ca05f29c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.246244 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.246223    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp927\" (UniqueName: \"kubernetes.io/projected/82aed3d1-4751-4928-b59d-46627783beea-kube-api-access-cp927\") pod \"payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.246338 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.246262    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmxxs\" (UniqueName: \"kubernetes.io/projected/9ed99196-61f1-432d-a584-df21ca05f29c-kube-api-access-wmxxs\") pod \"payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.377788 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.377682    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:42.408792 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.408744    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:42.531908 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.531880    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"]
Jul 31 01:06:42.538709 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:06:42.538648    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed99196_61f1_432d_a584_df21ca05f29c.slice/crio-e3ca2a7e8d586f629d2cbe29db526f43ff8a0584f56370a729541833d399e761 WatchSource:0}: Error finding container e3ca2a7e8d586f629d2cbe29db526f43ff8a0584f56370a729541833d399e761: Status 404 returned error can't find the container with id e3ca2a7e8d586f629d2cbe29db526f43ff8a0584f56370a729541833d399e761
Jul 31 01:06:42.555780 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.555732    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"]
Jul 31 01:06:42.557285 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:06:42.557244    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82aed3d1_4751_4928_b59d_46627783beea.slice/crio-7dce6cab6f9969eee5dcfe1ca1a38e52ac6e58f0cf58ea2a13112257ba5db478 WatchSource:0}: Error finding container 7dce6cab6f9969eee5dcfe1ca1a38e52ac6e58f0cf58ea2a13112257ba5db478: Status 404 returned error can't find the container with id 7dce6cab6f9969eee5dcfe1ca1a38e52ac6e58f0cf58ea2a13112257ba5db478
Jul 31 01:06:42.593262 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.593236    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl" event={"ID":"9ed99196-61f1-432d-a584-df21ca05f29c","Type":"ContainerStarted","Data":"e3ca2a7e8d586f629d2cbe29db526f43ff8a0584f56370a729541833d399e761"}
Jul 31 01:06:42.594796 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:42.594737    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m" event={"ID":"82aed3d1-4751-4928-b59d-46627783beea","Type":"ContainerStarted","Data":"7dce6cab6f9969eee5dcfe1ca1a38e52ac6e58f0cf58ea2a13112257ba5db478"}
Jul 31 01:06:43.601750 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:43.601713    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl" event={"ID":"9ed99196-61f1-432d-a584-df21ca05f29c","Type":"ContainerStarted","Data":"ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801"}
Jul 31 01:06:43.602228 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:43.601901    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:43.603248 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:43.603227    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m" event={"ID":"82aed3d1-4751-4928-b59d-46627783beea","Type":"ContainerStarted","Data":"62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21"}
Jul 31 01:06:43.603372 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:43.603357    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:06:43.617163 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:43.617079    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl" podStartSLOduration=1.6170660140000002 podStartE2EDuration="1.617066014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:06:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:06:43.614742269 +0000 UTC m=+3608.338708258" watchObservedRunningTime="2026-07-31 01:06:43.617066014 +0000 UTC m=+3608.341032027"
Jul 31 01:06:43.629012 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:43.628968    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m" podStartSLOduration=1.62895612 podStartE2EDuration="1.62895612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:06:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:06:43.627156248 +0000 UTC m=+3608.351122217" watchObservedRunningTime="2026-07-31 01:06:43.62895612 +0000 UTC m=+3608.352922086"
Jul 31 01:06:54.610433 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:54.610404    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:06:54.610866 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:06:54.610473    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:07:11.069026 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.068977    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"]
Jul 31 01:07:11.072581 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.072564    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.074425 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.074409    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0f1466-dockercfg-7f4z8\""
Jul 31 01:07:11.074507 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.074422    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0f1466\""
Jul 31 01:07:11.081417 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.081393    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"]
Jul 31 01:07:11.117950 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.117924    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"]
Jul 31 01:07:11.121188 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.121173    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.132036 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.132016    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"]
Jul 31 01:07:11.203558 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.203257    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swgcn\" (UniqueName: \"kubernetes.io/projected/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-kube-api-access-swgcn\") pod \"payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.203558 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.203342    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlzl\" (UniqueName: \"kubernetes.io/projected/329c0e7c-7a89-47da-84b7-bc6e71e23202-kube-api-access-jrlzl\") pod \"payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.203558 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.203388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329c0e7c-7a89-47da-84b7-bc6e71e23202-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.203558 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.203429    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.304479 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.304448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329c0e7c-7a89-47da-84b7-bc6e71e23202-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.304646 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.304496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.304646 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.304557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swgcn\" (UniqueName: \"kubernetes.io/projected/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-kube-api-access-swgcn\") pod \"payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.304646 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.304618    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlzl\" (UniqueName: \"kubernetes.io/projected/329c0e7c-7a89-47da-84b7-bc6e71e23202-kube-api-access-jrlzl\") pod \"payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.305274 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.305252    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329c0e7c-7a89-47da-84b7-bc6e71e23202-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.305318 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.305261    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.312856 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.312830    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swgcn\" (UniqueName: \"kubernetes.io/projected/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-kube-api-access-swgcn\") pod \"payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.313118 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.313097    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlzl\" (UniqueName: \"kubernetes.io/projected/329c0e7c-7a89-47da-84b7-bc6e71e23202-kube-api-access-jrlzl\") pod \"payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.384373 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.384302    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.430982 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.430944    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.531480 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.531445    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"]
Jul 31 01:07:11.533044 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:07:11.533003    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae92608_61b3_4c2a_9d88_54138d3e7a8a.slice/crio-85c05181014e90325d683789c693d3fe9c791950600ee0cb45c8a84d6370e500 WatchSource:0}: Error finding container 85c05181014e90325d683789c693d3fe9c791950600ee0cb45c8a84d6370e500: Status 404 returned error can't find the container with id 85c05181014e90325d683789c693d3fe9c791950600ee0cb45c8a84d6370e500
Jul 31 01:07:11.587946 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.587921    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"]
Jul 31 01:07:11.590721 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:07:11.590693    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329c0e7c_7a89_47da_84b7_bc6e71e23202.slice/crio-445e8b898e99076e52127c405b4aac607c58b9ea8780814a4660e4bd18f967af WatchSource:0}: Error finding container 445e8b898e99076e52127c405b4aac607c58b9ea8780814a4660e4bd18f967af: Status 404 returned error can't find the container with id 445e8b898e99076e52127c405b4aac607c58b9ea8780814a4660e4bd18f967af
Jul 31 01:07:11.749832 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.749797    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv" event={"ID":"329c0e7c-7a89-47da-84b7-bc6e71e23202","Type":"ContainerStarted","Data":"9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7"}
Jul 31 01:07:11.750032 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.749868    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv" event={"ID":"329c0e7c-7a89-47da-84b7-bc6e71e23202","Type":"ContainerStarted","Data":"445e8b898e99076e52127c405b4aac607c58b9ea8780814a4660e4bd18f967af"}
Jul 31 01:07:11.750032 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.749953    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:11.751668 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.751639    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns" event={"ID":"8ae92608-61b3-4c2a-9d88-54138d3e7a8a","Type":"ContainerStarted","Data":"f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9"}
Jul 31 01:07:11.751853 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.751699    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns" event={"ID":"8ae92608-61b3-4c2a-9d88-54138d3e7a8a","Type":"ContainerStarted","Data":"85c05181014e90325d683789c693d3fe9c791950600ee0cb45c8a84d6370e500"}
Jul 31 01:07:11.751853 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.751727    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:11.764177 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.763931    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv" podStartSLOduration=0.763915111 podStartE2EDuration="763.915111ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:07:11.763674004 +0000 UTC m=+3636.487639998" watchObservedRunningTime="2026-07-31 01:07:11.763915111 +0000 UTC m=+3636.487881078"
Jul 31 01:07:11.776905 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:11.776856    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns" podStartSLOduration=0.776839011 podStartE2EDuration="776.839011ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:07:11.775982658 +0000 UTC m=+3636.499948644" watchObservedRunningTime="2026-07-31 01:07:11.776839011 +0000 UTC m=+3636.500804981"
Jul 31 01:07:22.758199 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:22.758165    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:07:22.758810 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:22.758396    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:07:41.397715 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:41.397686    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5qk_5648c4a6-8434-4cfc-829e-dc24c83252f6/payload-processing/0.log"
Jul 31 01:07:41.527335 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:07:41.527308    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv_329c0e7c-7a89-47da-84b7-bc6e71e23202/payload-processing/0.log"
Jul 31 01:08:31.384953 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:31.384924    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m_82aed3d1-4751-4928-b59d-46627783beea/payload-processing/0.log"
Jul 31 01:08:31.508882 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:31.508841    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5qk_5648c4a6-8434-4cfc-829e-dc24c83252f6/payload-processing/0.log"
Jul 31 01:08:31.627017 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:31.626989    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv_329c0e7c-7a89-47da-84b7-bc6e71e23202/payload-processing/0.log"
Jul 31 01:08:36.065603 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.065567    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"]
Jul 31 01:08:36.069144 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.069128    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.071066 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.071038    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-689edf-serving-cert\""
Jul 31 01:08:36.071201 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.071083    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 01:08:36.076166 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.076142    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"]
Jul 31 01:08:36.138555 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.138525    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmsl7\" (UniqueName: \"kubernetes.io/projected/0387a7d3-8a66-4310-be66-5a3828825338-kube-api-access-pmsl7\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.138555 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.138556    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0387a7d3-8a66-4310-be66-5a3828825338-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.138731 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.138588    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.239108 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.239078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmsl7\" (UniqueName: \"kubernetes.io/projected/0387a7d3-8a66-4310-be66-5a3828825338-kube-api-access-pmsl7\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.239108 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.239110    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0387a7d3-8a66-4310-be66-5a3828825338-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.239315 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.239232    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.239367 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:08:36.239354    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-serving-cert: secret "maas-api-e2e-ipp-cleanup-689edf-serving-cert" not found
Jul 31 01:08:36.239446 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:08:36.239435    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls podName:0387a7d3-8a66-4310-be66-5a3828825338 nodeName:}" failed. No retries permitted until 2026-07-31 01:08:36.739418237 +0000 UTC m=+3721.463384182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" (UID: "0387a7d3-8a66-4310-be66-5a3828825338") : secret "maas-api-e2e-ipp-cleanup-689edf-serving-cert" not found
Jul 31 01:08:36.239656 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.239639    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0387a7d3-8a66-4310-be66-5a3828825338-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.249183 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.249162    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmsl7\" (UniqueName: \"kubernetes.io/projected/0387a7d3-8a66-4310-be66-5a3828825338-kube-api-access-pmsl7\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.681291 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.681250    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"]
Jul 31 01:08:36.684981 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.684959    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.686641 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.686624    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-689edf\""
Jul 31 01:08:36.686907 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.686890    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-689edf-dockercfg-644t4\""
Jul 31 01:08:36.694838 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.694816    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"]
Jul 31 01:08:36.718840 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.718812    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"]
Jul 31 01:08:36.722193 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.722179    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.729936 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.729918    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"]
Jul 31 01:08:36.744468 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.744444    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjxp\" (UniqueName: \"kubernetes.io/projected/f43dccb0-4330-4554-b590-1e22e4a6437a-kube-api-access-bnjxp\") pod \"payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.744586 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.744510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f43dccb0-4330-4554-b590-1e22e4a6437a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.744586 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.744563    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.747150 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.747127    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.845402 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.845364    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjxp\" (UniqueName: \"kubernetes.io/projected/f43dccb0-4330-4554-b590-1e22e4a6437a-kube-api-access-bnjxp\") pod \"payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.845586 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.845423    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.845586 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.845523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f43dccb0-4330-4554-b590-1e22e4a6437a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.845586 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.845580    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bm9t\" (UniqueName: \"kubernetes.io/projected/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-kube-api-access-6bm9t\") pod \"payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.846236 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.846216    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f43dccb0-4330-4554-b590-1e22e4a6437a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.852784 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.852738    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjxp\" (UniqueName: \"kubernetes.io/projected/f43dccb0-4330-4554-b590-1e22e4a6437a-kube-api-access-bnjxp\") pod \"payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:36.946459 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.946364    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.946628 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.946484    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bm9t\" (UniqueName: \"kubernetes.io/projected/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-kube-api-access-6bm9t\") pod \"payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.947126 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.947105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.953258 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.953235    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bm9t\" (UniqueName: \"kubernetes.io/projected/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-kube-api-access-6bm9t\") pod \"payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:36.981188 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.981167    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:36.998091 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:36.998066    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:37.032455 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:37.032416    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:37.159855 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:37.159683    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"]
Jul 31 01:08:37.162405 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:08:37.162340    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0387a7d3_8a66_4310_be66_5a3828825338.slice/crio-8de06a6703d214df48e9a2713f0ad0ef1d12949f233b0e4c23479add3041ae83 WatchSource:0}: Error finding container 8de06a6703d214df48e9a2713f0ad0ef1d12949f233b0e4c23479add3041ae83: Status 404 returned error can't find the container with id 8de06a6703d214df48e9a2713f0ad0ef1d12949f233b0e4c23479add3041ae83
Jul 31 01:08:37.163639 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:37.163602    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:08:37.179218 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:37.179186    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" event={"ID":"0387a7d3-8a66-4310-be66-5a3828825338","Type":"ContainerStarted","Data":"8de06a6703d214df48e9a2713f0ad0ef1d12949f233b0e4c23479add3041ae83"}
Jul 31 01:08:37.218255 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:37.218221    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"]
Jul 31 01:08:37.219230 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:08:37.219201    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6658ee7c_86f6_41fd_8ece_c9fc2108b06a.slice/crio-39278610183b9526a6a991cebd20a2c017aae6d7bd26c097b135e1ea5a5892b7 WatchSource:0}: Error finding container 39278610183b9526a6a991cebd20a2c017aae6d7bd26c097b135e1ea5a5892b7: Status 404 returned error can't find the container with id 39278610183b9526a6a991cebd20a2c017aae6d7bd26c097b135e1ea5a5892b7
Jul 31 01:08:37.388012 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:37.387985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"]
Jul 31 01:08:37.389851 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:08:37.389821    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43dccb0_4330_4554_b590_1e22e4a6437a.slice/crio-b5bf5e7f81f7a4d09d00790a798bcb773cdded481d66fd9b1b745d511ecb76ec WatchSource:0}: Error finding container b5bf5e7f81f7a4d09d00790a798bcb773cdded481d66fd9b1b745d511ecb76ec: Status 404 returned error can't find the container with id b5bf5e7f81f7a4d09d00790a798bcb773cdded481d66fd9b1b745d511ecb76ec
Jul 31 01:08:38.187815 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.187677    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q" event={"ID":"f43dccb0-4330-4554-b590-1e22e4a6437a","Type":"ContainerStarted","Data":"197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467"}
Jul 31 01:08:38.187815 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.187748    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q" event={"ID":"f43dccb0-4330-4554-b590-1e22e4a6437a","Type":"ContainerStarted","Data":"b5bf5e7f81f7a4d09d00790a798bcb773cdded481d66fd9b1b745d511ecb76ec"}
Jul 31 01:08:38.188352 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.187919    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:08:38.190389 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.190317    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg" event={"ID":"6658ee7c-86f6-41fd-8ece-c9fc2108b06a","Type":"ContainerStarted","Data":"f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b"}
Jul 31 01:08:38.190389 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.190365    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg" event={"ID":"6658ee7c-86f6-41fd-8ece-c9fc2108b06a","Type":"ContainerStarted","Data":"39278610183b9526a6a991cebd20a2c017aae6d7bd26c097b135e1ea5a5892b7"}
Jul 31 01:08:38.190600 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.190395    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:38.202238 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.202192    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q" podStartSLOduration=2.202176885 podStartE2EDuration="2.202176885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:08:38.200601 +0000 UTC m=+3722.924566980" watchObservedRunningTime="2026-07-31 01:08:38.202176885 +0000 UTC m=+3722.926142851"
Jul 31 01:08:38.218040 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:38.217973    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg" podStartSLOduration=2.217954056 podStartE2EDuration="2.217954056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:08:38.215143498 +0000 UTC m=+3722.939109488" watchObservedRunningTime="2026-07-31 01:08:38.217954056 +0000 UTC m=+3722.941920022"
Jul 31 01:08:39.196926 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:39.196887    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" event={"ID":"0387a7d3-8a66-4310-be66-5a3828825338","Type":"ContainerStarted","Data":"641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9"}
Jul 31 01:08:39.197355 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:39.197159    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:39.212374 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:39.212327    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" podStartSLOduration=1.5634754339999999 podStartE2EDuration="3.212312885s" totalImagesPullingTime="1.648837451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:08:39.210062767 +0000 UTC m=+3723.934028735" watchObservedRunningTime="2026-07-31 01:08:39.212312885 +0000 UTC m=+3723.936278852"
Jul 31 01:08:45.207905 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:45.207873    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:08:49.199513 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:49.199480    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:08:49.200038 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:08:49.199612    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:09:00.613719 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.613676    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"]
Jul 31 01:09:00.617593 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.617571    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:00.619358 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.619335    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 01:09:00.624211 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.624178    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"]
Jul 31 01:09:00.765723 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.765692    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3452d-f37d-4fae-82c9-37c5cde0cd51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d\" (UID: \"a4e3452d-f37d-4fae-82c9-37c5cde0cd51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:00.866301 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.866217    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3452d-f37d-4fae-82c9-37c5cde0cd51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d\" (UID: \"a4e3452d-f37d-4fae-82c9-37c5cde0cd51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:00.866873 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.866855    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3452d-f37d-4fae-82c9-37c5cde0cd51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d\" (UID: \"a4e3452d-f37d-4fae-82c9-37c5cde0cd51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:00.930929 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:00.930894    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:01.275308 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:01.275283    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"]
Jul 31 01:09:01.277776 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:09:01.277734    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e3452d_f37d_4fae_82c9_37c5cde0cd51.slice/crio-d0fc7e9c9a573b6b1d4966890e7794e3579f43d18b40f2a3b441e2cc5706fe6e WatchSource:0}: Error finding container d0fc7e9c9a573b6b1d4966890e7794e3579f43d18b40f2a3b441e2cc5706fe6e: Status 404 returned error can't find the container with id d0fc7e9c9a573b6b1d4966890e7794e3579f43d18b40f2a3b441e2cc5706fe6e
Jul 31 01:09:01.320662 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:01.320628    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d" event={"ID":"a4e3452d-f37d-4fae-82c9-37c5cde0cd51","Type":"ContainerStarted","Data":"d0fc7e9c9a573b6b1d4966890e7794e3579f43d18b40f2a3b441e2cc5706fe6e"}
Jul 31 01:09:02.327789 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:02.327684    2555 generic.go:356] "Generic (PLEG): container finished" podID="a4e3452d-f37d-4fae-82c9-37c5cde0cd51" containerID="9272dd91506a7363a711f8aa9a06247e52e84f9049eb8dfb9d6252319a98fdc3" exitCode=0
Jul 31 01:09:02.328314 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:02.327794    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d" event={"ID":"a4e3452d-f37d-4fae-82c9-37c5cde0cd51","Type":"ContainerDied","Data":"9272dd91506a7363a711f8aa9a06247e52e84f9049eb8dfb9d6252319a98fdc3"}
Jul 31 01:09:03.471322 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:03.471299    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:03.593601 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:03.593511    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3452d-f37d-4fae-82c9-37c5cde0cd51-maas-api-service-ca\") pod \"a4e3452d-f37d-4fae-82c9-37c5cde0cd51\" (UID: \"a4e3452d-f37d-4fae-82c9-37c5cde0cd51\") "
Jul 31 01:09:03.593896 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:03.593876    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e3452d-f37d-4fae-82c9-37c5cde0cd51-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4e3452d-f37d-4fae-82c9-37c5cde0cd51" (UID: "a4e3452d-f37d-4fae-82c9-37c5cde0cd51"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:03.694430 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:03.694391    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3452d-f37d-4fae-82c9-37c5cde0cd51-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:04.340667 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:04.340638    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"
Jul 31 01:09:04.340875 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:04.340640    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d" event={"ID":"a4e3452d-f37d-4fae-82c9-37c5cde0cd51","Type":"ContainerDied","Data":"d0fc7e9c9a573b6b1d4966890e7794e3579f43d18b40f2a3b441e2cc5706fe6e"}
Jul 31 01:09:04.340875 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:04.340785    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0fc7e9c9a573b6b1d4966890e7794e3579f43d18b40f2a3b441e2cc5706fe6e"
Jul 31 01:09:06.704145 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.704112    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"]
Jul 31 01:09:06.704575 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.704422    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" podUID="0387a7d3-8a66-4310-be66-5a3828825338" containerName="maas-api" containerID="cri-o://641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9" gracePeriod=30
Jul 31 01:09:06.754410 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.754378    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"]
Jul 31 01:09:06.754613 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.754587    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg" podUID="6658ee7c-86f6-41fd-8ece-c9fc2108b06a" containerName="payload-processing" containerID="cri-o://f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b" gracePeriod=30
Jul 31 01:09:06.768721 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.768695    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"]
Jul 31 01:09:06.769152 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.769108    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q" podUID="f43dccb0-4330-4554-b590-1e22e4a6437a" containerName="payload-pre-processing" containerID="cri-o://197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467" gracePeriod=30
Jul 31 01:09:06.993499 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.993466    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"]
Jul 31 01:09:06.995741 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:06.995712    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-689edf-p782d"]
Jul 31 01:09:07.029643 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.029617    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:09:07.035639 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.035616    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:09:07.078111 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.078074    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:09:07.126811 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.126783    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0387a7d3-8a66-4310-be66-5a3828825338-openshift-service-ca\") pod \"0387a7d3-8a66-4310-be66-5a3828825338\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") "
Jul 31 01:09:07.126975 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.126818    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls\") pod \"0387a7d3-8a66-4310-be66-5a3828825338\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") "
Jul 31 01:09:07.126975 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.126840    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnjxp\" (UniqueName: \"kubernetes.io/projected/f43dccb0-4330-4554-b590-1e22e4a6437a-kube-api-access-bnjxp\") pod \"f43dccb0-4330-4554-b590-1e22e4a6437a\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") "
Jul 31 01:09:07.126975 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.126860    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bm9t\" (UniqueName: \"kubernetes.io/projected/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-kube-api-access-6bm9t\") pod \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") "
Jul 31 01:09:07.126975 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.126940    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-plugins-config-volume\") pod \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\" (UID: \"6658ee7c-86f6-41fd-8ece-c9fc2108b06a\") "
Jul 31 01:09:07.127199 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.127040    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f43dccb0-4330-4554-b590-1e22e4a6437a-plugins-config-volume\") pod \"f43dccb0-4330-4554-b590-1e22e4a6437a\" (UID: \"f43dccb0-4330-4554-b590-1e22e4a6437a\") "
Jul 31 01:09:07.127199 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.127113    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmsl7\" (UniqueName: \"kubernetes.io/projected/0387a7d3-8a66-4310-be66-5a3828825338-kube-api-access-pmsl7\") pod \"0387a7d3-8a66-4310-be66-5a3828825338\" (UID: \"0387a7d3-8a66-4310-be66-5a3828825338\") "
Jul 31 01:09:07.127199 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.127142    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0387a7d3-8a66-4310-be66-5a3828825338-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0387a7d3-8a66-4310-be66-5a3828825338" (UID: "0387a7d3-8a66-4310-be66-5a3828825338"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:07.127459 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.127419    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0387a7d3-8a66-4310-be66-5a3828825338-openshift-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.127550 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.127495    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6658ee7c-86f6-41fd-8ece-c9fc2108b06a" (UID: "6658ee7c-86f6-41fd-8ece-c9fc2108b06a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:07.127550 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.127516    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f43dccb0-4330-4554-b590-1e22e4a6437a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f43dccb0-4330-4554-b590-1e22e4a6437a" (UID: "f43dccb0-4330-4554-b590-1e22e4a6437a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:07.129632 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.129611    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-kube-api-access-6bm9t" (OuterVolumeSpecName: "kube-api-access-6bm9t") pod "6658ee7c-86f6-41fd-8ece-c9fc2108b06a" (UID: "6658ee7c-86f6-41fd-8ece-c9fc2108b06a"). InnerVolumeSpecName "kube-api-access-6bm9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:07.129722 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.129628    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f43dccb0-4330-4554-b590-1e22e4a6437a-kube-api-access-bnjxp" (OuterVolumeSpecName: "kube-api-access-bnjxp") pod "f43dccb0-4330-4554-b590-1e22e4a6437a" (UID: "f43dccb0-4330-4554-b590-1e22e4a6437a"). InnerVolumeSpecName "kube-api-access-bnjxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:07.129722 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.129635    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0387a7d3-8a66-4310-be66-5a3828825338-kube-api-access-pmsl7" (OuterVolumeSpecName: "kube-api-access-pmsl7") pod "0387a7d3-8a66-4310-be66-5a3828825338" (UID: "0387a7d3-8a66-4310-be66-5a3828825338"). InnerVolumeSpecName "kube-api-access-pmsl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:07.129879 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.129863    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0387a7d3-8a66-4310-be66-5a3828825338" (UID: "0387a7d3-8a66-4310-be66-5a3828825338"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:09:07.228830 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.228732    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f43dccb0-4330-4554-b590-1e22e4a6437a-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.228830 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.228787    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmsl7\" (UniqueName: \"kubernetes.io/projected/0387a7d3-8a66-4310-be66-5a3828825338-kube-api-access-pmsl7\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.228830 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.228798    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0387a7d3-8a66-4310-be66-5a3828825338-maas-api-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.228830 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.228807    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnjxp\" (UniqueName: \"kubernetes.io/projected/f43dccb0-4330-4554-b590-1e22e4a6437a-kube-api-access-bnjxp\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.228830 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.228815    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bm9t\" (UniqueName: \"kubernetes.io/projected/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-kube-api-access-6bm9t\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.228830 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.228823    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6658ee7c-86f6-41fd-8ece-c9fc2108b06a-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:07.357371 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.357339    2555 generic.go:356] "Generic (PLEG): container finished" podID="6658ee7c-86f6-41fd-8ece-c9fc2108b06a" containerID="f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b" exitCode=0
Jul 31 01:09:07.357529 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.357384    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"
Jul 31 01:09:07.357529 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.357429    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg" event={"ID":"6658ee7c-86f6-41fd-8ece-c9fc2108b06a","Type":"ContainerDied","Data":"f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b"}
Jul 31 01:09:07.357529 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.357479    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg" event={"ID":"6658ee7c-86f6-41fd-8ece-c9fc2108b06a","Type":"ContainerDied","Data":"39278610183b9526a6a991cebd20a2c017aae6d7bd26c097b135e1ea5a5892b7"}
Jul 31 01:09:07.357684 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.357509    2555 scope.go:117] "RemoveContainer" containerID="f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b"
Jul 31 01:09:07.359027 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.359006    2555 generic.go:356] "Generic (PLEG): container finished" podID="0387a7d3-8a66-4310-be66-5a3828825338" containerID="641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9" exitCode=0
Jul 31 01:09:07.359158 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.359037    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"
Jul 31 01:09:07.359158 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.359105    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" event={"ID":"0387a7d3-8a66-4310-be66-5a3828825338","Type":"ContainerDied","Data":"641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9"}
Jul 31 01:09:07.359158 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.359146    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8" event={"ID":"0387a7d3-8a66-4310-be66-5a3828825338","Type":"ContainerDied","Data":"8de06a6703d214df48e9a2713f0ad0ef1d12949f233b0e4c23479add3041ae83"}
Jul 31 01:09:07.360818 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.360796    2555 generic.go:356] "Generic (PLEG): container finished" podID="f43dccb0-4330-4554-b590-1e22e4a6437a" containerID="197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467" exitCode=0
Jul 31 01:09:07.361006 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.360833    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q" event={"ID":"f43dccb0-4330-4554-b590-1e22e4a6437a","Type":"ContainerDied","Data":"197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467"}
Jul 31 01:09:07.361006 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.360838    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"
Jul 31 01:09:07.361006 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.360861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q" event={"ID":"f43dccb0-4330-4554-b590-1e22e4a6437a","Type":"ContainerDied","Data":"b5bf5e7f81f7a4d09d00790a798bcb773cdded481d66fd9b1b745d511ecb76ec"}
Jul 31 01:09:07.367902 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.367851    2555 scope.go:117] "RemoveContainer" containerID="f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b"
Jul 31 01:09:07.368178 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:09:07.368160    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b\": container with ID starting with f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b not found: ID does not exist" containerID="f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b"
Jul 31 01:09:07.368266 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.368187    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b"} err="failed to get container status \"f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b\": rpc error: code = NotFound desc = could not find container \"f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b\": container with ID starting with f32f0a4f992d38701017c2b2be8808e105a68f7ca888bdac1a1826c49bcbd21b not found: ID does not exist"
Jul 31 01:09:07.368266 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.368218    2555 scope.go:117] "RemoveContainer" containerID="641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9"
Jul 31 01:09:07.379151 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.379132    2555 scope.go:117] "RemoveContainer" containerID="641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9"
Jul 31 01:09:07.379429 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:09:07.379411    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9\": container with ID starting with 641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9 not found: ID does not exist" containerID="641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9"
Jul 31 01:09:07.379506 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.379440    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9"} err="failed to get container status \"641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9\": rpc error: code = NotFound desc = could not find container \"641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9\": container with ID starting with 641a6a939119fc5383b0080e2d25eef519aa4910841b1151c5df9825e511cde9 not found: ID does not exist"
Jul 31 01:09:07.379506 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.379464    2555 scope.go:117] "RemoveContainer" containerID="197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467"
Jul 31 01:09:07.387824 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.387804    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"]
Jul 31 01:09:07.389049 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.389027    2555 scope.go:117] "RemoveContainer" containerID="197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467"
Jul 31 01:09:07.389330 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:09:07.389309    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467\": container with ID starting with 197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467 not found: ID does not exist" containerID="197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467"
Jul 31 01:09:07.389405 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.389338    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467"} err="failed to get container status \"197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467\": rpc error: code = NotFound desc = could not find container \"197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467\": container with ID starting with 197e25a4fdfd6fbbb55dd6396271d95a78aecf26b5cdb84bbc850b93244f9467 not found: ID does not exist"
Jul 31 01:09:07.390398 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.390381    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-689edf-c8b6bcbb5-x77t8"]
Jul 31 01:09:07.397430 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.397413    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"]
Jul 31 01:09:07.400994 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.400976    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-689edf-586bc88cd8-5dbpg"]
Jul 31 01:09:07.409272 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.409246    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"]
Jul 31 01:09:07.411037 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.411019    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-689edf-8b6fc8748-2jb5q"]
Jul 31 01:09:07.868024 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.867981    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0387a7d3-8a66-4310-be66-5a3828825338" path="/var/lib/kubelet/pods/0387a7d3-8a66-4310-be66-5a3828825338/volumes"
Jul 31 01:09:07.868536 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.868515    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6658ee7c-86f6-41fd-8ece-c9fc2108b06a" path="/var/lib/kubelet/pods/6658ee7c-86f6-41fd-8ece-c9fc2108b06a/volumes"
Jul 31 01:09:07.868905 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.868886    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4e3452d-f37d-4fae-82c9-37c5cde0cd51" path="/var/lib/kubelet/pods/a4e3452d-f37d-4fae-82c9-37c5cde0cd51/volumes"
Jul 31 01:09:07.869285 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:07.869266    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f43dccb0-4330-4554-b590-1e22e4a6437a" path="/var/lib/kubelet/pods/f43dccb0-4330-4554-b590-1e22e4a6437a/volumes"
Jul 31 01:09:16.872248 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872214    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"]
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872660    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0387a7d3-8a66-4310-be66-5a3828825338" containerName="maas-api"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872672    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0387a7d3-8a66-4310-be66-5a3828825338" containerName="maas-api"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872683    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6658ee7c-86f6-41fd-8ece-c9fc2108b06a" containerName="payload-processing"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872689    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6658ee7c-86f6-41fd-8ece-c9fc2108b06a" containerName="payload-processing"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872697    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e3452d-f37d-4fae-82c9-37c5cde0cd51" containerName="revoke-keys"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872702    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e3452d-f37d-4fae-82c9-37c5cde0cd51" containerName="revoke-keys"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872710    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f43dccb0-4330-4554-b590-1e22e4a6437a" containerName="payload-pre-processing"
Jul 31 01:09:16.872710 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872715    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f43dccb0-4330-4554-b590-1e22e4a6437a" containerName="payload-pre-processing"
Jul 31 01:09:16.873153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872802    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f43dccb0-4330-4554-b590-1e22e4a6437a" containerName="payload-pre-processing"
Jul 31 01:09:16.873153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872811    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e3452d-f37d-4fae-82c9-37c5cde0cd51" containerName="revoke-keys"
Jul 31 01:09:16.873153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872818    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6658ee7c-86f6-41fd-8ece-c9fc2108b06a" containerName="payload-processing"
Jul 31 01:09:16.873153 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.872824    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0387a7d3-8a66-4310-be66-5a3828825338" containerName="maas-api"
Jul 31 01:09:16.878548 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.878517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:16.880339 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.880319    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 01:09:16.881120 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.881091    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"]
Jul 31 01:09:16.918094 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:16.918067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e84d26-8e12-436c-a651-9cdcebf67e03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn\" (UID: \"83e84d26-8e12-436c-a651-9cdcebf67e03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:17.019432 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:17.019403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e84d26-8e12-436c-a651-9cdcebf67e03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn\" (UID: \"83e84d26-8e12-436c-a651-9cdcebf67e03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:17.020087 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:17.020067    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e84d26-8e12-436c-a651-9cdcebf67e03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn\" (UID: \"83e84d26-8e12-436c-a651-9cdcebf67e03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:17.191487 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:17.191451    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:17.334629 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:17.334607    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"]
Jul 31 01:09:17.338188 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:09:17.338158    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e84d26_8e12_436c_a651_9cdcebf67e03.slice/crio-2fa038c0a00b45026554b7b5a9d56d263c5e2f3e820e58b71fa853b9e0278c23 WatchSource:0}: Error finding container 2fa038c0a00b45026554b7b5a9d56d263c5e2f3e820e58b71fa853b9e0278c23: Status 404 returned error can't find the container with id 2fa038c0a00b45026554b7b5a9d56d263c5e2f3e820e58b71fa853b9e0278c23
Jul 31 01:09:17.421916 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:17.421885    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn" event={"ID":"83e84d26-8e12-436c-a651-9cdcebf67e03","Type":"ContainerStarted","Data":"2fa038c0a00b45026554b7b5a9d56d263c5e2f3e820e58b71fa853b9e0278c23"}
Jul 31 01:09:18.429740 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:18.429703    2555 generic.go:356] "Generic (PLEG): container finished" podID="83e84d26-8e12-436c-a651-9cdcebf67e03" containerID="595fc070054e314ee81f94b874f946ac39bad047b91bb8e810e21dfbb0f99b26" exitCode=0
Jul 31 01:09:18.430159 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:18.429798    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn" event={"ID":"83e84d26-8e12-436c-a651-9cdcebf67e03","Type":"ContainerDied","Data":"595fc070054e314ee81f94b874f946ac39bad047b91bb8e810e21dfbb0f99b26"}
Jul 31 01:09:19.579407 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:19.579382    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:19.642063 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:19.642035    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e84d26-8e12-436c-a651-9cdcebf67e03-maas-api-service-ca\") pod \"83e84d26-8e12-436c-a651-9cdcebf67e03\" (UID: \"83e84d26-8e12-436c-a651-9cdcebf67e03\") "
Jul 31 01:09:19.642450 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:19.642418    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e84d26-8e12-436c-a651-9cdcebf67e03-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83e84d26-8e12-436c-a651-9cdcebf67e03" (UID: "83e84d26-8e12-436c-a651-9cdcebf67e03"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:19.742899 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:19.742827    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83e84d26-8e12-436c-a651-9cdcebf67e03-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:20.441719 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:20.441688    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"
Jul 31 01:09:20.441925 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:20.441725    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn" event={"ID":"83e84d26-8e12-436c-a651-9cdcebf67e03","Type":"ContainerDied","Data":"2fa038c0a00b45026554b7b5a9d56d263c5e2f3e820e58b71fa853b9e0278c23"}
Jul 31 01:09:20.441925 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:20.441790    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fa038c0a00b45026554b7b5a9d56d263c5e2f3e820e58b71fa853b9e0278c23"
Jul 31 01:09:32.550954 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.550869    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"]
Jul 31 01:09:32.551450 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.551099    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m" podUID="82aed3d1-4751-4928-b59d-46627783beea" containerName="payload-processing" containerID="cri-o://62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21" gracePeriod=30
Jul 31 01:09:32.558623 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.558595    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"]
Jul 31 01:09:32.558883 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.558852    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl" podUID="9ed99196-61f1-432d-a584-df21ca05f29c" containerName="payload-pre-processing" containerID="cri-o://ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801" gracePeriod=30
Jul 31 01:09:32.693848 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.693809    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"]
Jul 31 01:09:32.696082 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.696062    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2b1008-xsdbn"]
Jul 31 01:09:32.812206 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.812141    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:09:32.848053 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.848024    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:09:32.961567 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.961537    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp927\" (UniqueName: \"kubernetes.io/projected/82aed3d1-4751-4928-b59d-46627783beea-kube-api-access-cp927\") pod \"82aed3d1-4751-4928-b59d-46627783beea\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") "
Jul 31 01:09:32.961733 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.961593    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82aed3d1-4751-4928-b59d-46627783beea-plugins-config-volume\") pod \"82aed3d1-4751-4928-b59d-46627783beea\" (UID: \"82aed3d1-4751-4928-b59d-46627783beea\") "
Jul 31 01:09:32.961733 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.961664    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmxxs\" (UniqueName: \"kubernetes.io/projected/9ed99196-61f1-432d-a584-df21ca05f29c-kube-api-access-wmxxs\") pod \"9ed99196-61f1-432d-a584-df21ca05f29c\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") "
Jul 31 01:09:32.961733 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.961716    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ed99196-61f1-432d-a584-df21ca05f29c-plugins-config-volume\") pod \"9ed99196-61f1-432d-a584-df21ca05f29c\" (UID: \"9ed99196-61f1-432d-a584-df21ca05f29c\") "
Jul 31 01:09:32.962087 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.962061    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82aed3d1-4751-4928-b59d-46627783beea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82aed3d1-4751-4928-b59d-46627783beea" (UID: "82aed3d1-4751-4928-b59d-46627783beea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:32.962190 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.962147    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed99196-61f1-432d-a584-df21ca05f29c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ed99196-61f1-432d-a584-df21ca05f29c" (UID: "9ed99196-61f1-432d-a584-df21ca05f29c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:32.963976 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.963943    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82aed3d1-4751-4928-b59d-46627783beea-kube-api-access-cp927" (OuterVolumeSpecName: "kube-api-access-cp927") pod "82aed3d1-4751-4928-b59d-46627783beea" (UID: "82aed3d1-4751-4928-b59d-46627783beea"). InnerVolumeSpecName "kube-api-access-cp927". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:32.963976 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:32.963970    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed99196-61f1-432d-a584-df21ca05f29c-kube-api-access-wmxxs" (OuterVolumeSpecName: "kube-api-access-wmxxs") pod "9ed99196-61f1-432d-a584-df21ca05f29c" (UID: "9ed99196-61f1-432d-a584-df21ca05f29c"). InnerVolumeSpecName "kube-api-access-wmxxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:33.063073 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.063004    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82aed3d1-4751-4928-b59d-46627783beea-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.063073 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.063028    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmxxs\" (UniqueName: \"kubernetes.io/projected/9ed99196-61f1-432d-a584-df21ca05f29c-kube-api-access-wmxxs\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.063073 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.063037    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ed99196-61f1-432d-a584-df21ca05f29c-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.063073 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.063046    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp927\" (UniqueName: \"kubernetes.io/projected/82aed3d1-4751-4928-b59d-46627783beea-kube-api-access-cp927\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.514373 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.514333    2555 generic.go:356] "Generic (PLEG): container finished" podID="9ed99196-61f1-432d-a584-df21ca05f29c" containerID="ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801" exitCode=0
Jul 31 01:09:33.514674 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.514381    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"
Jul 31 01:09:33.514674 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.514426    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl" event={"ID":"9ed99196-61f1-432d-a584-df21ca05f29c","Type":"ContainerDied","Data":"ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801"}
Jul 31 01:09:33.514674 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.514475    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl" event={"ID":"9ed99196-61f1-432d-a584-df21ca05f29c","Type":"ContainerDied","Data":"e3ca2a7e8d586f629d2cbe29db526f43ff8a0584f56370a729541833d399e761"}
Jul 31 01:09:33.514674 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.514495    2555 scope.go:117] "RemoveContainer" containerID="ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801"
Jul 31 01:09:33.515727 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.515705    2555 generic.go:356] "Generic (PLEG): container finished" podID="82aed3d1-4751-4928-b59d-46627783beea" containerID="62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21" exitCode=0
Jul 31 01:09:33.515869 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.515734    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m" event={"ID":"82aed3d1-4751-4928-b59d-46627783beea","Type":"ContainerDied","Data":"62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21"}
Jul 31 01:09:33.515869 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.515785    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"
Jul 31 01:09:33.515869 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.515794    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m" event={"ID":"82aed3d1-4751-4928-b59d-46627783beea","Type":"ContainerDied","Data":"7dce6cab6f9969eee5dcfe1ca1a38e52ac6e58f0cf58ea2a13112257ba5db478"}
Jul 31 01:09:33.533474 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.533458    2555 scope.go:117] "RemoveContainer" containerID="ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801"
Jul 31 01:09:33.533736 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:09:33.533719    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801\": container with ID starting with ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801 not found: ID does not exist" containerID="ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801"
Jul 31 01:09:33.533804 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.533744    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801"} err="failed to get container status \"ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801\": rpc error: code = NotFound desc = could not find container \"ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801\": container with ID starting with ae46cf44a02c43e6ad9c68ab254b267d9c91814e5c20b48c75075b529fab2801 not found: ID does not exist"
Jul 31 01:09:33.533804 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.533791    2555 scope.go:117] "RemoveContainer" containerID="62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21"
Jul 31 01:09:33.542797 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.542775    2555 scope.go:117] "RemoveContainer" containerID="62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21"
Jul 31 01:09:33.543114 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:09:33.543093    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21\": container with ID starting with 62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21 not found: ID does not exist" containerID="62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21"
Jul 31 01:09:33.543217 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.543120    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21"} err="failed to get container status \"62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21\": rpc error: code = NotFound desc = could not find container \"62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21\": container with ID starting with 62f3a0683bec7cb60df8340dd5bdc7f4c11ddf85a0e2f582819fec9165650f21 not found: ID does not exist"
Jul 31 01:09:33.545065 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.545046    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"]
Jul 31 01:09:33.547870 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.547850    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2b1008-bcbfd9f96-wgm5m"]
Jul 31 01:09:33.557690 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.557667    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"]
Jul 31 01:09:33.561417 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.561394    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2b1008-dcb65dbcb-tl2hl"]
Jul 31 01:09:33.866877 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.866800    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82aed3d1-4751-4928-b59d-46627783beea" path="/var/lib/kubelet/pods/82aed3d1-4751-4928-b59d-46627783beea/volumes"
Jul 31 01:09:33.867120 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.867107    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83e84d26-8e12-436c-a651-9cdcebf67e03" path="/var/lib/kubelet/pods/83e84d26-8e12-436c-a651-9cdcebf67e03/volumes"
Jul 31 01:09:33.867412 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:09:33.867400    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ed99196-61f1-432d-a584-df21ca05f29c" path="/var/lib/kubelet/pods/9ed99196-61f1-432d-a584-df21ca05f29c/volumes"
Jul 31 01:10:35.050730 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.050699    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"]
Jul 31 01:10:35.051215 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051118    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82aed3d1-4751-4928-b59d-46627783beea" containerName="payload-processing"
Jul 31 01:10:35.051215 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051129    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="82aed3d1-4751-4928-b59d-46627783beea" containerName="payload-processing"
Jul 31 01:10:35.051215 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051145    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed99196-61f1-432d-a584-df21ca05f29c" containerName="payload-pre-processing"
Jul 31 01:10:35.051215 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051152    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed99196-61f1-432d-a584-df21ca05f29c" containerName="payload-pre-processing"
Jul 31 01:10:35.051215 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051163    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e84d26-8e12-436c-a651-9cdcebf67e03" containerName="revoke-keys"
Jul 31 01:10:35.051215 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051169    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e84d26-8e12-436c-a651-9cdcebf67e03" containerName="revoke-keys"
Jul 31 01:10:35.051426 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051229    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ed99196-61f1-432d-a584-df21ca05f29c" containerName="payload-pre-processing"
Jul 31 01:10:35.051426 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051238    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e84d26-8e12-436c-a651-9cdcebf67e03" containerName="revoke-keys"
Jul 31 01:10:35.051426 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.051245    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="82aed3d1-4751-4928-b59d-46627783beea" containerName="payload-processing"
Jul 31 01:10:35.054344 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.054328    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:35.056008 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.055988    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 01:10:35.060875 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.060839    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"]
Jul 31 01:10:35.125740 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.125707    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c07b3b-3009-4d53-8181-7d60cfbf794d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b\" (UID: \"34c07b3b-3009-4d53-8181-7d60cfbf794d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:35.226503 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.226459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c07b3b-3009-4d53-8181-7d60cfbf794d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b\" (UID: \"34c07b3b-3009-4d53-8181-7d60cfbf794d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:35.227114 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.227095    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c07b3b-3009-4d53-8181-7d60cfbf794d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b\" (UID: \"34c07b3b-3009-4d53-8181-7d60cfbf794d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:35.366867 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.366793    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:35.505130 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.505109    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"]
Jul 31 01:10:35.507503 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:10:35.507477    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c07b3b_3009_4d53_8181_7d60cfbf794d.slice/crio-42787c269830fc9000f5512584b7c151a74a8d8656412f369695d81e20de03cd WatchSource:0}: Error finding container 42787c269830fc9000f5512584b7c151a74a8d8656412f369695d81e20de03cd: Status 404 returned error can't find the container with id 42787c269830fc9000f5512584b7c151a74a8d8656412f369695d81e20de03cd
Jul 31 01:10:35.825268 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.825228    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b" event={"ID":"34c07b3b-3009-4d53-8181-7d60cfbf794d","Type":"ContainerStarted","Data":"1fda42d0cfea9fa6ce73c5c58f40df418b62786169bfe1835cf9970ce24d78e4"}
Jul 31 01:10:35.825458 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.825293    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b" event={"ID":"34c07b3b-3009-4d53-8181-7d60cfbf794d","Type":"ContainerStarted","Data":"42787c269830fc9000f5512584b7c151a74a8d8656412f369695d81e20de03cd"}
Jul 31 01:10:35.839039 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:35.838990    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b" podStartSLOduration=0.838975228 podStartE2EDuration="838.975228ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:10:35.837773504 +0000 UTC m=+3840.561739491" watchObservedRunningTime="2026-07-31 01:10:35.838975228 +0000 UTC m=+3840.562941195"
Jul 31 01:10:36.831257 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:36.831224    2555 generic.go:356] "Generic (PLEG): container finished" podID="34c07b3b-3009-4d53-8181-7d60cfbf794d" containerID="1fda42d0cfea9fa6ce73c5c58f40df418b62786169bfe1835cf9970ce24d78e4" exitCode=0
Jul 31 01:10:36.831634 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:36.831314    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b" event={"ID":"34c07b3b-3009-4d53-8181-7d60cfbf794d","Type":"ContainerDied","Data":"1fda42d0cfea9fa6ce73c5c58f40df418b62786169bfe1835cf9970ce24d78e4"}
Jul 31 01:10:37.980290 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:37.980265    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:38.049615 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:38.049580    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c07b3b-3009-4d53-8181-7d60cfbf794d-maas-api-service-ca\") pod \"34c07b3b-3009-4d53-8181-7d60cfbf794d\" (UID: \"34c07b3b-3009-4d53-8181-7d60cfbf794d\") "
Jul 31 01:10:38.049934 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:38.049911    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c07b3b-3009-4d53-8181-7d60cfbf794d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34c07b3b-3009-4d53-8181-7d60cfbf794d" (UID: "34c07b3b-3009-4d53-8181-7d60cfbf794d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:10:38.150848 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:38.150742    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c07b3b-3009-4d53-8181-7d60cfbf794d-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:10:38.842624 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:38.842595    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"
Jul 31 01:10:38.842624 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:38.842610    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b" event={"ID":"34c07b3b-3009-4d53-8181-7d60cfbf794d","Type":"ContainerDied","Data":"42787c269830fc9000f5512584b7c151a74a8d8656412f369695d81e20de03cd"}
Jul 31 01:10:38.842872 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:38.842678    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42787c269830fc9000f5512584b7c151a74a8d8656412f369695d81e20de03cd"
Jul 31 01:10:45.506035 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.505999    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"]
Jul 31 01:10:45.506607 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.506298    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv" podUID="329c0e7c-7a89-47da-84b7-bc6e71e23202" containerName="payload-processing" containerID="cri-o://9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7" gracePeriod=30
Jul 31 01:10:45.513141 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.513117    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"]
Jul 31 01:10:45.513571 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.513521    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns" podUID="8ae92608-61b3-4c2a-9d88-54138d3e7a8a" containerName="payload-pre-processing" containerID="cri-o://f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9" gracePeriod=30
Jul 31 01:10:45.650071 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.650015    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"]
Jul 31 01:10:45.651946 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.651922    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0f1466-pmw9b"]
Jul 31 01:10:45.775768 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.775733    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:10:45.803428 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.803403    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:10:45.819284 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.819258    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrlzl\" (UniqueName: \"kubernetes.io/projected/329c0e7c-7a89-47da-84b7-bc6e71e23202-kube-api-access-jrlzl\") pod \"329c0e7c-7a89-47da-84b7-bc6e71e23202\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") "
Jul 31 01:10:45.819424 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.819315    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329c0e7c-7a89-47da-84b7-bc6e71e23202-plugins-config-volume\") pod \"329c0e7c-7a89-47da-84b7-bc6e71e23202\" (UID: \"329c0e7c-7a89-47da-84b7-bc6e71e23202\") "
Jul 31 01:10:45.820056 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.820023    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329c0e7c-7a89-47da-84b7-bc6e71e23202-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "329c0e7c-7a89-47da-84b7-bc6e71e23202" (UID: "329c0e7c-7a89-47da-84b7-bc6e71e23202"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:10:45.821698 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.821667    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/329c0e7c-7a89-47da-84b7-bc6e71e23202-kube-api-access-jrlzl" (OuterVolumeSpecName: "kube-api-access-jrlzl") pod "329c0e7c-7a89-47da-84b7-bc6e71e23202" (UID: "329c0e7c-7a89-47da-84b7-bc6e71e23202"). InnerVolumeSpecName "kube-api-access-jrlzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:10:45.868428 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.868398    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c07b3b-3009-4d53-8181-7d60cfbf794d" path="/var/lib/kubelet/pods/34c07b3b-3009-4d53-8181-7d60cfbf794d/volumes"
Jul 31 01:10:45.879829 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.879808    2555 generic.go:356] "Generic (PLEG): container finished" podID="329c0e7c-7a89-47da-84b7-bc6e71e23202" containerID="9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7" exitCode=0
Jul 31 01:10:45.879930 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.879850    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"
Jul 31 01:10:45.879930 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.879895    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv" event={"ID":"329c0e7c-7a89-47da-84b7-bc6e71e23202","Type":"ContainerDied","Data":"9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7"}
Jul 31 01:10:45.880029 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.879942    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv" event={"ID":"329c0e7c-7a89-47da-84b7-bc6e71e23202","Type":"ContainerDied","Data":"445e8b898e99076e52127c405b4aac607c58b9ea8780814a4660e4bd18f967af"}
Jul 31 01:10:45.880029 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.879979    2555 scope.go:117] "RemoveContainer" containerID="9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7"
Jul 31 01:10:45.881298 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.881278    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae92608-61b3-4c2a-9d88-54138d3e7a8a" containerID="f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9" exitCode=0
Jul 31 01:10:45.881567 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.881316    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"
Jul 31 01:10:45.881567 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.881375    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns" event={"ID":"8ae92608-61b3-4c2a-9d88-54138d3e7a8a","Type":"ContainerDied","Data":"f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9"}
Jul 31 01:10:45.881567 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.881434    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns" event={"ID":"8ae92608-61b3-4c2a-9d88-54138d3e7a8a","Type":"ContainerDied","Data":"85c05181014e90325d683789c693d3fe9c791950600ee0cb45c8a84d6370e500"}
Jul 31 01:10:45.888969 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.888949    2555 scope.go:117] "RemoveContainer" containerID="9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7"
Jul 31 01:10:45.889214 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:10:45.889198    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7\": container with ID starting with 9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7 not found: ID does not exist" containerID="9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7"
Jul 31 01:10:45.889259 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.889222    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7"} err="failed to get container status \"9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7\": rpc error: code = NotFound desc = could not find container \"9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7\": container with ID starting with 9c61c6246108823e88b6ef0cb647e34fb3a4adaeac6e7713a7b3f801091ed7b7 not found: ID does not exist"
Jul 31 01:10:45.889259 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.889240    2555 scope.go:117] "RemoveContainer" containerID="f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9"
Jul 31 01:10:45.893730 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.893709    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"]
Jul 31 01:10:45.897563 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.897545    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0f1466-7645fd5594-dvdqv"]
Jul 31 01:10:45.898055 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.898043    2555 scope.go:117] "RemoveContainer" containerID="f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9"
Jul 31 01:10:45.898306 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:10:45.898287    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9\": container with ID starting with f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9 not found: ID does not exist" containerID="f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9"
Jul 31 01:10:45.898366 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.898316    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9"} err="failed to get container status \"f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9\": rpc error: code = NotFound desc = could not find container \"f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9\": container with ID starting with f86595fa315a0ccb73f3ca08bc823ea196578a3bde16a016cedc1bb7f4d587a9 not found: ID does not exist"
Jul 31 01:10:45.920150 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.920130    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swgcn\" (UniqueName: \"kubernetes.io/projected/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-kube-api-access-swgcn\") pod \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") "
Jul 31 01:10:45.920255 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.920233    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-plugins-config-volume\") pod \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\" (UID: \"8ae92608-61b3-4c2a-9d88-54138d3e7a8a\") "
Jul 31 01:10:45.920592 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.920557    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ae92608-61b3-4c2a-9d88-54138d3e7a8a" (UID: "8ae92608-61b3-4c2a-9d88-54138d3e7a8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:10:45.920696 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.920628    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrlzl\" (UniqueName: \"kubernetes.io/projected/329c0e7c-7a89-47da-84b7-bc6e71e23202-kube-api-access-jrlzl\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:10:45.920696 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.920648    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329c0e7c-7a89-47da-84b7-bc6e71e23202-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:10:45.922328 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:45.922303    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-kube-api-access-swgcn" (OuterVolumeSpecName: "kube-api-access-swgcn") pod "8ae92608-61b3-4c2a-9d88-54138d3e7a8a" (UID: "8ae92608-61b3-4c2a-9d88-54138d3e7a8a"). InnerVolumeSpecName "kube-api-access-swgcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:10:46.022008 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:46.021926    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:10:46.022008 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:46.021953    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swgcn\" (UniqueName: \"kubernetes.io/projected/8ae92608-61b3-4c2a-9d88-54138d3e7a8a-kube-api-access-swgcn\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:10:46.202243 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:46.202215    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"]
Jul 31 01:10:46.206075 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:46.206047    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0f1466-7888467c4d-9d4ns"]
Jul 31 01:10:47.867505 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:47.867470    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="329c0e7c-7a89-47da-84b7-bc6e71e23202" path="/var/lib/kubelet/pods/329c0e7c-7a89-47da-84b7-bc6e71e23202/volumes"
Jul 31 01:10:47.867892 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:47.867842    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae92608-61b3-4c2a-9d88-54138d3e7a8a" path="/var/lib/kubelet/pods/8ae92608-61b3-4c2a-9d88-54138d3e7a8a/volumes"
Jul 31 01:10:52.400835 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.400800    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"]
Jul 31 01:10:52.401265 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401192    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae92608-61b3-4c2a-9d88-54138d3e7a8a" containerName="payload-pre-processing"
Jul 31 01:10:52.401265 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401203    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae92608-61b3-4c2a-9d88-54138d3e7a8a" containerName="payload-pre-processing"
Jul 31 01:10:52.401265 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401216    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329c0e7c-7a89-47da-84b7-bc6e71e23202" containerName="payload-processing"
Jul 31 01:10:52.401265 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401221    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="329c0e7c-7a89-47da-84b7-bc6e71e23202" containerName="payload-processing"
Jul 31 01:10:52.401265 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401228    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c07b3b-3009-4d53-8181-7d60cfbf794d" containerName="revoke-keys"
Jul 31 01:10:52.401265 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401234    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c07b3b-3009-4d53-8181-7d60cfbf794d" containerName="revoke-keys"
Jul 31 01:10:52.401467 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401303    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c07b3b-3009-4d53-8181-7d60cfbf794d" containerName="revoke-keys"
Jul 31 01:10:52.401467 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401313    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="329c0e7c-7a89-47da-84b7-bc6e71e23202" containerName="payload-processing"
Jul 31 01:10:52.401467 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.401320    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae92608-61b3-4c2a-9d88-54138d3e7a8a" containerName="payload-pre-processing"
Jul 31 01:10:52.404323 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.404306    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:52.406182 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.406166    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 01:10:52.409881 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.409846    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"]
Jul 31 01:10:52.480718 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.480674    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb9de0f-78fc-41ed-9523-c73d3e09f521-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87\" (UID: \"7cb9de0f-78fc-41ed-9523-c73d3e09f521\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:52.581441 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.581398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb9de0f-78fc-41ed-9523-c73d3e09f521-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87\" (UID: \"7cb9de0f-78fc-41ed-9523-c73d3e09f521\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:52.582050 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.582029    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb9de0f-78fc-41ed-9523-c73d3e09f521-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87\" (UID: \"7cb9de0f-78fc-41ed-9523-c73d3e09f521\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:52.715804 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:52.715774    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:53.055458 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:53.055435    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"]
Jul 31 01:10:53.057346 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:10:53.057318    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb9de0f_78fc_41ed_9523_c73d3e09f521.slice/crio-d897385506bdc5fbe2e7fe0b8b40fb75aafe0dcccd85556e16a65fe2d79c91b1 WatchSource:0}: Error finding container d897385506bdc5fbe2e7fe0b8b40fb75aafe0dcccd85556e16a65fe2d79c91b1: Status 404 returned error can't find the container with id d897385506bdc5fbe2e7fe0b8b40fb75aafe0dcccd85556e16a65fe2d79c91b1
Jul 31 01:10:53.925372 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:53.925336    2555 generic.go:356] "Generic (PLEG): container finished" podID="7cb9de0f-78fc-41ed-9523-c73d3e09f521" containerID="9b4549da159e0edb9e58837c78e0bb020a442603ee4a70f6c9460f12e100da6c" exitCode=0
Jul 31 01:10:53.925749 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:53.925420    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87" event={"ID":"7cb9de0f-78fc-41ed-9523-c73d3e09f521","Type":"ContainerDied","Data":"9b4549da159e0edb9e58837c78e0bb020a442603ee4a70f6c9460f12e100da6c"}
Jul 31 01:10:53.925749 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:53.925475    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87" event={"ID":"7cb9de0f-78fc-41ed-9523-c73d3e09f521","Type":"ContainerStarted","Data":"d897385506bdc5fbe2e7fe0b8b40fb75aafe0dcccd85556e16a65fe2d79c91b1"}
Jul 31 01:10:55.064941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.064912    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:55.205304 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.205214    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb9de0f-78fc-41ed-9523-c73d3e09f521-maas-api-service-ca\") pod \"7cb9de0f-78fc-41ed-9523-c73d3e09f521\" (UID: \"7cb9de0f-78fc-41ed-9523-c73d3e09f521\") "
Jul 31 01:10:55.205548 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.205527    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb9de0f-78fc-41ed-9523-c73d3e09f521-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cb9de0f-78fc-41ed-9523-c73d3e09f521" (UID: "7cb9de0f-78fc-41ed-9523-c73d3e09f521"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:10:55.306704 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.306652    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb9de0f-78fc-41ed-9523-c73d3e09f521-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:10:55.937088 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.937063    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"
Jul 31 01:10:55.937088 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.937068    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87" event={"ID":"7cb9de0f-78fc-41ed-9523-c73d3e09f521","Type":"ContainerDied","Data":"d897385506bdc5fbe2e7fe0b8b40fb75aafe0dcccd85556e16a65fe2d79c91b1"}
Jul 31 01:10:55.937280 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:10:55.937114    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d897385506bdc5fbe2e7fe0b8b40fb75aafe0dcccd85556e16a65fe2d79c91b1"
Jul 31 01:11:02.812388 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.812354    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"]
Jul 31 01:11:02.816051 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.816031    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2164-29757660-kk596"]
Jul 31 01:11:02.840821 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.840795    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"]
Jul 31 01:11:02.841028 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.840998    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b" podUID="8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" containerName="payload-processing" containerID="cri-o://55fb4f7c57bba6004e5dbcdd155ed4714d80c02e52beb14ff35c30fbfb8007aa" gracePeriod=30
Jul 31 01:11:02.849185 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.849149    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"]
Jul 31 01:11:02.849393 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.849364    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j" podUID="2cceb1e7-6e7e-4ba5-af21-b9c65609a132" containerName="payload-pre-processing" containerID="cri-o://089c6932132b31fe7cb5465eac30c6ec1479612140e0bbe14ade3ecbd0fd2b73" gracePeriod=30
Jul 31 01:11:02.975031 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.974999    2555 generic.go:356] "Generic (PLEG): container finished" podID="8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" containerID="55fb4f7c57bba6004e5dbcdd155ed4714d80c02e52beb14ff35c30fbfb8007aa" exitCode=0
Jul 31 01:11:02.975188 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.975077    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b" event={"ID":"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40","Type":"ContainerDied","Data":"55fb4f7c57bba6004e5dbcdd155ed4714d80c02e52beb14ff35c30fbfb8007aa"}
Jul 31 01:11:02.976725 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.976703    2555 generic.go:356] "Generic (PLEG): container finished" podID="2cceb1e7-6e7e-4ba5-af21-b9c65609a132" containerID="089c6932132b31fe7cb5465eac30c6ec1479612140e0bbe14ade3ecbd0fd2b73" exitCode=0
Jul 31 01:11:02.976895 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.976811    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j" event={"ID":"2cceb1e7-6e7e-4ba5-af21-b9c65609a132","Type":"ContainerDied","Data":"089c6932132b31fe7cb5465eac30c6ec1479612140e0bbe14ade3ecbd0fd2b73"}
Jul 31 01:11:02.988260 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.988230    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"]
Jul 31 01:11:02.991335 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:02.991313    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2164-7dc87"]
Jul 31 01:11:03.100040 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.100015    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 01:11:03.138567 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.138541    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 01:11:03.174423 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.174387    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-682kl\" (UniqueName: \"kubernetes.io/projected/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-kube-api-access-682kl\") pod \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") "
Jul 31 01:11:03.174574 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.174534    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-plugins-config-volume\") pod \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\" (UID: \"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40\") "
Jul 31 01:11:03.174931 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.174902    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" (UID: "8e4039ab-9b8e-4549-ad0d-5b42c69bfb40"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:03.176483 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.176453    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-kube-api-access-682kl" (OuterVolumeSpecName: "kube-api-access-682kl") pod "8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" (UID: "8e4039ab-9b8e-4549-ad0d-5b42c69bfb40"). InnerVolumeSpecName "kube-api-access-682kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:03.275829 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.275795    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmb6n\" (UniqueName: \"kubernetes.io/projected/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-kube-api-access-gmb6n\") pod \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") "
Jul 31 01:11:03.275993 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.275844    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-plugins-config-volume\") pod \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\" (UID: \"2cceb1e7-6e7e-4ba5-af21-b9c65609a132\") "
Jul 31 01:11:03.276090 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.276072    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.276128 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.276098    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-682kl\" (UniqueName: \"kubernetes.io/projected/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40-kube-api-access-682kl\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.276272 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.276239    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2cceb1e7-6e7e-4ba5-af21-b9c65609a132" (UID: "2cceb1e7-6e7e-4ba5-af21-b9c65609a132"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:03.278070 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.278048    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-kube-api-access-gmb6n" (OuterVolumeSpecName: "kube-api-access-gmb6n") pod "2cceb1e7-6e7e-4ba5-af21-b9c65609a132" (UID: "2cceb1e7-6e7e-4ba5-af21-b9c65609a132"). InnerVolumeSpecName "kube-api-access-gmb6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:03.377244 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.377178    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmb6n\" (UniqueName: \"kubernetes.io/projected/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-kube-api-access-gmb6n\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.377244 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.377204    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cceb1e7-6e7e-4ba5-af21-b9c65609a132-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.867355 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.867324    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ea34723-312c-4a21-9172-7532615a9305" path="/var/lib/kubelet/pods/2ea34723-312c-4a21-9172-7532615a9305/volumes"
Jul 31 01:11:03.867682 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.867607    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb9de0f-78fc-41ed-9523-c73d3e09f521" path="/var/lib/kubelet/pods/7cb9de0f-78fc-41ed-9523-c73d3e09f521/volumes"
Jul 31 01:11:03.983476 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.983448    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"
Jul 31 01:11:03.983638 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.983448    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b" event={"ID":"8e4039ab-9b8e-4549-ad0d-5b42c69bfb40","Type":"ContainerDied","Data":"954fcd4ea9939748ac057797be6d273a9bf61f5a25ac77e4f436e273851aaf3e"}
Jul 31 01:11:03.983638 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.983582    2555 scope.go:117] "RemoveContainer" containerID="55fb4f7c57bba6004e5dbcdd155ed4714d80c02e52beb14ff35c30fbfb8007aa"
Jul 31 01:11:03.984841 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.984810    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"
Jul 31 01:11:03.984905 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.984851    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j" event={"ID":"2cceb1e7-6e7e-4ba5-af21-b9c65609a132","Type":"ContainerDied","Data":"20b944bbf2e2f9d5bfcbe97c9d252330b780d86d19478a243a4e9fc0895a81cc"}
Jul 31 01:11:03.992644 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.992622    2555 scope.go:117] "RemoveContainer" containerID="089c6932132b31fe7cb5465eac30c6ec1479612140e0bbe14ade3ecbd0fd2b73"
Jul 31 01:11:03.999736 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:03.999484    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"]
Jul 31 01:11:04.001940 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:04.001918    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-6a2164-5c5b67f4d8-mzq5j"]
Jul 31 01:11:04.010038 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:04.010018    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"]
Jul 31 01:11:04.012234 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:04.012217    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a2164-79d8fd9bc8-klr6b"]
Jul 31 01:11:05.866927 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:05.866896    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cceb1e7-6e7e-4ba5-af21-b9c65609a132" path="/var/lib/kubelet/pods/2cceb1e7-6e7e-4ba5-af21-b9c65609a132/volumes"
Jul 31 01:11:05.867320 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:05.867229    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" path="/var/lib/kubelet/pods/8e4039ab-9b8e-4549-ad0d-5b42c69bfb40/volumes"
Jul 31 01:11:09.838908 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.838874    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"]
Jul 31 01:11:09.839312 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839267    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb9de0f-78fc-41ed-9523-c73d3e09f521" containerName="revoke-keys"
Jul 31 01:11:09.839312 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839278    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb9de0f-78fc-41ed-9523-c73d3e09f521" containerName="revoke-keys"
Jul 31 01:11:09.839312 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839296    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" containerName="payload-processing"
Jul 31 01:11:09.839312 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839302    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" containerName="payload-processing"
Jul 31 01:11:09.839312 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839313    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cceb1e7-6e7e-4ba5-af21-b9c65609a132" containerName="payload-pre-processing"
Jul 31 01:11:09.839497 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839319    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cceb1e7-6e7e-4ba5-af21-b9c65609a132" containerName="payload-pre-processing"
Jul 31 01:11:09.839497 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839370    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4039ab-9b8e-4549-ad0d-5b42c69bfb40" containerName="payload-processing"
Jul 31 01:11:09.839497 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839379    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb9de0f-78fc-41ed-9523-c73d3e09f521" containerName="revoke-keys"
Jul 31 01:11:09.839497 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.839385    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cceb1e7-6e7e-4ba5-af21-b9c65609a132" containerName="payload-pre-processing"
Jul 31 01:11:09.843951 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.843932    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:09.847140 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.847118    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 01:11:09.847902 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.847830    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"]
Jul 31 01:11:09.932403 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:09.932366    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60419f83-e933-4190-964b-3e3740ad0165-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp\" (UID: \"60419f83-e933-4190-964b-3e3740ad0165\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:10.033663 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:10.033629    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60419f83-e933-4190-964b-3e3740ad0165-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp\" (UID: \"60419f83-e933-4190-964b-3e3740ad0165\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:10.034258 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:10.034237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60419f83-e933-4190-964b-3e3740ad0165-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp\" (UID: \"60419f83-e933-4190-964b-3e3740ad0165\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:10.158445 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:10.158374    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:10.289278 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:10.289243    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"]
Jul 31 01:11:10.290866 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:11:10.290836    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60419f83_e933_4190_964b_3e3740ad0165.slice/crio-5f69aa33df579dc4a8973e8faf32e1f955b4b3ba34c6e5e8b17e13a322e5baab WatchSource:0}: Error finding container 5f69aa33df579dc4a8973e8faf32e1f955b4b3ba34c6e5e8b17e13a322e5baab: Status 404 returned error can't find the container with id 5f69aa33df579dc4a8973e8faf32e1f955b4b3ba34c6e5e8b17e13a322e5baab
Jul 31 01:11:11.023208 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:11.023174    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp" event={"ID":"60419f83-e933-4190-964b-3e3740ad0165","Type":"ContainerStarted","Data":"e55a8a04deb00ac904b21fd7a49d5e847b23e31f0f49e1cdeafb1a4b39157123"}
Jul 31 01:11:11.023558 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:11.023234    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp" event={"ID":"60419f83-e933-4190-964b-3e3740ad0165","Type":"ContainerStarted","Data":"5f69aa33df579dc4a8973e8faf32e1f955b4b3ba34c6e5e8b17e13a322e5baab"}
Jul 31 01:11:11.036878 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:11.036826    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp" podStartSLOduration=2.036806581 podStartE2EDuration="2.036806581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:11:11.036250532 +0000 UTC m=+3875.760216504" watchObservedRunningTime="2026-07-31 01:11:11.036806581 +0000 UTC m=+3875.760772549"
Jul 31 01:11:12.029834 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:12.029795    2555 generic.go:356] "Generic (PLEG): container finished" podID="60419f83-e933-4190-964b-3e3740ad0165" containerID="e55a8a04deb00ac904b21fd7a49d5e847b23e31f0f49e1cdeafb1a4b39157123" exitCode=0
Jul 31 01:11:12.030233 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:12.029888    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp" event={"ID":"60419f83-e933-4190-964b-3e3740ad0165","Type":"ContainerDied","Data":"e55a8a04deb00ac904b21fd7a49d5e847b23e31f0f49e1cdeafb1a4b39157123"}
Jul 31 01:11:13.172844 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:13.172820    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:13.266706 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:13.266674    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60419f83-e933-4190-964b-3e3740ad0165-maas-api-service-ca\") pod \"60419f83-e933-4190-964b-3e3740ad0165\" (UID: \"60419f83-e933-4190-964b-3e3740ad0165\") "
Jul 31 01:11:13.267045 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:13.267023    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60419f83-e933-4190-964b-3e3740ad0165-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60419f83-e933-4190-964b-3e3740ad0165" (UID: "60419f83-e933-4190-964b-3e3740ad0165"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:13.368414 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:13.368334    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60419f83-e933-4190-964b-3e3740ad0165-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.049462 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:14.049429    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"
Jul 31 01:11:14.049609 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:14.049460    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp" event={"ID":"60419f83-e933-4190-964b-3e3740ad0165","Type":"ContainerDied","Data":"5f69aa33df579dc4a8973e8faf32e1f955b4b3ba34c6e5e8b17e13a322e5baab"}
Jul 31 01:11:14.049609 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:14.049529    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f69aa33df579dc4a8973e8faf32e1f955b4b3ba34c6e5e8b17e13a322e5baab"
Jul 31 01:11:20.295697 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.295666    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"]
Jul 31 01:11:20.306063 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.306035    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b32567-29757660-2qpvn"]
Jul 31 01:11:20.324525 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.324496    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"]
Jul 31 01:11:20.324851 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.324806    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv" podUID="aeaf114f-0830-4519-adf2-07b9bd5192df" containerName="payload-processing" containerID="cri-o://5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3" gracePeriod=30
Jul 31 01:11:20.331455 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.331425    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"]
Jul 31 01:11:20.331719 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.331670    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77" podUID="3e65e868-e85f-4e2f-b5d6-651a1d4d540d" containerName="payload-pre-processing" containerID="cri-o://9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa" gracePeriod=30
Jul 31 01:11:20.461640 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.461591    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"]
Jul 31 01:11:20.465199 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.465169    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b32567-9qpwp"]
Jul 31 01:11:20.580989 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.580966    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 01:11:20.613251 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.613230    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 01:11:20.630999 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.630975    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aeaf114f-0830-4519-adf2-07b9bd5192df-plugins-config-volume\") pod \"aeaf114f-0830-4519-adf2-07b9bd5192df\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") "
Jul 31 01:11:20.631185 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631040    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-plugins-config-volume\") pod \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") "
Jul 31 01:11:20.631185 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631079    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnmmr\" (UniqueName: \"kubernetes.io/projected/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-kube-api-access-gnmmr\") pod \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\" (UID: \"3e65e868-e85f-4e2f-b5d6-651a1d4d540d\") "
Jul 31 01:11:20.631185 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631126    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df6n5\" (UniqueName: \"kubernetes.io/projected/aeaf114f-0830-4519-adf2-07b9bd5192df-kube-api-access-df6n5\") pod \"aeaf114f-0830-4519-adf2-07b9bd5192df\" (UID: \"aeaf114f-0830-4519-adf2-07b9bd5192df\") "
Jul 31 01:11:20.631465 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631437    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e65e868-e85f-4e2f-b5d6-651a1d4d540d" (UID: "3e65e868-e85f-4e2f-b5d6-651a1d4d540d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:20.631465 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631450    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeaf114f-0830-4519-adf2-07b9bd5192df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aeaf114f-0830-4519-adf2-07b9bd5192df" (UID: "aeaf114f-0830-4519-adf2-07b9bd5192df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:20.631804 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631783    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aeaf114f-0830-4519-adf2-07b9bd5192df-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:20.631883 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.631809    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:20.633330 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.633304    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-kube-api-access-gnmmr" (OuterVolumeSpecName: "kube-api-access-gnmmr") pod "3e65e868-e85f-4e2f-b5d6-651a1d4d540d" (UID: "3e65e868-e85f-4e2f-b5d6-651a1d4d540d"). InnerVolumeSpecName "kube-api-access-gnmmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:20.633495 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.633474    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeaf114f-0830-4519-adf2-07b9bd5192df-kube-api-access-df6n5" (OuterVolumeSpecName: "kube-api-access-df6n5") pod "aeaf114f-0830-4519-adf2-07b9bd5192df" (UID: "aeaf114f-0830-4519-adf2-07b9bd5192df"). InnerVolumeSpecName "kube-api-access-df6n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:20.732389 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.732356    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnmmr\" (UniqueName: \"kubernetes.io/projected/3e65e868-e85f-4e2f-b5d6-651a1d4d540d-kube-api-access-gnmmr\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:20.732389 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:20.732387    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df6n5\" (UniqueName: \"kubernetes.io/projected/aeaf114f-0830-4519-adf2-07b9bd5192df-kube-api-access-df6n5\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\""
Jul 31 01:11:21.086230 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.086187    2555 generic.go:356] "Generic (PLEG): container finished" podID="aeaf114f-0830-4519-adf2-07b9bd5192df" containerID="5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3" exitCode=0
Jul 31 01:11:21.086437 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.086238    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"
Jul 31 01:11:21.086437 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.086272    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv" event={"ID":"aeaf114f-0830-4519-adf2-07b9bd5192df","Type":"ContainerDied","Data":"5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3"}
Jul 31 01:11:21.086437 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.086329    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv" event={"ID":"aeaf114f-0830-4519-adf2-07b9bd5192df","Type":"ContainerDied","Data":"99329d37f33c898ce11ff30e6ab9ec93fdb5e1087ab5ae70c04a4eca189585ec"}
Jul 31 01:11:21.086437 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.086351    2555 scope.go:117] "RemoveContainer" containerID="5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3"
Jul 31 01:11:21.087551 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.087530    2555 generic.go:356] "Generic (PLEG): container finished" podID="3e65e868-e85f-4e2f-b5d6-651a1d4d540d" containerID="9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa" exitCode=0
Jul 31 01:11:21.087656 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.087568    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"
Jul 31 01:11:21.087656 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.087622    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77" event={"ID":"3e65e868-e85f-4e2f-b5d6-651a1d4d540d","Type":"ContainerDied","Data":"9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa"}
Jul 31 01:11:21.087777 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.087666    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77" event={"ID":"3e65e868-e85f-4e2f-b5d6-651a1d4d540d","Type":"ContainerDied","Data":"2164755ef56794afb26f54c7a2c3a56dbc1ccdfdf8ca093241adef70b3e61951"}
Jul 31 01:11:21.096002 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.095987    2555 scope.go:117] "RemoveContainer" containerID="5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3"
Jul 31 01:11:21.096426 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:11:21.096298    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3\": container with ID starting with 5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3 not found: ID does not exist" containerID="5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3"
Jul 31 01:11:21.096426 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.096332    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3"} err="failed to get container status \"5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3\": rpc error: code = NotFound desc = could not find container \"5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3\": container with ID starting with 5799eb5ce62f5783720e59808da7fe2a6300c7a54ad990dfaa2787b3642ebfb3 not found: ID does not exist"
Jul 31 01:11:21.096426 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.096353    2555 scope.go:117] "RemoveContainer" containerID="9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa"
Jul 31 01:11:21.105081 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.105062    2555 scope.go:117] "RemoveContainer" containerID="9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa"
Jul 31 01:11:21.105316 ip-10-0-129-35 kubenswrapper[2555]: E0731 01:11:21.105297    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa\": container with ID starting with 9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa not found: ID does not exist" containerID="9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa"
Jul 31 01:11:21.105363 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.105323    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa"} err="failed to get container status \"9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa\": rpc error: code = NotFound desc = could not find container \"9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa\": container with ID starting with 9d76da8a5ca903857b0f3ea00eff1cc9e9eabaadeec46d15310c5e3d75e7d1aa not found: ID does not exist"
Jul 31 01:11:21.110616 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.110595    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"]
Jul 31 01:11:21.114206 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.114187    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-b32567-5b88756c76-krs77"]
Jul 31 01:11:21.121911 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.121894    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"]
Jul 31 01:11:21.127241 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.127221    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-b32567-95d568dc4-nhxjv"]
Jul 31 01:11:21.866154 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.866122    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3daac06a-44d8-4218-be5b-610da6001dd7" path="/var/lib/kubelet/pods/3daac06a-44d8-4218-be5b-610da6001dd7/volumes"
Jul 31 01:11:21.866515 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.866432    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e65e868-e85f-4e2f-b5d6-651a1d4d540d" path="/var/lib/kubelet/pods/3e65e868-e85f-4e2f-b5d6-651a1d4d540d/volumes"
Jul 31 01:11:21.866709 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.866696    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60419f83-e933-4190-964b-3e3740ad0165" path="/var/lib/kubelet/pods/60419f83-e933-4190-964b-3e3740ad0165/volumes"
Jul 31 01:11:21.867023 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:21.867011    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeaf114f-0830-4519-adf2-07b9bd5192df" path="/var/lib/kubelet/pods/aeaf114f-0830-4519-adf2-07b9bd5192df/volumes"
Jul 31 01:11:27.580236 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:27.580205    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c56db9f6-f8ht8_f8e474b0-f962-4f6b-b0eb-5785f3e61ada/authorino/0.log"
Jul 31 01:11:33.448401 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:33.448346    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c9699fb4f-96hf9_256331ef-b2ba-48fc-adc9-6595f719bc07/manager/0.log"
Jul 31 01:11:33.965654 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:33.965625    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-j6wd9_0679d330-625d-4264-8f09-e0573bd5837c/copy-manifests/0.log"
Jul 31 01:11:33.973164 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:33.973143    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-j6wd9_0679d330-625d-4264-8f09-e0573bd5837c/manager/0.log"
Jul 31 01:11:34.840381 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:34.840350    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757660-nwrpr_03ef163b-0cc1-4843-bf16-047a840d12ba/cleanup/0.log"
Jul 31 01:11:34.959615 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:34.959589    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5zszg_409563b2-1ddc-47c7-a71a-28be508cf1e6/postgres/0.log"
Jul 31 01:11:35.765604 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:35.765578    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c56db9f6-f8ht8_f8e474b0-f962-4f6b-b0eb-5785f3e61ada/authorino/0.log"
Jul 31 01:11:36.349078 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:36.349046    2555 scope.go:117] "RemoveContainer" containerID="cdd2dfa5f77bfdfcef88bea23165709a8f599845cb7b24b49e6f44d41bcdf924"
Jul 31 01:11:36.357264 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:36.357247    2555 scope.go:117] "RemoveContainer" containerID="907d79c60778e9168d5ad9f6cf25bd6b4cee89015e0ff1739dd40f6d3e872743"
Jul 31 01:11:37.126086 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:37.126055    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6dcbc74-dxcqt_3ff551cf-0096-40a8-b916-691531a9e72e/kube-auth-proxy/0.log"
Jul 31 01:11:37.510499 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:37.510468    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-pfb45_f95298ac-098e-40b3-bb16-de35d3ecab23/payload-pre-processing/0.log"
Jul 31 01:11:37.639829 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:37.639783    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5qk_5648c4a6-8434-4cfc-829e-dc24c83252f6/payload-processing/0.log"
Jul 31 01:11:38.118421 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:38.118395    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hj5pm_f51aa949-2bcf-4be4-902c-03add36c2759/main/0.log"
Jul 31 01:11:38.233349 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:38.233320    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vx8tx_533b8a1a-e47b-433d-8dde-cf8fff30c61d/main/0.log"
Jul 31 01:11:47.343930 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:47.343897    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xkr25_2f7ec3b6-c4b5-4e97-b08f-374dfb1c15e0/global-pull-secret-syncer/0.log"
Jul 31 01:11:47.439599 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:47.439564    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b7ctz_fd10469a-d51d-4155-991e-f157be459a76/konnectivity-agent/0.log"
Jul 31 01:11:47.505413 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:47.505381    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-35.ec2.internal_a2ac76fcfd2a1053c05256ae49c3a18b/haproxy/0.log"
Jul 31 01:11:52.466351 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:52.466312    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c56db9f6-f8ht8_f8e474b0-f962-4f6b-b0eb-5785f3e61ada/authorino/0.log"
Jul 31 01:11:54.430313 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:54.430283    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-qtcqb_c009cf61-0a88-4b6c-b673-6dd00d936515/cluster-monitoring-operator/0.log"
Jul 31 01:11:54.672832 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:54.672741    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9cz8_c2d774ba-82fd-482f-b688-4a47ddd87816/node-exporter/0.log"
Jul 31 01:11:54.693556 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:54.693531    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9cz8_c2d774ba-82fd-482f-b688-4a47ddd87816/kube-rbac-proxy/0.log"
Jul 31 01:11:54.717392 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:54.717373    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9cz8_c2d774ba-82fd-482f-b688-4a47ddd87816/init-textfile/0.log"
Jul 31 01:11:54.937525 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:54.937496    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/prometheus/0.log"
Jul 31 01:11:54.972686 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:54.972657    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/config-reloader/0.log"
Jul 31 01:11:55.006430 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.006411    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/thanos-sidecar/0.log"
Jul 31 01:11:55.034789 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.034769    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/kube-rbac-proxy-web/0.log"
Jul 31 01:11:55.094739 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.094716    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/kube-rbac-proxy/0.log"
Jul 31 01:11:55.184027 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.184007    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/kube-rbac-proxy-thanos/0.log"
Jul 31 01:11:55.214264 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.214169    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dbc0765-0c11-474b-8ce5-463c1dc589d2/init-config-reloader/0.log"
Jul 31 01:11:55.379328 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.379302    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcbb74d8f-5g6rf_efebb5a1-3e39-4c63-9fc4-49b9eb177bff/thanos-query/0.log"
Jul 31 01:11:55.398828 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.398804    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcbb74d8f-5g6rf_efebb5a1-3e39-4c63-9fc4-49b9eb177bff/kube-rbac-proxy-web/0.log"
Jul 31 01:11:55.419348 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.419323    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcbb74d8f-5g6rf_efebb5a1-3e39-4c63-9fc4-49b9eb177bff/kube-rbac-proxy/0.log"
Jul 31 01:11:55.440262 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.440243    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcbb74d8f-5g6rf_efebb5a1-3e39-4c63-9fc4-49b9eb177bff/prom-label-proxy/0.log"
Jul 31 01:11:55.458162 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.458139    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcbb74d8f-5g6rf_efebb5a1-3e39-4c63-9fc4-49b9eb177bff/kube-rbac-proxy-rules/0.log"
Jul 31 01:11:55.478580 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:55.478522    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bcbb74d8f-5g6rf_efebb5a1-3e39-4c63-9fc4-49b9eb177bff/kube-rbac-proxy-metrics/0.log"
Jul 31 01:11:58.138520 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138489    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"]
Jul 31 01:11:58.138941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138854    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60419f83-e933-4190-964b-3e3740ad0165" containerName="revoke-keys"
Jul 31 01:11:58.138941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138867    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60419f83-e933-4190-964b-3e3740ad0165" containerName="revoke-keys"
Jul 31 01:11:58.138941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138883    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e65e868-e85f-4e2f-b5d6-651a1d4d540d" containerName="payload-pre-processing"
Jul 31 01:11:58.138941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138889    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e65e868-e85f-4e2f-b5d6-651a1d4d540d" containerName="payload-pre-processing"
Jul 31 01:11:58.138941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138902    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeaf114f-0830-4519-adf2-07b9bd5192df" containerName="payload-processing"
Jul 31 01:11:58.138941 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138909    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeaf114f-0830-4519-adf2-07b9bd5192df" containerName="payload-processing"
Jul 31 01:11:58.139137 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138963    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e65e868-e85f-4e2f-b5d6-651a1d4d540d" containerName="payload-pre-processing"
Jul 31 01:11:58.139137 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138970    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeaf114f-0830-4519-adf2-07b9bd5192df" containerName="payload-processing"
Jul 31 01:11:58.139137 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.138979    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="60419f83-e933-4190-964b-3e3740ad0165" containerName="revoke-keys"
Jul 31 01:11:58.141991 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.141973    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.143811 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.143790    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sj55h\"/\"kube-root-ca.crt\""
Jul 31 01:11:58.143987 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.143968    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sj55h\"/\"openshift-service-ca.crt\""
Jul 31 01:11:58.144254 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.144240    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sj55h\"/\"default-dockercfg-jj2mk\""
Jul 31 01:11:58.148406 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.148385    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"]
Jul 31 01:11:58.261609 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.261578    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-podres\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.261796 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.261623    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-lib-modules\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.261796 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.261652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-sys\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.261796 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.261718    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwfd5\" (UniqueName: \"kubernetes.io/projected/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-kube-api-access-lwfd5\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.261796 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.261746    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-proc\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362602 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362574    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-podres\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362814 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362628    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-lib-modules\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362814 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-sys\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362814 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwfd5\" (UniqueName: \"kubernetes.io/projected/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-kube-api-access-lwfd5\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362814 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362732    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-proc\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362814 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362744    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-podres\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.362814 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362800    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-sys\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.363134 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-lib-modules\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.363134 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.362870    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-proc\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.369772 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.369741    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwfd5\" (UniqueName: \"kubernetes.io/projected/9be769e1-c9b2-45e3-bd4c-68e19d6d1483-kube-api-access-lwfd5\") pod \"perf-node-gather-daemonset-bm647\" (UID: \"9be769e1-c9b2-45e3-bd4c-68e19d6d1483\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.452898 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.452877    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:58.584295 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:58.584269    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"]
Jul 31 01:11:58.586452 ip-10-0-129-35 kubenswrapper[2555]: W0731 01:11:58.586410    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9be769e1_c9b2_45e3_bd4c_68e19d6d1483.slice/crio-0bada51bb43d683d932a54b84382239c04e0d541029d623c39a4f4f49e9006fe WatchSource:0}: Error finding container 0bada51bb43d683d932a54b84382239c04e0d541029d623c39a4f4f49e9006fe: Status 404 returned error can't find the container with id 0bada51bb43d683d932a54b84382239c04e0d541029d623c39a4f4f49e9006fe
Jul 31 01:11:59.276773 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:59.276711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647" event={"ID":"9be769e1-c9b2-45e3-bd4c-68e19d6d1483","Type":"ContainerStarted","Data":"fbbda1d5f9c47fd4557d61e346ac67cd868c933d9db5189f1bc6306ba0167706"}
Jul 31 01:11:59.277240 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:59.276797    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:11:59.277240 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:59.276815    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647" event={"ID":"9be769e1-c9b2-45e3-bd4c-68e19d6d1483","Type":"ContainerStarted","Data":"0bada51bb43d683d932a54b84382239c04e0d541029d623c39a4f4f49e9006fe"}
Jul 31 01:11:59.289845 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:11:59.289797    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647" podStartSLOduration=1.28978135 podStartE2EDuration="1.28978135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:11:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:11:59.288636758 +0000 UTC m=+3924.012602737" watchObservedRunningTime="2026-07-31 01:11:59.28978135 +0000 UTC m=+3924.013747333"
Jul 31 01:12:00.076838 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:00.076807    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vfqzp_07143eab-2b8d-42bb-b999-98fff8133c4f/dns/0.log"
Jul 31 01:12:00.101522 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:00.101497    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vfqzp_07143eab-2b8d-42bb-b999-98fff8133c4f/kube-rbac-proxy/0.log"
Jul 31 01:12:00.143420 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:00.143391    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcfgz_74844aa7-2483-499e-b047-91989c57445a/dns-node-resolver/0.log"
Jul 31 01:12:00.714685 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:00.714653    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7796cfc577-8kn2s_bbd614d6-3799-4609-b9c8-204c2f97f8b2/registry/0.log"
Jul 31 01:12:00.756675 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:00.756649    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2nmw_c3061a80-e687-4256-af18-173c5ff6b279/node-ca/0.log"
Jul 31 01:12:02.088809 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:02.088774    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6dcbc74-dxcqt_3ff551cf-0096-40a8-b916-691531a9e72e/kube-auth-proxy/0.log"
Jul 31 01:12:02.179035 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:02.178217    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-pfb45_f95298ac-098e-40b3-bb16-de35d3ecab23/payload-pre-processing/0.log"
Jul 31 01:12:02.203378 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:02.203358    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5qk_5648c4a6-8434-4cfc-829e-dc24c83252f6/payload-processing/0.log"
Jul 31 01:12:03.064770 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:03.064713    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlnrt_607c0767-752d-4ed2-95c0-32536bcdfc15/serve-healthcheck-canary/0.log"
Jul 31 01:12:03.660654 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:03.660621    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxmz4_266dc6ac-6827-42e0-b103-c5b01060a634/kube-rbac-proxy/0.log"
Jul 31 01:12:03.679981 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:03.679963    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxmz4_266dc6ac-6827-42e0-b103-c5b01060a634/exporter/0.log"
Jul 31 01:12:03.699370 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:03.699349    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxmz4_266dc6ac-6827-42e0-b103-c5b01060a634/extractor/0.log"
Jul 31 01:12:05.292067 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:05.292037    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-bm647"
Jul 31 01:12:06.434943 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:06.434909    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c9699fb4f-96hf9_256331ef-b2ba-48fc-adc9-6595f719bc07/manager/0.log"
Jul 31 01:12:06.780282 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:06.780180    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-j6wd9_0679d330-625d-4264-8f09-e0573bd5837c/manager/0.log"
Jul 31 01:12:06.798740 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:06.798716    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-j6wd9_0679d330-625d-4264-8f09-e0573bd5837c/copy-manifests/0.log"
Jul 31 01:12:08.277428 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:08.277345    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dbc4bb7b6-h4p7r_713bf6e0-b746-4e70-8023-38f66421d978/manager/0.log"
Jul 31 01:12:09.326133 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:09.326106    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6dcbc74-dxcqt_3ff551cf-0096-40a8-b916-691531a9e72e/kube-auth-proxy/0.log"
Jul 31 01:12:09.398880 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:09.398852    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-pfb45_f95298ac-098e-40b3-bb16-de35d3ecab23/payload-pre-processing/0.log"
Jul 31 01:12:09.419117 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:09.419090    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5qk_5648c4a6-8434-4cfc-829e-dc24c83252f6/payload-processing/0.log"
Jul 31 01:12:11.181955 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:11.181902    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6dcbc74-dxcqt_3ff551cf-0096-40a8-b916-691531a9e72e/kube-auth-proxy/0.log"
Jul 31 01:12:11.252291 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:11.252265    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-pfb45_f95298ac-098e-40b3-bb16-de35d3ecab23/payload-pre-processing/0.log"
Jul 31 01:12:11.271203 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:11.271177    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5qk_5648c4a6-8434-4cfc-829e-dc24c83252f6/payload-processing/0.log"
Jul 31 01:12:13.422403 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:13.422377    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-qgz9f_773e8476-0fdf-4170-85f2-fb96341429a8/migrator/0.log"
Jul 31 01:12:13.440848 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:13.440824    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-qgz9f_773e8476-0fdf-4170-85f2-fb96341429a8/graceful-termination/0.log"
Jul 31 01:12:13.780610 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:13.780569    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-k56wt_43412d3c-1163-4e1d-b861-9a8c395365a8/kube-storage-version-migrator-operator/1.log"
Jul 31 01:12:13.781378 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:13.781355    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-k56wt_43412d3c-1163-4e1d-b861-9a8c395365a8/kube-storage-version-migrator-operator/0.log"
Jul 31 01:12:14.771218 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.771147    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/kube-multus-additional-cni-plugins/0.log"
Jul 31 01:12:14.788946 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.788922    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/egress-router-binary-copy/0.log"
Jul 31 01:12:14.807788 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.807745    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/cni-plugins/0.log"
Jul 31 01:12:14.825974 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.825952    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/bond-cni-plugin/0.log"
Jul 31 01:12:14.844165 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.844146    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/routeoverride-cni/0.log"
Jul 31 01:12:14.862130 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.862109    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/whereabouts-cni-bincopy/0.log"
Jul 31 01:12:14.880379 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:14.880349    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djrwl_8ae8f7db-80fe-4f85-b1b3-3eec86c8a36c/whereabouts-cni/0.log"
Jul 31 01:12:15.253076 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:15.253042    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v56gk_fc01b05a-fe73-42e3-8fb6-4188fe7254a0/kube-multus/0.log"
Jul 31 01:12:15.355316 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:15.355287    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fcf6_8a4af45a-1ff2-46d6-a98a-cf698fcbdfff/network-metrics-daemon/0.log"
Jul 31 01:12:15.369589 ip-10-0-129-35 kubenswrapper[2555]: I0731 01:12:15.369564    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fcf6_8a4af45a-1ff2-46d6-a98a-cf698fcbdfff/kube-rbac-proxy/0.log"