Sep 06 01:07:15.269663 ip-10-0-129-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 06 01:07:15.269972 ip-10-0-129-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 06 01:07:15.270082 ip-10-0-129-23 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 06 01:07:15.270796 ip-10-0-129-23 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 06 01:07:25.305131 ip-10-0-129-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 06 01:07:25.305147 ip-10-0-129-23 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7c5f2f8fe8de46538b8ae9cfe9c858f6 --
Sep 06 01:09:06.599208 ip-10-0-129-23 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 01:09:07.044233 ip-10-0-129-23 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:09:07.044233 ip-10-0-129-23 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 01:09:07.044233 ip-10-0-129-23 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:09:07.044233 ip-10-0-129-23 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 01:09:07.044233 ip-10-0-129-23 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:09:07.046858 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.046734    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 01:09:07.052081 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052062    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:07.052081 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052079    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:07.052081 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052084    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052088    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052093    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052097    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052100    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052104    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052108    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052113    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052119    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052123    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052126    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052130    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052134    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052144    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052149    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052153    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052157    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052160    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052164    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052168    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:07.052268 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052172    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052176    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052179    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052183    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052187    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052191    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052196    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052200    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052204    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052208    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052212    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052216    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052220    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052224    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052229    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052234    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052238    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052242    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052254    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052259    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:07.053091 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052263    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052267    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052272    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052276    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052280    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052283    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052288    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052292    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052296    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052299    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052304    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052308    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052312    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052316    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052320    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052324    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052328    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052332    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052336    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052339    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:07.053962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052344    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052348    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052352    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052356    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052360    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052364    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052370    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052374    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052378    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052382    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052386    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052398    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052402    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052406    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052412    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052418    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052423    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052443    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052448    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:07.054795 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052453    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052457    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052462    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052467    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052472    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052476    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052480    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052484    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052489    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052492    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052496    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052500    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052504    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052508    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052512    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052516    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052520    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.052524    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055061    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055077    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:07.055550 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055098    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055145    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055297    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055310    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055315    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055319    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055323    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055326    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055328    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055331    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055334    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055337    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055343    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055350    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055354    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055357    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055360    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055363    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:07.056059 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055366    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055369    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055372    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055375    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055377    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055380    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055382    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055385    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055389    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055393    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055396    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055398    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055400    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055403    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055406    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055410    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055413    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055416    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055418    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055421    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:07.056564 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055423    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055426    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055429    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055431    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055433    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055436    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055439    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055441    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055444    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055446    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055449    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055452    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055455    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055457    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055460    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055462    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055464    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055467    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055470    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055472    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:07.057076 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055475    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055477    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055480    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055483    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055485    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055488    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055491    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055494    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055497    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055499    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055502    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055504    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055507    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055509    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055512    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055514    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055516    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055519    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055521    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055524    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:07.057568 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055528    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055530    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055533    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055535    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055538    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055540    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055543    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055546    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055548    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055551    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055553    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055557    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055559    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055562    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055565    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055568    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055570    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055573    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055575    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055974    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:07.058112 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055980    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055983    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055986    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055989    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055991    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055994    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055997    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.055999    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056002    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056004    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056007    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056010    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056013    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056015    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056017    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056020    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056023    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056025    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056027    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056030    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:07.058594 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056032    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056035    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056042    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056047    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056051    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056054    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056057    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056059    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056062    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056065    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056067    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056072    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056075    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056079    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056082    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056085    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056088    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056090    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056093    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:07.059092 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056095    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056098    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056101    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056103    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056106    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056108    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056112    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056115    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056117    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056120    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056123    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056126    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056128    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056131    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056150    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056166    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056169    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056172    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056175    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056178    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:07.059599 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056182    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056185    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056188    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056191    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056194    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056197    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056200    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056202    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056205    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056207    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056210    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056212    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056215    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056217    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056220    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056222    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056225    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056228    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056230    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056233    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:07.060093 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056235    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056238    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056241    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056243    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056246    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056248    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056251    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056254    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056257    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056260    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056262    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056265    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056267    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056270    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056272    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056275    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056277    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056279    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.056282    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056369    2567 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056408    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 01:09:07.060591 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056416    2567 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056420    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056424    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056427    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056431    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056435    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056439    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056442    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056445    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056449    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056452    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056455    2567 flags.go:64] FLAG: --cgroup-root=""
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056458    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056461    2567 flags.go:64] FLAG: --client-ca-file=""
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056465    2567 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056468    2567 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056472    2567 flags.go:64] FLAG: --cluster-domain=""
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056475    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056479    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056483    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056486    2567 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056490    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056494    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 01:09:07.061143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056497    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056500    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056503    2567 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056506    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056509    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056512    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056515    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056519    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056522    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056525    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056528    2567 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056531    2567 flags.go:64] FLAG: --enable-server="true"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056534    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056538    2567 flags.go:64] FLAG: --event-burst="100"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056541    2567 flags.go:64] FLAG: --event-qps="50"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056544    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056547    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056550    2567 flags.go:64] FLAG: --eviction-hard=""
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056553    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056556    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056559    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056562    2567 flags.go:64] FLAG: --eviction-soft=""
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056566    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056569    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056572    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 01:09:07.061739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056575    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056578    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056582    2567 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056585    2567 flags.go:64] FLAG: --feature-gates=""
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056589    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056592    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056595    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056598    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056601    2567 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056604    2567 flags.go:64] FLAG: --help="false"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056607    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056610    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056613    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056616    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056619    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056623    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056625    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056628    2567 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056631    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056635    2567 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056637    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056640    2567 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056643    2567 flags.go:64] FLAG: --kube-reserved=""
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056646    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 01:09:07.062464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056649    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056652    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056654    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056657    2567 flags.go:64] FLAG: --lock-file=""
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056660    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056663    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056666    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056671    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056674    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056677    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056681    2567 flags.go:64] FLAG: --logging-format="text"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056684    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056687    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056690    2567 flags.go:64] FLAG: --manifest-url=""
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056692    2567 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056697    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056700    2567 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056704    2567 flags.go:64] FLAG: --max-pods="110"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056707    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056710    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056712    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056715    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056719    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056722    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056725    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 01:09:07.063102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056731    2567 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056735    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056738    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056741    2567 flags.go:64] FLAG: --pod-cidr=""
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056744    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056749    2567 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056752    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056756    2567 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056759    2567 flags.go:64] FLAG: --port="10250"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056762    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056765    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dde68d3bba3bf28f"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056768    2567 flags.go:64] FLAG: --qos-reserved=""
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056771    2567 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056774    2567 flags.go:64] FLAG: --register-node="true"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056777    2567 flags.go:64] FLAG: --register-with-taints=""
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056781    2567 flags.go:64] FLAG: --registry-burst="10"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056784    2567 flags.go:64] FLAG: --registry-qps="5"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056788    2567 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056790    2567 flags.go:64] FLAG: --reserved-memory=""
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056794    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056797    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056800    2567 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056803    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056806    2567 flags.go:64] FLAG: --runonce="false"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056809    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 01:09:07.063703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056814    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056817    2567 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056820    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056823    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056826    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056829    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056832    2567 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056835    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056838    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056841    2567 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056844    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056847    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056850    2567 flags.go:64] FLAG: --system-cgroups=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056852    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056857    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056860    2567 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056863    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056867    2567 flags.go:64] FLAG: --tls-min-version=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056870    2567 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056873    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056875    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056878    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056881    2567 flags.go:64] FLAG: --v="2"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056885    2567 flags.go:64] FLAG: --version="false"
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056889    2567 flags.go:64] FLAG: --vmodule=""
Sep 06 01:09:07.064358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056893    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.056896    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057019    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057023    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057026    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057029    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057032    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057036    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057039    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057041    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057046    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057049    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057053    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057056    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057058    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057062    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057065    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057067    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057070    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:07.065015 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057073    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057075    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057078    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057081    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057084    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057086    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057090    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057094    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057097    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057100    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057102    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057105    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057109    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057112    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057115    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057118    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057121    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057123    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057126    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057129    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:07.065477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057132    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057135    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057138    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057141    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057143    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057146    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057148    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057151    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057154    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057157    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057159    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057162    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057165    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057168    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057170    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057173    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057175    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057178    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057180    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057183    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:07.066000 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057185    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057188    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057190    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057193    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057196    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057199    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057204    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057206    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057209    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057212    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057214    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057217    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057221    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057223    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057226    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057229    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057232    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057235    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057237    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057240    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:07.066487 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057243    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057245    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057248    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057251    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057254    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057257    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057259    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057262    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057265    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057268    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057271    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057273    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057276    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057278    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057281    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057284    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057287    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057290    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057293    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057296    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:07.066994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057299    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.057303    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.057308    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.064901    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.064951    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.065888    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.065895    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065965    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065971    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065975    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065978    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065981    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065984    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065987    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:07.067477 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065990    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065993    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065996    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.065998    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066001    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066003    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066006    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066009    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066012    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066015    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066018    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066022    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066026    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066029    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066032    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066034    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066037    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066041    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066044    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066046    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:07.067827 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066049    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066052    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066058    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066061    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066064    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066067    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066070    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066073    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066076    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066078    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066081    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066084    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066087    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066090    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066093    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066095    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066098    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066100    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066103    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066106    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:07.068359 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066108    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066111    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066113    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066116    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066119    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066121    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066124    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066126    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066129    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066131    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066134    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066137    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066140    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066143    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066145    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066149    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066152    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066155    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066157    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:07.068821 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066160    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066162    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066165    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066167    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066170    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066172    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066175    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066177    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066180    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066183    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066185    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066188    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066190    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066193    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066195    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066198    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066200    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066205    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066208    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066211    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:07.069294 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066214    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066217    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066220    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066223    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066226    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066229    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066233    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066235    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066238    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066243    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066247    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066250    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066252    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.066258    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066394    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:07.069798 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066398    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066401    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066404    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066407    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066410    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066413    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066416    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066418    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066421    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066423    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066426    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066429    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066431    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066434    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066436    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066439    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066441    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066444    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066446    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:07.070218 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066448    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066453    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066456    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066459    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066463    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066466    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066468    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066471    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066475    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066478    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066481    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066484    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066487    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066490    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066493    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066496    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066499    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066501    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066504    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:07.070679 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066507    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066509    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066512    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066514    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066516    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066519    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066521    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066524    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066527    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066529    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066532    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066535    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066537    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066539    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066542    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066545    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066548    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066550    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066553    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066555    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:07.071153 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066558    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066560    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066563    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066565    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066568    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066570    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066573    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066575    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066578    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066580    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066583    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066585    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066587    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066590    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066592    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066595    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066597    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066600    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066602    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066605    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:07.071635 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066607    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066611    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066613    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066615    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066618    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066620    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066623    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066626    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066628    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066631    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066634    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066636    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066638    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066641    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066643    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066647    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066651    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066654    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066657    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:07.072134 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:07.066660    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:07.072593 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.066665    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:09:07.072593 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.066784    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 01:09:07.072593 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.071182    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 01:09:07.072593 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.072164    2567 server.go:1019] "Starting client certificate rotation"
Sep 06 01:09:07.072593 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.072261    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 01:09:07.072593 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.072289    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 01:09:07.075021 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.075007    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 01:09:07.076118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.076102    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 01:09:07.086039 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.085996    2567 log.go:25] "Validated CRI v1 runtime API"
Sep 06 01:09:07.089353 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.089336    2567 log.go:25] "Validated CRI v1 image API"
Sep 06 01:09:07.090284 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.090146    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 01:09:07.097290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.097271    2567 fs.go:135] Filesystem UUIDs: map[4a373148-2e1b-490b-8007-7045c978d1d9:/dev/nvme0n1p4 5f906c7f-ca05-4f53-b66d-563fb6f86fcf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 06 01:09:07.097374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.097289    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 01:09:07.103449 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.103332    2567 manager.go:216] Machine: {Timestamp:2026-09-06 01:09:07.101046152 +0000 UTC m=+0.376431306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200420 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c86dc889ea6ce84d5f75215d22f28 SystemUUID:ec2c86dc-889e-a6ce-84d5-f75215d22f28 BootID:7c5f2f8f-e8de-4653-8b8a-e9cfe9c858f6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:83:9b:ec:7b:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:83:9b:ec:7b:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:12:01:c1:35:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 01:09:07.103449 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.103437    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 01:09:07.103595 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.103533    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 01:09:07.104350 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.104333    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 01:09:07.104659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.104634    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 01:09:07.104787 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.104662    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 01:09:07.105504 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.105494    2567 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 01:09:07.105535 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.105505    2567 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 01:09:07.105535 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.105512    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 01:09:07.106273 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.106262    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 01:09:07.108168 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.108159    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 01:09:07.113035 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113015    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 01:09:07.113168 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113158    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 01:09:07.113201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113186    2567 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 01:09:07.113201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113195    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 01:09:07.113264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113212    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 01:09:07.113264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113220    2567 kubelet.go:398] "Adding apiserver pod source"
Sep 06 01:09:07.113390 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113269    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 01:09:07.113696 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113568    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 01:09:07.113727 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.113707    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 01:09:07.115993 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.115975    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 01:09:07.118952 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.118923    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 01:09:07.119023 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.118970    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 01:09:07.119114 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119104    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 01:09:07.119148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119118    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 01:09:07.119148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119124    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 01:09:07.119148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119129    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 01:09:07.119148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119137    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 01:09:07.119148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119142    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 01:09:07.119747 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119738    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 01:09:07.119747 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119746    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 01:09:07.119809 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119753    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 01:09:07.119809 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119758    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 01:09:07.119809 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119767    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 01:09:07.119809 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.119774    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 01:09:07.120740 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.120729    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 01:09:07.120740 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.120739    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 01:09:07.124085 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.124056    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 01:09:07.124281 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.124260    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 01:09:07.124345 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.124290    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 01:09:07.124420 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.124407    2567 server.go:1268] "Started kubelet"
Sep 06 01:09:07.124573 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.124545    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 01:09:07.124631 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.124598    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 01:09:07.124662 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.124543    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 01:09:07.125487 ip-10-0-129-23 systemd[1]: Started Kubernetes Kubelet.
Sep 06 01:09:07.126044 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.126027    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 01:09:07.128865 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.128834    2567 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 01:09:07.129889 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.129863    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 01:09:07.130147 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.129024    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-23.ec2.internal.18d29604466222cc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-23.ec2.internal,UID:ip-10-0-129-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-23.ec2.internal,},FirstTimestamp:2026-09-06 01:09:07.124380364 +0000 UTC m=+0.399765518,LastTimestamp:2026-09-06 01:09:07.124380364 +0000 UTC m=+0.399765518,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-23.ec2.internal,}"
Sep 06 01:09:07.131919 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.131902    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cn22m"
Sep 06 01:09:07.133217 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.133193    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 01:09:07.133910 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.133897    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 01:09:07.134073 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.134055    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.134720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.134694    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 01:09:07.134720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.134696    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 01:09:07.134846 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.134724    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 01:09:07.134846 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.134771    2567 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 01:09:07.134846 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.134779    2567 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 01:09:07.135302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135286    2567 factory.go:55] Registering systemd factory
Sep 06 01:09:07.135388 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135325    2567 factory.go:223] Registration of the systemd container factory successfully
Sep 06 01:09:07.135541 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135522    2567 factory.go:153] Registering CRI-O factory
Sep 06 01:09:07.135541 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135541    2567 factory.go:223] Registration of the crio container factory successfully
Sep 06 01:09:07.135666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135590    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 01:09:07.135666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135608    2567 factory.go:103] Registering Raw factory
Sep 06 01:09:07.135666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.135622    2567 manager.go:1196] Started watching for new ooms in manager
Sep 06 01:09:07.136081 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.136067    2567 manager.go:349] Starting recovery of all containers
Sep 06 01:09:07.138216 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.138181    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 01:09:07.138526 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.138503    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 01:09:07.141481 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.141461    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cn22m"
Sep 06 01:09:07.147862 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.147848    2567 manager.go:354] Recovery completed
Sep 06 01:09:07.150444 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.150425    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 06 01:09:07.153651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.153625    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.156781 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.156762    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.156846 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.156808    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.156846 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.156826    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.157428 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.157414    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 01:09:07.157428 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.157424    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.157428 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.157427    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 01:09:07.157554 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.157446    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 01:09:07.158208 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.158193    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.158283 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.158222    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.158283 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.158236    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.158871 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.158795    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-23.ec2.internal.18d29604485086d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-23.ec2.internal,UID:ip-10-0-129-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-23.ec2.internal,},FirstTimestamp:2026-09-06 01:09:07.156780757 +0000 UTC m=+0.432165917,LastTimestamp:2026-09-06 01:09:07.156780757 +0000 UTC m=+0.432165917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-23.ec2.internal,}"
Sep 06 01:09:07.159531 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.159520    2567 policy_none.go:49] "None policy: Start"
Sep 06 01:09:07.159571 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.159534    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 01:09:07.159571 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.159544    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 01:09:07.161555 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.161544    2567 policy_none.go:47] "Start"
Sep 06 01:09:07.197485 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.197467    2567 manager.go:337] "Starting Device Plugin manager"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.197517    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.197530    2567 server.go:87] "Starting device plugin registration server"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.197893    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.197903    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.198096    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.198206    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.198217    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.198532    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.198573    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.199920    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.201140    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.201179    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.201198    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.201233    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 01:09:07.210103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.202979    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:07.298446 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.298367    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.299294 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.299280    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.299368 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.299310    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.299368 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.299325    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.299368 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.299353    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.301435 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.301417    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"]
Sep 06 01:09:07.301501 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.301476    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.302276 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.302260    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.302351 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.302292    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.302351 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.302306    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.304477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.304463    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.304598 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.304585    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.304646 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.304609    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.305466 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.305451    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.305544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.305479    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.305544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.305458    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.305544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.305510    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.305544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.305519    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.305670 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.305489    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.307673 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.307657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.307737 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.307684    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:07.308695 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.308680    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:07.308759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.308704    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:07.308759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.308713    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:07.313328 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.313312    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.313404 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.313333    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-23.ec2.internal\": node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.326477 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.326462    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-23.ec2.internal\" not found" node="ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.330852 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.330838    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-23.ec2.internal\" not found" node="ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.336018 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.336002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cee5ecae58ff184b6f632299c1d231ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"cee5ecae58ff184b6f632299c1d231ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.336086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.336026    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e445836fda903b3df6d257b2d34302e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"e445836fda903b3df6d257b2d34302e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.336086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.336042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e445836fda903b3df6d257b2d34302e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"e445836fda903b3df6d257b2d34302e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.346666 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.346644    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.436647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.436624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e445836fda903b3df6d257b2d34302e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"e445836fda903b3df6d257b2d34302e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.436733 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.436710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e445836fda903b3df6d257b2d34302e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"e445836fda903b3df6d257b2d34302e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.436733 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.436718    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e445836fda903b3df6d257b2d34302e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"e445836fda903b3df6d257b2d34302e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.436799 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.436714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e445836fda903b3df6d257b2d34302e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"e445836fda903b3df6d257b2d34302e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.436799 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.436746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cee5ecae58ff184b6f632299c1d231ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"cee5ecae58ff184b6f632299c1d231ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.436799 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.436769    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cee5ecae58ff184b6f632299c1d231ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"cee5ecae58ff184b6f632299c1d231ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.447635 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.447616    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.547896 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.547873    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.630292 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.630237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.635486 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:07.635473    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:07.648854 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.648838    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.749317 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.749287    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.849844 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.849823    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:07.950322 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:07.950273    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.050713 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:08.050692    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.071843 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.071825    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 01:09:08.071992 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.071976    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 01:09:08.136851 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.136826    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:08.144477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.144449    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 01:04:07 +0000 UTC" deadline="2028-03-26 03:07:15.422477009 +0000 UTC"
Sep 06 01:09:08.144477 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.144472    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13609h58m7.278007739s"
Sep 06 01:09:08.151412 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:08.151394    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.224248 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:08.224107    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee5ecae58ff184b6f632299c1d231ab.slice/crio-c5045f840596603c39d0c19f23191a607adee1fbaacf56f6f9933fddce39c18e WatchSource:0}: Error finding container c5045f840596603c39d0c19f23191a607adee1fbaacf56f6f9933fddce39c18e: Status 404 returned error can't find the container with id c5045f840596603c39d0c19f23191a607adee1fbaacf56f6f9933fddce39c18e
Sep 06 01:09:08.224444 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:08.224429    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode445836fda903b3df6d257b2d34302e9.slice/crio-cfd2f3dcb02a64c90996a191736426b52893e8c51281cc33b263b8113a719ffa WatchSource:0}: Error finding container cfd2f3dcb02a64c90996a191736426b52893e8c51281cc33b263b8113a719ffa: Status 404 returned error can't find the container with id cfd2f3dcb02a64c90996a191736426b52893e8c51281cc33b263b8113a719ffa
Sep 06 01:09:08.227948 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.227910    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:09:08.252103 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:08.252075    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.352520 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:08.352502    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.452999 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:08.452971    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.463219 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.463169    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:08.553180 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:08.553156    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Sep 06 01:09:08.583017 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.582997    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:08.634527 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.634504    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:08.657218 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.657196    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 01:09:08.658443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.658421    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Sep 06 01:09:08.675764 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:08.675743    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 01:09:09.114341 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.114316    2567 apiserver.go:52] "Watching apiserver"
Sep 06 01:09:09.125168 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.125143    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 01:09:09.125464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.125441    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-7hm2s","kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k","openshift-cluster-node-tuning-operator/tuned-rmrz6","openshift-image-registry/node-ca-tjsgp","openshift-multus/multus-additional-cni-plugins-gxbvh","openshift-multus/network-metrics-daemon-hbvbh","openshift-network-diagnostics/network-check-target-5p8b2","kube-system/global-pull-secret-syncer-nnkg9","kube-system/konnectivity-agent-g9c79","openshift-dns/node-resolver-8l2x4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal","openshift-multus/multus-dldj6","openshift-network-operator/iptables-alerter-jc6gg"]
Sep 06 01:09:09.127822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.127801    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.127905 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.127874    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:09.129911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.129887    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.132248 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.132021    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.133127 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.133107    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.133206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.133175    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 01:09:09.133206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.133179    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 01:09:09.135470 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.135077    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 01:09:09.135470 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.135210    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.137371 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.137328    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhvxk\""
Sep 06 01:09:09.137371 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.137344    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.138369 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.138352    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.138788 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.138675    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qglvk\""
Sep 06 01:09:09.139819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.139420    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.139819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.139605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.139819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.139668    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmrkw\""
Sep 06 01:09:09.141871 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.141855    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.141986 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.141969    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143543    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143628    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143651    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143549    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143706    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.143866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.143862    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 01:09:09.144255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.144033    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zv2dw\""
Sep 06 01:09:09.144255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.144127    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.144349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.144257    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hw54n\""
Sep 06 01:09:09.144402 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.144346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.146020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.145992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-socket-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.146125 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdm28\" (UniqueName: \"kubernetes.io/projected/a65e586b-45e9-45b8-a817-5c82923126f9-kube-api-access-cdm28\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.146125 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-k8s-cni-cncf-io\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146125 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-hostroot\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146125 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146118    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-conf-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-etc-kubernetes\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtj9\" (UniqueName: \"kubernetes.io/projected/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-kube-api-access-swtj9\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.146331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146264    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysconfig\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146307    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-run\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-tuned\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-multus-certs\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146397    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-registration-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.146529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-device-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.146529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.146529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-sys\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-var-lib-kubelet\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/12258b65-fdef-4b24-ae67-bc0deba5fdac-serviceca\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-cni-binary-copy\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-cni-bin\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-daemon-config\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-modprobe-d\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-kubernetes\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146710    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-systemd\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-host\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-system-cni-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.146792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146779    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-sys-fs\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysctl-conf\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74e0357e-6439-45d1-a37a-77e3b05e300f-tmp\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-cni-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-cnibin\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146922    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-socket-dir-parent\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-netns\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.146999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jmpw\" (UniqueName: \"kubernetes.io/projected/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-kube-api-access-9jmpw\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klljv\" (UniqueName: \"kubernetes.io/projected/12258b65-fdef-4b24-ae67-bc0deba5fdac-kube-api-access-klljv\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147084    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-kubelet\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysctl-d\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-lib-modules\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlrms\" (UniqueName: \"kubernetes.io/projected/74e0357e-6439-45d1-a37a-77e3b05e300f-kube-api-access-qlrms\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12258b65-fdef-4b24-ae67-bc0deba5fdac-host\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.147304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-cni-multus\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.147903 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.147334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.149244 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.149230    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.150466 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.150446    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snz4s\""
Sep 06 01:09:09.150556 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.150470    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 01:09:09.151891 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.151619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.151891 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.151806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 01:09:09.152268 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.151979    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.152268 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.152052    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.153083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.153065    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 01:09:09.153170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.153091    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.153221 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.153209    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 01:09:09.153324 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.153303    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.153480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.153461    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 01:09:09.153559 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.153509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgvw6\""
Sep 06 01:09:09.154255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.154233    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 01:09:09.154255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.154253    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpr2g\""
Sep 06 01:09:09.154362 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.154256    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 01:09:09.154879 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.154862    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 01:09:09.155441 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.155426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qqfg6\""
Sep 06 01:09:09.155834 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.155790    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 01:09:09.157076 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.157052    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:09.158753 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.157152    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:09.161114 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.161091    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 01:09:09.181420 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.181404    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:09.206912 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.206868    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" event={"ID":"cee5ecae58ff184b6f632299c1d231ab","Type":"ContainerStarted","Data":"c5045f840596603c39d0c19f23191a607adee1fbaacf56f6f9933fddce39c18e"}
Sep 06 01:09:09.208162 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.208135    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"e445836fda903b3df6d257b2d34302e9","Type":"ContainerStarted","Data":"cfd2f3dcb02a64c90996a191736426b52893e8c51281cc33b263b8113a719ffa"}
Sep 06 01:09:09.208255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.208169    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k76pm"
Sep 06 01:09:09.217828 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.217811    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k76pm"
Sep 06 01:09:09.236116 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.236100    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 01:09:09.247666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-etc-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.247763 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.247763 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-cni-bin\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.247864 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-cni-bin\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.247864 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-kubernetes\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.247864 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-systemd\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-host\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswcx\" (UniqueName: \"kubernetes.io/projected/261aa706-8c29-460e-b6ec-6808712695d4-kube-api-access-qswcx\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-kubernetes\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-cni-bin\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-system-cni-dir\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-host\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-system-cni-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247976    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-systemd\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.247993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysctl-conf\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248012 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-host-slash\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248023    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-system-cni-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-env-overrides\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248078    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-ovnkube-script-lib\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysctl-conf\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-cni-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-cnibin\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248320    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-cnibin\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-socket-dir-parent\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klljv\" (UniqueName: \"kubernetes.io/projected/12258b65-fdef-4b24-ae67-bc0deba5fdac-kube-api-access-klljv\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248401    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-cni-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/261aa706-8c29-460e-b6ec-6808712695d4-hosts-file\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248432    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysctl-d\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-socket-dir-parent\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-lib-modules\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12258b65-fdef-4b24-ae67-bc0deba5fdac-host\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-ovn\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248560    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysctl-d\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248567    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12258b65-fdef-4b24-ae67-bc0deba5fdac-host\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-lib-modules\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-hostroot\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248629    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-hostroot\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248631    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-conf-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.248717    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-slash\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248725    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-conf-dir\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-var-lib-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.248994 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.248834    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:09.748815762 +0000 UTC m=+3.024200921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysconfig\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16bc738a-0b7a-49c9-889e-134d75a20581-dbus\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-systemd\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248963    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.248975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-ovnkube-config\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249006    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-multus-certs\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249012    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-sysconfig\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249038    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-registration-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-multus-certs\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249102    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-registration-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-var-lib-kubelet\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249165    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee947f2e-dd9d-4968-bcf1-56766d448719-ovn-node-metrics-cert\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.249688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-cni-binary-copy\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-etc-selinux\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-daemon-config\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249251    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-var-lib-kubelet\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-modprobe-d\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-run-netns\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cnibin\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-sys-fs\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-modprobe-d\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74e0357e-6439-45d1-a37a-77e3b05e300f-tmp\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-run-ovn-kubernetes\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-sys-fs\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249467    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-netns\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jmpw\" (UniqueName: \"kubernetes.io/projected/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-kube-api-access-9jmpw\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-netns\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.250551 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef749114-4049-465f-ab1c-8aacce7bc641-agent-certs\") pod \"konnectivity-agent-g9c79\" (UID: \"ef749114-4049-465f-ab1c-8aacce7bc641\") " pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-kubelet\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249574    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlrms\" (UniqueName: \"kubernetes.io/projected/74e0357e-6439-45d1-a37a-77e3b05e300f-kube-api-access-qlrms\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-cni-netd\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249615    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-kubelet\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef749114-4049-465f-ab1c-8aacce7bc641-konnectivity-ca\") pod \"konnectivity-agent-g9c79\" (UID: \"ef749114-4049-465f-ab1c-8aacce7bc641\") " pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-cni-multus\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-socket-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdm28\" (UniqueName: \"kubernetes.io/projected/a65e586b-45e9-45b8-a817-5c82923126f9-kube-api-access-cdm28\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l62rb\" (UniqueName: \"kubernetes.io/projected/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-kube-api-access-l62rb\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-systemd-units\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249788    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-cni-binary-copy\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249803    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-node-log\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249819    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-k8s-cni-cncf-io\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-etc-kubernetes\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-multus-daemon-config\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-socket-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.251214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249869    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261aa706-8c29-460e-b6ec-6808712695d4-tmp-dir\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249887    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-etc-kubernetes\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-run-k8s-cni-cncf-io\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16bc738a-0b7a-49c9-889e-134d75a20581-kubelet-config\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-log-socket\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249988    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtj9\" (UniqueName: \"kubernetes.io/projected/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-kube-api-access-swtj9\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-run\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-tuned\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.249977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-host-var-lib-cni-multus\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-iptables-alerter-script\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250118    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-run\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-kubelet\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtzsh\" (UniqueName: \"kubernetes.io/projected/ee947f2e-dd9d-4968-bcf1-56766d448719-kube-api-access-xtzsh\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb76c\" (UniqueName: \"kubernetes.io/projected/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-kube-api-access-rb76c\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-device-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.252007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-sys\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.252778 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/12258b65-fdef-4b24-ae67-bc0deba5fdac-serviceca\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.252778 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e0357e-6439-45d1-a37a-77e3b05e300f-sys\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.252778 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250283    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-device-dir\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.252778 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.250730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/12258b65-fdef-4b24-ae67-bc0deba5fdac-serviceca\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.253819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.253797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74e0357e-6439-45d1-a37a-77e3b05e300f-etc-tuned\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.253819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.253814    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74e0357e-6439-45d1-a37a-77e3b05e300f-tmp\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.261192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.261170    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klljv\" (UniqueName: \"kubernetes.io/projected/12258b65-fdef-4b24-ae67-bc0deba5fdac-kube-api-access-klljv\") pod \"node-ca-tjsgp\" (UID: \"12258b65-fdef-4b24-ae67-bc0deba5fdac\") " pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.265219 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.265194    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdm28\" (UniqueName: \"kubernetes.io/projected/a65e586b-45e9-45b8-a817-5c82923126f9-kube-api-access-cdm28\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.265986 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.265964    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtj9\" (UniqueName: \"kubernetes.io/projected/c88525a7-8b1a-46a1-8302-dd2c7d0639f9-kube-api-access-swtj9\") pod \"multus-dldj6\" (UID: \"c88525a7-8b1a-46a1-8302-dd2c7d0639f9\") " pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.266881 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.266852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jmpw\" (UniqueName: \"kubernetes.io/projected/f5a4020e-c0fe-4c63-a9a6-e38762d65ea8-kube-api-access-9jmpw\") pod \"aws-ebs-csi-driver-node-jp66k\" (UID: \"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.267276 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.267255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlrms\" (UniqueName: \"kubernetes.io/projected/74e0357e-6439-45d1-a37a-77e3b05e300f-kube-api-access-qlrms\") pod \"tuned-rmrz6\" (UID: \"74e0357e-6439-45d1-a37a-77e3b05e300f\") " pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.350977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.350948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.350977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.350980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee947f2e-dd9d-4968-bcf1-56766d448719-ovn-node-metrics-cert\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.350997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-run-netns\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-run-netns\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cnibin\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-run-ovn-kubernetes\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef749114-4049-465f-ab1c-8aacce7bc641-agent-certs\") pod \"konnectivity-agent-g9c79\" (UID: \"ef749114-4049-465f-ab1c-8aacce7bc641\") " pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cnibin\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-cni-netd\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef749114-4049-465f-ab1c-8aacce7bc641-konnectivity-ca\") pod \"konnectivity-agent-g9c79\" (UID: \"ef749114-4049-465f-ab1c-8aacce7bc641\") " pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351291    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l62rb\" (UniqueName: \"kubernetes.io/projected/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-kube-api-access-l62rb\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-systemd-units\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351337    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-node-log\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261aa706-8c29-460e-b6ec-6808712695d4-tmp-dir\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-run-ovn-kubernetes\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16bc738a-0b7a-49c9-889e-134d75a20581-kubelet-config\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-log-socket\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-iptables-alerter-script\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-kubelet\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtzsh\" (UniqueName: \"kubernetes.io/projected/ee947f2e-dd9d-4968-bcf1-56766d448719-kube-api-access-xtzsh\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351536    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb76c\" (UniqueName: \"kubernetes.io/projected/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-kube-api-access-rb76c\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.351643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-etc-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qswcx\" (UniqueName: \"kubernetes.io/projected/261aa706-8c29-460e-b6ec-6808712695d4-kube-api-access-qswcx\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-cni-bin\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-system-cni-dir\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-log-socket\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-host-slash\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-systemd-units\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-host-slash\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-env-overrides\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-ovnkube-script-lib\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351861    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/261aa706-8c29-460e-b6ec-6808712695d4-hosts-file\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16bc738a-0b7a-49c9-889e-134d75a20581-kubelet-config\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-ovn\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.352480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.351989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-node-log\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-slash\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-var-lib-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16bc738a-0b7a-49c9-889e-134d75a20581-dbus\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352114    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-systemd\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-ovnkube-config\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261aa706-8c29-460e-b6ec-6808712695d4-tmp-dir\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-iptables-alerter-script\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-cni-bin\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-env-overrides\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-system-cni-dir\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.353750 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.352704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-ovnkube-config\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.353812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee947f2e-dd9d-4968-bcf1-56766d448719-ovnkube-script-lib\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353882 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.351982    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:09.353947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.353916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-kubelet\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.353995 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.353966    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:09.853920147 +0000 UTC m=+3.129305304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:09.354058 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-slash\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.354058 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-var-lib-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.354282 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/261aa706-8c29-460e-b6ec-6808712695d4-hosts-file\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.354346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-ovn\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.354569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354554    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-etc-openvswitch\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.354616 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.354697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.354730 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354716    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16bc738a-0b7a-49c9-889e-134d75a20581-dbus\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.354765 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-host-cni-netd\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.354765 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee947f2e-dd9d-4968-bcf1-56766d448719-run-systemd\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.354978 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.354965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee947f2e-dd9d-4968-bcf1-56766d448719-ovn-node-metrics-cert\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.355160 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.355139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef749114-4049-465f-ab1c-8aacce7bc641-agent-certs\") pod \"konnectivity-agent-g9c79\" (UID: \"ef749114-4049-465f-ab1c-8aacce7bc641\") " pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.355247 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.355163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef749114-4049-465f-ab1c-8aacce7bc641-konnectivity-ca\") pod \"konnectivity-agent-g9c79\" (UID: \"ef749114-4049-465f-ab1c-8aacce7bc641\") " pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.355247 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.355150    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.362090 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.362067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l62rb\" (UniqueName: \"kubernetes.io/projected/e3e59faf-e901-428a-9fd5-1617cf7a0cb5-kube-api-access-l62rb\") pod \"iptables-alerter-jc6gg\" (UID: \"e3e59faf-e901-428a-9fd5-1617cf7a0cb5\") " pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.362179 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.362117    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:09.362179 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.362132    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:09.362179 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.362144    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:09.362335 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.362203    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:09.862188548 +0000 UTC m=+3.137573690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:09.365045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.364995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswcx\" (UniqueName: \"kubernetes.io/projected/261aa706-8c29-460e-b6ec-6808712695d4-kube-api-access-qswcx\") pod \"node-resolver-8l2x4\" (UID: \"261aa706-8c29-460e-b6ec-6808712695d4\") " pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.366393 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.366372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb76c\" (UniqueName: \"kubernetes.io/projected/dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f-kube-api-access-rb76c\") pod \"multus-additional-cni-plugins-gxbvh\" (UID: \"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f\") " pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.367327 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.367309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtzsh\" (UniqueName: \"kubernetes.io/projected/ee947f2e-dd9d-4968-bcf1-56766d448719-kube-api-access-xtzsh\") pod \"ovnkube-node-7hm2s\" (UID: \"ee947f2e-dd9d-4968-bcf1-56766d448719\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.441105 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.441072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dldj6"
Sep 06 01:09:09.448911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.448886    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k"
Sep 06 01:09:09.459652 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.459635    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rmrz6"
Sep 06 01:09:09.464527 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.464510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tjsgp"
Sep 06 01:09:09.470764 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.470741    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gxbvh"
Sep 06 01:09:09.477498 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.477484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:09.485387 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.485368    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jc6gg"
Sep 06 01:09:09.490446 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.490426    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:09.494994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.494979    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8l2x4"
Sep 06 01:09:09.753889 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.753814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:09.754023 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.753981    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:09.754059 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.754046    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:10.754031082 +0000 UTC m=+4.029416239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:09.854820 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.854789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:09.855003 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.854894    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:09.855003 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.854968    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:10.85495042 +0000 UTC m=+4.130335575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:09.955900 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:09.955866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:09.956074 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.956039    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:09.956074 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.956062    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:09.956074 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.956074    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:09.956211 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:09.956140    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:10.95612044 +0000 UTC m=+4.231505605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:10.107344 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.107280    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261aa706_8c29_460e_b6ec_6808712695d4.slice/crio-a269bd5adb8bf4a0255662f7e20f13a874147914813d0e7dc203b391ae8504e1 WatchSource:0}: Error finding container a269bd5adb8bf4a0255662f7e20f13a874147914813d0e7dc203b391ae8504e1: Status 404 returned error can't find the container with id a269bd5adb8bf4a0255662f7e20f13a874147914813d0e7dc203b391ae8504e1
Sep 06 01:09:10.108824 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.108500    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12258b65_fdef_4b24_ae67_bc0deba5fdac.slice/crio-be59e9f89bdc03e84c2e123ee23fac35f4cd91b6ea20b7e53f8412fdea65169d WatchSource:0}: Error finding container be59e9f89bdc03e84c2e123ee23fac35f4cd91b6ea20b7e53f8412fdea65169d: Status 404 returned error can't find the container with id be59e9f89bdc03e84c2e123ee23fac35f4cd91b6ea20b7e53f8412fdea65169d
Sep 06 01:09:10.109230 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.109209    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a4020e_c0fe_4c63_a9a6_e38762d65ea8.slice/crio-f990bb9f2bc2706537dede4c2f8c183ae1e47d5db3572633fe783da9bc3f1e9f WatchSource:0}: Error finding container f990bb9f2bc2706537dede4c2f8c183ae1e47d5db3572633fe783da9bc3f1e9f: Status 404 returned error can't find the container with id f990bb9f2bc2706537dede4c2f8c183ae1e47d5db3572633fe783da9bc3f1e9f
Sep 06 01:09:10.110421 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.110377    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef749114_4049_465f_ab1c_8aacce7bc641.slice/crio-168bbb7c519a9e264cbc25a6abc16213c1e1351fd1326b87f48b0f9838191356 WatchSource:0}: Error finding container 168bbb7c519a9e264cbc25a6abc16213c1e1351fd1326b87f48b0f9838191356: Status 404 returned error can't find the container with id 168bbb7c519a9e264cbc25a6abc16213c1e1351fd1326b87f48b0f9838191356
Sep 06 01:09:10.112321 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.112296    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda4b39f_10ed_4ea8_8f27_b6f4d2c0bb2f.slice/crio-cb9cf0bee4e3bda339263f0730f37f28a97be3e323f38ad6fe468bcf002bc4df WatchSource:0}: Error finding container cb9cf0bee4e3bda339263f0730f37f28a97be3e323f38ad6fe468bcf002bc4df: Status 404 returned error can't find the container with id cb9cf0bee4e3bda339263f0730f37f28a97be3e323f38ad6fe468bcf002bc4df
Sep 06 01:09:10.113101 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.113082    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e0357e_6439_45d1_a37a_77e3b05e300f.slice/crio-809cb95a9f203d5ff817019aa53b5e4da6a4181fd931e0ffd921995f3d80d967 WatchSource:0}: Error finding container 809cb95a9f203d5ff817019aa53b5e4da6a4181fd931e0ffd921995f3d80d967: Status 404 returned error can't find the container with id 809cb95a9f203d5ff817019aa53b5e4da6a4181fd931e0ffd921995f3d80d967
Sep 06 01:09:10.114197 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.114072    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee947f2e_dd9d_4968_bcf1_56766d448719.slice/crio-37e1ea87bdffb8cb1362cb761049ff9400ea705becd9ce9abadadd1cd96abf13 WatchSource:0}: Error finding container 37e1ea87bdffb8cb1362cb761049ff9400ea705becd9ce9abadadd1cd96abf13: Status 404 returned error can't find the container with id 37e1ea87bdffb8cb1362cb761049ff9400ea705becd9ce9abadadd1cd96abf13
Sep 06 01:09:10.116478 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:10.116084    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e59faf_e901_428a_9fd5_1617cf7a0cb5.slice/crio-b98af73fcc419b249d46baa4d8db93ede6fbe503333beb5f846e38b2b3a0f120 WatchSource:0}: Error finding container b98af73fcc419b249d46baa4d8db93ede6fbe503333beb5f846e38b2b3a0f120: Status 404 returned error can't find the container with id b98af73fcc419b249d46baa4d8db93ede6fbe503333beb5f846e38b2b3a0f120
Sep 06 01:09:10.210581 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.210554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dldj6" event={"ID":"c88525a7-8b1a-46a1-8302-dd2c7d0639f9","Type":"ContainerStarted","Data":"091e868f8effd6e489bd59e3241574e4c958b75664a65e3758efd5c04f4c8a06"}
Sep 06 01:09:10.211636 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.211614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"37e1ea87bdffb8cb1362cb761049ff9400ea705becd9ce9abadadd1cd96abf13"}
Sep 06 01:09:10.212688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.212665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rmrz6" event={"ID":"74e0357e-6439-45d1-a37a-77e3b05e300f","Type":"ContainerStarted","Data":"809cb95a9f203d5ff817019aa53b5e4da6a4181fd931e0ffd921995f3d80d967"}
Sep 06 01:09:10.213840 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.213820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerStarted","Data":"cb9cf0bee4e3bda339263f0730f37f28a97be3e323f38ad6fe468bcf002bc4df"}
Sep 06 01:09:10.214889 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.214869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g9c79" event={"ID":"ef749114-4049-465f-ab1c-8aacce7bc641","Type":"ContainerStarted","Data":"168bbb7c519a9e264cbc25a6abc16213c1e1351fd1326b87f48b0f9838191356"}
Sep 06 01:09:10.216419 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.216397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k" event={"ID":"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8","Type":"ContainerStarted","Data":"f990bb9f2bc2706537dede4c2f8c183ae1e47d5db3572633fe783da9bc3f1e9f"}
Sep 06 01:09:10.217796 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.217768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tjsgp" event={"ID":"12258b65-fdef-4b24-ae67-bc0deba5fdac","Type":"ContainerStarted","Data":"be59e9f89bdc03e84c2e123ee23fac35f4cd91b6ea20b7e53f8412fdea65169d"}
Sep 06 01:09:10.220858 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.220835    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 01:04:09 +0000 UTC" deadline="2028-06-17 03:17:33.769633884 +0000 UTC"
Sep 06 01:09:10.220958 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.220860    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15602h8m23.548778916s"
Sep 06 01:09:10.221136 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.221116    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" event={"ID":"cee5ecae58ff184b6f632299c1d231ab","Type":"ContainerStarted","Data":"1b3ceb86611e5ba525dfee425917a8c71ee58e190b42401e107c38145d245ad9"}
Sep 06 01:09:10.222244 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.222225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jc6gg" event={"ID":"e3e59faf-e901-428a-9fd5-1617cf7a0cb5","Type":"ContainerStarted","Data":"b98af73fcc419b249d46baa4d8db93ede6fbe503333beb5f846e38b2b3a0f120"}
Sep 06 01:09:10.223258 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.223240    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8l2x4" event={"ID":"261aa706-8c29-460e-b6ec-6808712695d4","Type":"ContainerStarted","Data":"a269bd5adb8bf4a0255662f7e20f13a874147914813d0e7dc203b391ae8504e1"}
Sep 06 01:09:10.762367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.761712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:10.762367 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.761903    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:10.762367 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.761985    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:12.761964479 +0000 UTC m=+6.037349644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:10.862607 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.862571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:10.862805 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.862756    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:10.862859 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.862833    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:12.862811616 +0000 UTC m=+6.138196771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:10.963843 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:10.963153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:10.963843 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.963353    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:10.963843 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.963379    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:10.963843 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.963391    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:10.963843 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:10.963447    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:12.963430233 +0000 UTC m=+6.238815380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:11.211126 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.211048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:11.211902 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:11.211226    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:11.211902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.211692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:11.211902 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:11.211809    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:11.211902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.211901    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:11.212133 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:11.212031    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:11.222443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.222391    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 01:04:09 +0000 UTC" deadline="2028-05-18 01:34:59.801819538 +0000 UTC"
Sep 06 01:09:11.222443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.222444    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14880h25m48.579379687s"
Sep 06 01:09:11.247951 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.247601    2567 generic.go:356] "Generic (PLEG): container finished" podID="e445836fda903b3df6d257b2d34302e9" containerID="bc3818cb44c8764604225111be5ccfe5cc4b5ebed9fedc26433922dd4a2c571c" exitCode=0
Sep 06 01:09:11.248651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.248133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"e445836fda903b3df6d257b2d34302e9","Type":"ContainerDied","Data":"bc3818cb44c8764604225111be5ccfe5cc4b5ebed9fedc26433922dd4a2c571c"}
Sep 06 01:09:11.267748 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:11.267206    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" podStartSLOduration=3.267189627 podStartE2EDuration="3.267189627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:10.244944549 +0000 UTC m=+3.520329889" watchObservedRunningTime="2026-09-06 01:09:11.267189627 +0000 UTC m=+4.542574790"
Sep 06 01:09:12.268236 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:12.267944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"e445836fda903b3df6d257b2d34302e9","Type":"ContainerStarted","Data":"e0a488b585e7df16508778a43f8d672619447736b83c697c1776b4c59aa83659"}
Sep 06 01:09:12.777155 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:12.776535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:12.777155 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.776725    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:12.777155 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.776782    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:16.77676464 +0000 UTC m=+10.052149804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:12.877938 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:12.877891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:12.878112 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.878091    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:12.878175 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.878153    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:16.878134908 +0000 UTC m=+10.153520066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:12.978651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:12.978618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:12.978822 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.978778    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:12.978822 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.978801    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:12.978822 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.978813    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:12.979020 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:12.978863    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:16.97884677 +0000 UTC m=+10.254231926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:13.202754 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:13.202022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:13.202754 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:13.202158    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:13.202754 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:13.202529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:13.202754 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:13.202627    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:13.203265 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:13.203118    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:13.203265 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:13.203209    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:15.202026 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:15.201991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:15.202461 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:15.202147    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:15.202542 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:15.202469    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:15.202594 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:15.202576    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:15.202642 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:15.202611    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:15.202692 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:15.202680    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:16.807830 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:16.807792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:16.808298 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:16.807945    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:16.808298 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:16.808022    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:24.808001746 +0000 UTC m=+18.083386904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:16.908697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:16.908661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:16.908966 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:16.908924    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:16.909035 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:16.909009    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:24.908990328 +0000 UTC m=+18.184375488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:17.010015 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:17.009982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:17.010158 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.010141    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:17.010218 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.010160    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:17.010218 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.010172    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:17.010291 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.010238    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:25.010220252 +0000 UTC m=+18.285605398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:17.203462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:17.203028    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:17.203462 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.203110    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:17.203462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:17.203130    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:17.203462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:17.203194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:17.203462 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.203291    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:17.203462 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:17.203368    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:19.201588 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:19.201560    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:19.201957 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:19.201600    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:19.201957 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:19.201675    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:19.201957 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:19.201702    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:19.201957 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:19.201768    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:19.201957 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:19.201861    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:21.204767 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:21.204738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:21.204767 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:21.204765    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:21.205273 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:21.204868    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:21.205273 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:21.204942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:21.205273 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:21.205027    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:21.205273 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:21.205094    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:23.201540 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:23.201506    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:23.201982 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:23.201506    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:23.201982 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:23.201634    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:23.201982 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:23.201523    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:23.201982 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:23.201724    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:23.201982 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:23.201786    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:24.863719 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:24.863667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:24.864208 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:24.863807    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:24.864208 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:24.863860    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.863844966 +0000 UTC m=+34.139230121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:24.965005 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:24.964965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:24.965176 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:24.965127    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:24.965217 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:24.965194    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.965176913 +0000 UTC m=+34.240562074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:25.065383 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:25.065350    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:25.065545 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.065509    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:25.065545 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.065527    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:25.065545 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.065540    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:25.065698 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.065603    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:41.065583903 +0000 UTC m=+34.340969068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:25.206480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:25.206409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:25.206633 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:25.206414    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:25.206633 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.206523    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:25.206633 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:25.206415    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:25.206633 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.206591    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:25.206846 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:25.206680    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:27.202105 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:27.202077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:27.202554 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:27.202197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:27.202554 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:27.202219    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:27.202554 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:27.202267    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:27.202554 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:27.202296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:27.202554 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:27.202382    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:28.313439 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.313232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dldj6" event={"ID":"c88525a7-8b1a-46a1-8302-dd2c7d0639f9","Type":"ContainerStarted","Data":"837829487c20f267f17d90b1a233428914794bb3df3fff4da12634eff4610445"}
Sep 06 01:09:28.316049 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.316022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"1c5c163f1450393b2a65ca902c6788f490ebf6561b19bbfca24476ffd2f98335"}
Sep 06 01:09:28.316173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.316086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"a33443e460717844bb468832aaef5a0b5be172a96162f40b15892396ef13345e"}
Sep 06 01:09:28.316173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.316130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"763f540749adf432e3f5c988df41d4fc720005f94546b0d2570ce35acbd1060c"}
Sep 06 01:09:28.316173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.316161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"838972df852833b9c401062f75da16871871e1a2c65d030054de53cd2da149f1"}
Sep 06 01:09:28.317636 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.317608    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rmrz6" event={"ID":"74e0357e-6439-45d1-a37a-77e3b05e300f","Type":"ContainerStarted","Data":"1b8423c4fe5f553737287bf8370511066087a6a85f40d89d6afe9f4237263bf5"}
Sep 06 01:09:28.319258 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.319234    2567 generic.go:356] "Generic (PLEG): container finished" podID="dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f" containerID="c936ec242078efa009b07bb4f7b33dfbe7ff6e73610c1955d0c1887e98d445ef" exitCode=0
Sep 06 01:09:28.319348 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.319312    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerDied","Data":"c936ec242078efa009b07bb4f7b33dfbe7ff6e73610c1955d0c1887e98d445ef"}
Sep 06 01:09:28.320885 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.320866    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g9c79" event={"ID":"ef749114-4049-465f-ab1c-8aacce7bc641","Type":"ContainerStarted","Data":"60025b715f8933bb551667195b10760c77c8d2355e4fd39ac7d6ba5806603318"}
Sep 06 01:09:28.322557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.322533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k" event={"ID":"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8","Type":"ContainerStarted","Data":"d8b002f883259062ea4db454192ca88580b709ec7694c8eac912130ed6ab32ca"}
Sep 06 01:09:28.323972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.323953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tjsgp" event={"ID":"12258b65-fdef-4b24-ae67-bc0deba5fdac","Type":"ContainerStarted","Data":"3da1f1b0001f9935f5443b1a4a1793e49805efbab6ed277cb1bb38c508a6241a"}
Sep 06 01:09:28.325289 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.325270    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8l2x4" event={"ID":"261aa706-8c29-460e-b6ec-6808712695d4","Type":"ContainerStarted","Data":"2889bb7a8233afb18deaed6fe1530030c910f46861bc1999498cb735db5906c3"}
Sep 06 01:09:28.332302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.332257    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" podStartSLOduration=20.332240328 podStartE2EDuration="20.332240328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:12.28658171 +0000 UTC m=+5.561966873" watchObservedRunningTime="2026-09-06 01:09:28.332240328 +0000 UTC m=+21.607625493"
Sep 06 01:09:28.332376 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.332352    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dldj6" podStartSLOduration=3.6669174780000002 podStartE2EDuration="21.332346602s" totalImagesPullingTime="17.665429124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.331914837 +0000 UTC m=+21.607299998" watchObservedRunningTime="2026-09-06 01:09:28.332346602 +0000 UTC m=+21.607731768"
Sep 06 01:09:28.349776 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.349746    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rmrz6" podStartSLOduration=3.721873298 podStartE2EDuration="21.349735428s" totalImagesPullingTime="17.62786213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.349594034 +0000 UTC m=+21.624979197" watchObservedRunningTime="2026-09-06 01:09:28.349735428 +0000 UTC m=+21.625120592"
Sep 06 01:09:28.366426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.366388    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tjsgp" podStartSLOduration=3.73484316 podStartE2EDuration="21.366376584s" totalImagesPullingTime="17.631533424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.365821745 +0000 UTC m=+21.641206910" watchObservedRunningTime="2026-09-06 01:09:28.366376584 +0000 UTC m=+21.641761749"
Sep 06 01:09:28.402250 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.402210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g9c79" podStartSLOduration=11.256596291 podStartE2EDuration="21.402192576s" totalImagesPullingTime="10.145596285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.402005591 +0000 UTC m=+21.677390767" watchObservedRunningTime="2026-09-06 01:09:28.402192576 +0000 UTC m=+21.677577740"
Sep 06 01:09:28.417188 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.417152    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8l2x4" podStartSLOduration=3.784685163 podStartE2EDuration="21.417140324s" totalImagesPullingTime="17.632455161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.416604621 +0000 UTC m=+21.691989786" watchObservedRunningTime="2026-09-06 01:09:28.417140324 +0000 UTC m=+21.692525487"
Sep 06 01:09:28.446229 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.445893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:28.507976 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.507952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:28.571080 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:28.571019    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:29.065300 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.065233    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 01:09:29.202333 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.202274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:29.202507 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.202274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:29.202507 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:29.202374    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:29.202507 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:29.202489    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:29.202662 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.202274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:29.202662 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:29.202593    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:29.207716 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.207617    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T01:09:29.065249748Z","UUID":"564d17aa-c3f5-45c3-985b-57169f2f76c5","Handler":null,"Name":"","Endpoint":""}
Sep 06 01:09:29.209302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.209281    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 01:09:29.209395 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.209317    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 01:09:29.331396 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.331365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"a9eb02bde8465c5af113494c7ed9e9bef003d181a45932256e7f4c2e564acc0a"}
Sep 06 01:09:29.331827 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.331438    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"e8ab9d871c62ceea9f07b80df08ba08ba600295b3f8a42b594cd249e809ef563"}
Sep 06 01:09:29.333336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.333306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k" event={"ID":"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8","Type":"ContainerStarted","Data":"9016e6e0e855b21d7562669163f1ec3723a30c11913645ef37a9235ba5ccbf4c"}
Sep 06 01:09:29.335079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.335033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jc6gg" event={"ID":"e3e59faf-e901-428a-9fd5-1617cf7a0cb5","Type":"ContainerStarted","Data":"24d233be870078fdd0e6b38e230d44f66b7b16a37f041a47d2938cfed41232a7"}
Sep 06 01:09:29.351936 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.351883    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jc6gg" podStartSLOduration=4.754118285 podStartE2EDuration="22.351865406s" totalImagesPullingTime="17.597747121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:29.351483111 +0000 UTC m=+22.626868272" watchObservedRunningTime="2026-09-06 01:09:29.351865406 +0000 UTC m=+22.627250570"
Sep 06 01:09:29.472225 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.472135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:29.537484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:29.537456    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:30.339228 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:30.339152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k" event={"ID":"f5a4020e-c0fe-4c63-a9a6-e38762d65ea8","Type":"ContainerStarted","Data":"4a5e26e05ef66e5c7dd3ca00f8c71f95f9eb6b3a9ddab858220bf922308842ac"}
Sep 06 01:09:30.356311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:30.356262    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jp66k" podStartSLOduration=3.821586473 podStartE2EDuration="23.356245447s" totalImagesPullingTime="19.534658974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:30.355876233 +0000 UTC m=+23.631261399" watchObservedRunningTime="2026-09-06 01:09:30.356245447 +0000 UTC m=+23.631630614"
Sep 06 01:09:30.881288 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:30.881195    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:30.947175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:30.947146    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:31.018972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.018945    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:31.086879 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.086854    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:31.181433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.181404    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:31.201652 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.201626    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:31.201808 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.201647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:31.201808 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.201626    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:31.201808 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:31.201749    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:31.201987 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:31.201833    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:31.201987 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:31.201921    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:31.344975 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.344915    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"5a089cb3305aead8ea50b93e219216e1f9c8fa674eaaaedc67cf0d38e5c1d491"}
Sep 06 01:09:31.346041 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.346018    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:31.446856 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.446782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:31.510284 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:31.510255    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:32.198136 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:32.198108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:32.250229 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:32.250204    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:32.599726 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:32.599621    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:32.664952 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:32.664916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:33.202330 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.202104    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:33.202444 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.202137    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:33.202497 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:33.202432    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:33.202497 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.202159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:33.202570 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:33.202489    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:33.202570 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:33.202560    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:33.241071 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.241047    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:33.241531 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.241514    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:33.352261 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.352229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" event={"ID":"ee947f2e-dd9d-4968-bcf1-56766d448719","Type":"ContainerStarted","Data":"634190697a620ce525751d29232f8792d9f6d645900ec854f12a62c6a2827e00"}
Sep 06 01:09:33.352481 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.352459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:33.354195 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.354171    2567 generic.go:356] "Generic (PLEG): container finished" podID="dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f" containerID="8d98f24bb34be723c3070cddbe40cc162fd07d443ae20a6bd7b76057105f61ea" exitCode=0
Sep 06 01:09:33.354288 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.354256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerDied","Data":"8d98f24bb34be723c3070cddbe40cc162fd07d443ae20a6bd7b76057105f61ea"}
Sep 06 01:09:33.354445 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.354426    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:33.354885 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.354872    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g9c79"
Sep 06 01:09:33.367858 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.367841    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:33.402918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.402880    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s" podStartSLOduration=8.714636693 podStartE2EDuration="26.402868758s" totalImagesPullingTime="17.688232065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:33.384181291 +0000 UTC m=+26.659566447" watchObservedRunningTime="2026-09-06 01:09:33.402868758 +0000 UTC m=+26.678253920"
Sep 06 01:09:33.466164 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:33.466110    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:34.253878 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.253848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:34.356674 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.356491    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:34.371434 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.371414    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:09:34.653753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.653725    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nnkg9"]
Sep 06 01:09:34.653892 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.653830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:34.653947 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:34.653911    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:34.657738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.657716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5p8b2"]
Sep 06 01:09:34.657856 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.657830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:34.657955 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:34.657914    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:34.658373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.658353    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbvbh"]
Sep 06 01:09:34.658455 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:34.658444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:34.658542 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:34.658521    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:35.360144 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:35.360115    2567 generic.go:356] "Generic (PLEG): container finished" podID="dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f" containerID="f84bc319774f1e05ac9725c0debeaeb1f1cd180b3300e4ccd2c0cbc88425973c" exitCode=0
Sep 06 01:09:35.360580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:35.360203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerDied","Data":"f84bc319774f1e05ac9725c0debeaeb1f1cd180b3300e4ccd2c0cbc88425973c"}
Sep 06 01:09:36.201776 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:36.201744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:36.201911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:36.201840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:36.201911 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:36.201845    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:36.201911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:36.201851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:36.202042 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:36.201940    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:36.202042 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:36.202002    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:37.152301 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:37.152230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:37.210769 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:37.210737    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:37.367200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:37.367169    2567 generic.go:356] "Generic (PLEG): container finished" podID="dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f" containerID="60413fd5831ba0f560ce672f3f47b6a7c095e9c789fe347b217275bf06c6e19c" exitCode=0
Sep 06 01:09:37.367340 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:37.367225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerDied","Data":"60413fd5831ba0f560ce672f3f47b6a7c095e9c789fe347b217275bf06c6e19c"}
Sep 06 01:09:38.201706 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:38.201674    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:38.202167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:38.201672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:38.202167 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:38.201810    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:38.202167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:38.201819    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:38.202167 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:38.201897    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:38.202167 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:38.201987    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:40.201751 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.201722    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:40.202323 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.201777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:40.202323 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.201779    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:40.202323 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.201868    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p8b2" podUID="cf47b4ed-86d9-4781-8d71-a92b6873b5d4"
Sep 06 01:09:40.202323 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.201969    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnkg9" podUID="16bc738a-0b7a-49c9-889e-134d75a20581"
Sep 06 01:09:40.202323 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.202031    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbvbh" podUID="a65e586b-45e9-45b8-a817-5c82923126f9"
Sep 06 01:09:40.496821 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.496739    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeReady"
Sep 06 01:09:40.497010 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.496867    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 01:09:40.564029 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.563992    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wk7gs"]
Sep 06 01:09:40.568720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.568699    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cggfs"]
Sep 06 01:09:40.568847 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.568828    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.571513 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.571491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 01:09:40.571703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.571555    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 01:09:40.571852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.571834    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjq89\""
Sep 06 01:09:40.571947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.571884    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.574042 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.574024    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 01:09:40.574461 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.574442    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g5vzv\""
Sep 06 01:09:40.574857 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.574839    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 01:09:40.574956 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.574856    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 01:09:40.579799 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.579771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wk7gs"]
Sep 06 01:09:40.580429 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.580388    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cggfs"]
Sep 06 01:09:40.680478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.680438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b6af44-d08a-46b7-9715-054d97e55126-cert\") pod \"ingress-canary-cggfs\" (UID: \"30b6af44-d08a-46b7-9715-054d97e55126\") " pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.680647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.680483    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.680647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.680551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/73b20a23-5d22-43a4-aabe-31648175eee4-config-volume\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.680647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.680578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrrpr\" (UniqueName: \"kubernetes.io/projected/30b6af44-d08a-46b7-9715-054d97e55126-kube-api-access-nrrpr\") pod \"ingress-canary-cggfs\" (UID: \"30b6af44-d08a-46b7-9715-054d97e55126\") " pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.680647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.680593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b20a23-5d22-43a4-aabe-31648175eee4-tmp-dir\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.680647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.680620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrflz\" (UniqueName: \"kubernetes.io/projected/73b20a23-5d22-43a4-aabe-31648175eee4-kube-api-access-vrflz\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.709245 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.709211    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:40.781331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b6af44-d08a-46b7-9715-054d97e55126-cert\") pod \"ingress-canary-cggfs\" (UID: \"30b6af44-d08a-46b7-9715-054d97e55126\") " pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.781331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.781511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/73b20a23-5d22-43a4-aabe-31648175eee4-config-volume\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.781511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrrpr\" (UniqueName: \"kubernetes.io/projected/30b6af44-d08a-46b7-9715-054d97e55126-kube-api-access-nrrpr\") pod \"ingress-canary-cggfs\" (UID: \"30b6af44-d08a-46b7-9715-054d97e55126\") " pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.781511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b20a23-5d22-43a4-aabe-31648175eee4-tmp-dir\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.781511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrflz\" (UniqueName: \"kubernetes.io/projected/73b20a23-5d22-43a4-aabe-31648175eee4-kube-api-access-vrflz\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.781511 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.781493    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:40.781778 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.781553    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls podName:73b20a23-5d22-43a4-aabe-31648175eee4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:41.281533567 +0000 UTC m=+34.556918722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls") pod "dns-default-wk7gs" (UID: "73b20a23-5d22-43a4-aabe-31648175eee4") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:40.782015 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.781990    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b20a23-5d22-43a4-aabe-31648175eee4-tmp-dir\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.782273 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.782255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/73b20a23-5d22-43a4-aabe-31648175eee4-config-volume\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.785916 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.785893    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b6af44-d08a-46b7-9715-054d97e55126-cert\") pod \"ingress-canary-cggfs\" (UID: \"30b6af44-d08a-46b7-9715-054d97e55126\") " pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.790498 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.790478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrflz\" (UniqueName: \"kubernetes.io/projected/73b20a23-5d22-43a4-aabe-31648175eee4-kube-api-access-vrflz\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:40.791779 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.791757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrrpr\" (UniqueName: \"kubernetes.io/projected/30b6af44-d08a-46b7-9715-054d97e55126-kube-api-access-nrrpr\") pod \"ingress-canary-cggfs\" (UID: \"30b6af44-d08a-46b7-9715-054d97e55126\") " pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.810101 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.810074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:40.882460 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.882428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:40.882608 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.882589    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:40.882668 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.882656    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs podName:a65e586b-45e9-45b8-a817-5c82923126f9 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:12.882642737 +0000 UTC m=+66.158027900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs") pod "network-metrics-daemon-hbvbh" (UID: "a65e586b-45e9-45b8-a817-5c82923126f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:40.887383 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.887363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cggfs"
Sep 06 01:09:40.983162 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:40.983124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:40.983307 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.983288    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:40.983380 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:40.983368    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret podName:16bc738a-0b7a-49c9-889e-134d75a20581 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:12.983347617 +0000 UTC m=+66.258732784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret") pod "global-pull-secret-syncer-nnkg9" (UID: "16bc738a-0b7a-49c9-889e-134d75a20581") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:41.083916 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:41.083828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:41.084095 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:41.084035    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:41.084095 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:41.084059    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:41.084095 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:41.084069    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pmxcn for pod openshift-network-diagnostics/network-check-target-5p8b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:41.084256 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:41.084123    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn podName:cf47b4ed-86d9-4781-8d71-a92b6873b5d4 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:13.084105155 +0000 UTC m=+66.359490298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmxcn" (UniqueName: "kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn") pod "network-check-target-5p8b2" (UID: "cf47b4ed-86d9-4781-8d71-a92b6873b5d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:41.285530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:41.285498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:41.286060 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:41.285653    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:41.286060 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:41.285714    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls podName:73b20a23-5d22-43a4-aabe-31648175eee4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:42.285698862 +0000 UTC m=+35.561084003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls") pod "dns-default-wk7gs" (UID: "73b20a23-5d22-43a4-aabe-31648175eee4") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:41.856637 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:41.856580    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cggfs"]
Sep 06 01:09:41.864975 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:41.864742    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b6af44_d08a_46b7_9715_054d97e55126.slice/crio-884d3fb39bb2a0e6403f63b5ee25d7e6f9401a424489d18a694e707912f67b6b WatchSource:0}: Error finding container 884d3fb39bb2a0e6403f63b5ee25d7e6f9401a424489d18a694e707912f67b6b: Status 404 returned error can't find the container with id 884d3fb39bb2a0e6403f63b5ee25d7e6f9401a424489d18a694e707912f67b6b
Sep 06 01:09:42.202193 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.202172    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:09:42.202342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.202255    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:09:42.202342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.202289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:09:42.205851 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.205828    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gxmf\""
Sep 06 01:09:42.205989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.205828    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 01:09:42.205989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.205860    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 01:09:42.205989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.205855    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rhdd5\""
Sep 06 01:09:42.205989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.205865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 01:09:42.205989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.205851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 01:09:42.292745 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.292727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:42.293333 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:42.292827    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:42.293333 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:42.292876    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls podName:73b20a23-5d22-43a4-aabe-31648175eee4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.29285977 +0000 UTC m=+37.568244925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls") pod "dns-default-wk7gs" (UID: "73b20a23-5d22-43a4-aabe-31648175eee4") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:42.358838 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.358816    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-52s8j"]
Sep 06 01:09:42.361864 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.361850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j"
Sep 06 01:09:42.365594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.365579    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5lqvc\""
Sep 06 01:09:42.379394 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.379375    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-52s8j"]
Sep 06 01:09:42.381736 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.381705    2567 generic.go:356] "Generic (PLEG): container finished" podID="dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f" containerID="39d4a2a049e8c97ffb40e103846017a4d47852b37bed8f6c6d9b57095da2247e" exitCode=0
Sep 06 01:09:42.381827 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.381799    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerDied","Data":"39d4a2a049e8c97ffb40e103846017a4d47852b37bed8f6c6d9b57095da2247e"}
Sep 06 01:09:42.383163 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.383143    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cggfs" event={"ID":"30b6af44-d08a-46b7-9715-054d97e55126","Type":"ContainerStarted","Data":"884d3fb39bb2a0e6403f63b5ee25d7e6f9401a424489d18a694e707912f67b6b"}
Sep 06 01:09:42.493499 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.493472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t5qq\" (UniqueName: \"kubernetes.io/projected/94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1-kube-api-access-6t5qq\") pod \"network-check-source-685456655f-52s8j\" (UID: \"94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1\") " pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j"
Sep 06 01:09:42.594675 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.594641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t5qq\" (UniqueName: \"kubernetes.io/projected/94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1-kube-api-access-6t5qq\") pod \"network-check-source-685456655f-52s8j\" (UID: \"94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1\") " pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j"
Sep 06 01:09:42.603902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.603874    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t5qq\" (UniqueName: \"kubernetes.io/projected/94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1-kube-api-access-6t5qq\") pod \"network-check-source-685456655f-52s8j\" (UID: \"94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1\") " pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j"
Sep 06 01:09:42.669667 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.669641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j"
Sep 06 01:09:42.945478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:42.945443    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-52s8j"]
Sep 06 01:09:42.950429 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:42.950393    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b7f39a_b9d9_45f7_a0d8_eaf5a96fbbb1.slice/crio-9590a2c67a9859b942f1a4be387aa8f048833a8761addc5a4d47a0b1b029efa2 WatchSource:0}: Error finding container 9590a2c67a9859b942f1a4be387aa8f048833a8761addc5a4d47a0b1b029efa2: Status 404 returned error can't find the container with id 9590a2c67a9859b942f1a4be387aa8f048833a8761addc5a4d47a0b1b029efa2
Sep 06 01:09:43.386892 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.386848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j" event={"ID":"94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1","Type":"ContainerStarted","Data":"9590a2c67a9859b942f1a4be387aa8f048833a8761addc5a4d47a0b1b029efa2"}
Sep 06 01:09:43.389781 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.389758    2567 generic.go:356] "Generic (PLEG): container finished" podID="dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f" containerID="6843acdeb10cb8c4caafd9d9a2b60b9e34c62898c0edd245a6200c73b54891db" exitCode=0
Sep 06 01:09:43.389961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.389803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerDied","Data":"6843acdeb10cb8c4caafd9d9a2b60b9e34c62898c0edd245a6200c73b54891db"}
Sep 06 01:09:43.633548 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.633511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:43.729511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.729454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:43.749564 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.749167    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-77sth"]
Sep 06 01:09:43.752346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.752324    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:43.755035 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.754802    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 01:09:43.755179 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.755159    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 01:09:43.755436 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.755416    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 01:09:43.755770 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.755753    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5j6d7\""
Sep 06 01:09:43.756650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.756632    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 01:09:43.761478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.761429    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-77sth"]
Sep 06 01:09:43.831141 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.831097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:43.886816 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.886787    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:43.905886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.905799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/33a271a3-491d-4b96-81eb-eb0845197960-crio-socket\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:43.905886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.905849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/33a271a3-491d-4b96-81eb-eb0845197960-data-volume\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:43.906100 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.905982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:43.906100 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.906016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkhtf\" (UniqueName: \"kubernetes.io/projected/33a271a3-491d-4b96-81eb-eb0845197960-kube-api-access-qkhtf\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:43.906100 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:43.906069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.007289 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007207    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.007463 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007300    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/33a271a3-491d-4b96-81eb-eb0845197960-crio-socket\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.007463 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/33a271a3-491d-4b96-81eb-eb0845197960-data-volume\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.007463 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.007463 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.007374    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:44.007463 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkhtf\" (UniqueName: \"kubernetes.io/projected/33a271a3-491d-4b96-81eb-eb0845197960-kube-api-access-qkhtf\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.007463 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.007452    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.507429689 +0000 UTC m=+37.782814854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:44.007726 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.007661    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:44.007726 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.007719    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.507702605 +0000 UTC m=+37.783087752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:44.007942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/33a271a3-491d-4b96-81eb-eb0845197960-crio-socket\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.008157 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.007948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/33a271a3-491d-4b96-81eb-eb0845197960-data-volume\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.019175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.019152    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkhtf\" (UniqueName: \"kubernetes.io/projected/33a271a3-491d-4b96-81eb-eb0845197960-kube-api-access-qkhtf\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.309673 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.309596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:44.309828 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.309782    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:44.309899 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.309843    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls podName:73b20a23-5d22-43a4-aabe-31648175eee4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:48.309828685 +0000 UTC m=+41.585213832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls") pod "dns-default-wk7gs" (UID: "73b20a23-5d22-43a4-aabe-31648175eee4") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:44.395884 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.395714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" event={"ID":"dda4b39f-10ed-4ea8-8f27-b6f4d2c0bb2f","Type":"ContainerStarted","Data":"62270d92729e42e428979bd6e66691e66c72774ae5a464905cc7c670327db300"}
Sep 06 01:09:44.419651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.419582    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gxbvh" podStartSLOduration=8.99829532 podStartE2EDuration="37.419566791s" totalImagesPullingTime="28.421271471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:44.417709668 +0000 UTC m=+37.693094835" watchObservedRunningTime="2026-09-06 01:09:44.419566791 +0000 UTC m=+37.694951955"
Sep 06 01:09:44.511570 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.511548    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.511746 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.511726    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:44.511841 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.511796    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:45.511776242 +0000 UTC m=+38.787161407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:44.511908 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.511877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:44.512150 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.512012    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:44.512150 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:44.512077    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:45.512060553 +0000 UTC m=+38.787445702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:44.540250 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.540222    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:44.632008 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.631973    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"]
Sep 06 01:09:44.636296 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.636258    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:44.647646 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.647615    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"]
Sep 06 01:09:44.647832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.647762    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"
Sep 06 01:09:44.650768 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.650741    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:44.650850 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.650800    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5nl95\""
Sep 06 01:09:44.651188 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.651033    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 06 01:09:44.691592 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.691555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:44.814774 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.814690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg45m\" (UniqueName: \"kubernetes.io/projected/be90b67c-32bd-43b7-a99e-3e47d68ad019-kube-api-access-wg45m\") pod \"migrator-fdbb8fdff-6952s\" (UID: \"be90b67c-32bd-43b7-a99e-3e47d68ad019\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"
Sep 06 01:09:44.915311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.915275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg45m\" (UniqueName: \"kubernetes.io/projected/be90b67c-32bd-43b7-a99e-3e47d68ad019-kube-api-access-wg45m\") pod \"migrator-fdbb8fdff-6952s\" (UID: \"be90b67c-32bd-43b7-a99e-3e47d68ad019\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"
Sep 06 01:09:44.923990 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.923960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg45m\" (UniqueName: \"kubernetes.io/projected/be90b67c-32bd-43b7-a99e-3e47d68ad019-kube-api-access-wg45m\") pod \"migrator-fdbb8fdff-6952s\" (UID: \"be90b67c-32bd-43b7-a99e-3e47d68ad019\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"
Sep 06 01:09:44.960817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:44.960786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"
Sep 06 01:09:45.242903 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.242769    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s"]
Sep 06 01:09:45.245877 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:45.245848    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe90b67c_32bd_43b7_a99e_3e47d68ad019.slice/crio-83ae8730f0e228962e6340e14d2f881790e6907df77687bbb74acac07cce6d81 WatchSource:0}: Error finding container 83ae8730f0e228962e6340e14d2f881790e6907df77687bbb74acac07cce6d81: Status 404 returned error can't find the container with id 83ae8730f0e228962e6340e14d2f881790e6907df77687bbb74acac07cce6d81
Sep 06 01:09:45.309380 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.309349    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8l2x4_261aa706-8c29-460e-b6ec-6808712695d4/dns-node-resolver/0.log"
Sep 06 01:09:45.399490 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.399454    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cggfs" event={"ID":"30b6af44-d08a-46b7-9715-054d97e55126","Type":"ContainerStarted","Data":"59bab761ae279049724c944160681715615a7b5748c46b3990e565ff34fececf"}
Sep 06 01:09:45.400800 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.400775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s" event={"ID":"be90b67c-32bd-43b7-a99e-3e47d68ad019","Type":"ContainerStarted","Data":"83ae8730f0e228962e6340e14d2f881790e6907df77687bbb74acac07cce6d81"}
Sep 06 01:09:45.420202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.419082    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cggfs" podStartSLOduration=2.839703931 podStartE2EDuration="5.419064512s" totalImagesPullingTime="2.579360581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:45.417030885 +0000 UTC m=+38.692416049" watchObservedRunningTime="2026-09-06 01:09:45.419064512 +0000 UTC m=+38.694449676"
Sep 06 01:09:45.520993 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.520897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:45.521132 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:45.521035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:45.521132 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:45.521042    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:45.521132 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:45.521116    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:47.521096057 +0000 UTC m=+40.796481215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:45.521297 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:45.521143    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:45.521297 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:45.521202    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:47.521186875 +0000 UTC m=+40.796572032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:46.090852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.090816    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cc5kz"]
Sep 06 01:09:46.120202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.120171    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cc5kz"]
Sep 06 01:09:46.120354 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.120277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.123108 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.122973    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 06 01:09:46.123108 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.122986    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pxkpg\""
Sep 06 01:09:46.123108 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.123008    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 06 01:09:46.123108 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.123064    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 06 01:09:46.123984 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.123942    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 06 01:09:46.129561 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.129536    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:46.185308 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.185277    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:46.224943 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.224727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b54278f7-019f-4ec8-a86d-c4a183c3dd88-signing-cabundle\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.225117 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.224971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b54278f7-019f-4ec8-a86d-c4a183c3dd88-signing-key\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.225117 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.225032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mfc\" (UniqueName: \"kubernetes.io/projected/b54278f7-019f-4ec8-a86d-c4a183c3dd88-kube-api-access-z6mfc\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.309924 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.309903    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tjsgp_12258b65-fdef-4b24-ae67-bc0deba5fdac/node-ca/0.log"
Sep 06 01:09:46.318906 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.318881    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:46.325646 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.325624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b54278f7-019f-4ec8-a86d-c4a183c3dd88-signing-cabundle\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.325763 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.325662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b54278f7-019f-4ec8-a86d-c4a183c3dd88-signing-key\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.325822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.325805    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mfc\" (UniqueName: \"kubernetes.io/projected/b54278f7-019f-4ec8-a86d-c4a183c3dd88-kube-api-access-z6mfc\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.326332 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.326317    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b54278f7-019f-4ec8-a86d-c4a183c3dd88-signing-cabundle\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.328067 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.328048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b54278f7-019f-4ec8-a86d-c4a183c3dd88-signing-key\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.334365 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.334347    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mfc\" (UniqueName: \"kubernetes.io/projected/b54278f7-019f-4ec8-a86d-c4a183c3dd88-kube-api-access-z6mfc\") pod \"service-ca-75d99c484-cc5kz\" (UID: \"b54278f7-019f-4ec8-a86d-c4a183c3dd88\") " pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.381536 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.381478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:46.431841 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.431823    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-cc5kz"
Sep 06 01:09:46.709908 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.709874    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cggfs_30b6af44-d08a-46b7-9715-054d97e55126/serve-healthcheck-canary/0.log"
Sep 06 01:09:46.720953 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.720896    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cc5kz"]
Sep 06 01:09:46.724034 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:46.724005    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54278f7_019f_4ec8_a86d_c4a183c3dd88.slice/crio-685a68a3f6cc99b785aff188f78072f66a9f2c9cb5f5e95dd7b4ad59cb93cc65 WatchSource:0}: Error finding container 685a68a3f6cc99b785aff188f78072f66a9f2c9cb5f5e95dd7b4ad59cb93cc65: Status 404 returned error can't find the container with id 685a68a3f6cc99b785aff188f78072f66a9f2c9cb5f5e95dd7b4ad59cb93cc65
Sep 06 01:09:46.752097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:46.752069    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:47.406383 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:47.406346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j" event={"ID":"94b7f39a-b9d9-45f7-a0d8-eaf5a96fbbb1","Type":"ContainerStarted","Data":"b9307c4f6c2e3d5a965fee8f369d4f9fa12f5de95e372cd7f9ed3333542c5238"}
Sep 06 01:09:47.407522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:47.407499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-cc5kz" event={"ID":"b54278f7-019f-4ec8-a86d-c4a183c3dd88","Type":"ContainerStarted","Data":"685a68a3f6cc99b785aff188f78072f66a9f2c9cb5f5e95dd7b4ad59cb93cc65"}
Sep 06 01:09:47.426315 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:47.426272    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-52s8j" podStartSLOduration=1.937481633 podStartE2EDuration="5.426258841s" totalImagesPullingTime="3.488777208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:47.425131423 +0000 UTC m=+40.700516586" watchObservedRunningTime="2026-09-06 01:09:47.426258841 +0000 UTC m=+40.701644003"
Sep 06 01:09:47.535158 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:47.535131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:47.535484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:47.535192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:47.535484 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:47.535256    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:47.535484 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:47.535305    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:47.535484 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:47.535315    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:51.535300018 +0000 UTC m=+44.810685179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:47.535484 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:47.535358    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:51.535334468 +0000 UTC m=+44.810719626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:48.341874 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:48.341841    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:48.342060 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:48.342005    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:48.342101 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:48.342067    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls podName:73b20a23-5d22-43a4-aabe-31648175eee4 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:56.34205154 +0000 UTC m=+49.617436705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls") pod "dns-default-wk7gs" (UID: "73b20a23-5d22-43a4-aabe-31648175eee4") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:48.411788 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:48.411753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s" event={"ID":"be90b67c-32bd-43b7-a99e-3e47d68ad019","Type":"ContainerStarted","Data":"80fd12cca6df9d7698501b7cd4a4f961247039a670efd4822284cec19364b3e2"}
Sep 06 01:09:48.411916 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:48.411838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s" event={"ID":"be90b67c-32bd-43b7-a99e-3e47d68ad019","Type":"ContainerStarted","Data":"414cc690cd9f6e8778270898801c74821f5bc7844988faddf5c8255357896314"}
Sep 06 01:09:48.428682 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:48.428605    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6952s" podStartSLOduration=2.142864974 podStartE2EDuration="4.428586833s" totalImagesPullingTime="2.285721859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:48.428399901 +0000 UTC m=+41.703785067" watchObservedRunningTime="2026-09-06 01:09:48.428586833 +0000 UTC m=+41.703971999"
Sep 06 01:09:50.231541 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:50.231508    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:50.418136 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:50.418108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-cc5kz" event={"ID":"b54278f7-019f-4ec8-a86d-c4a183c3dd88","Type":"ContainerStarted","Data":"7525b1e7d847456b62a2d2e6beb61d24dcda16f8e8ebfce8e35445b17e4c3097"}
Sep 06 01:09:50.435526 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:50.435488    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-cc5kz" podStartSLOduration=1.825248551 podStartE2EDuration="4.4354722s" totalImagesPullingTime="2.610223649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:50.434761673 +0000 UTC m=+43.710146835" watchObservedRunningTime="2026-09-06 01:09:50.4354722 +0000 UTC m=+43.710857362"
Sep 06 01:09:50.707173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:50.707142    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:50.813383 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:50.813329    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:50.908530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:50.908501    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:51.017367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:51.017292    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:51.110349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:51.110315    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:51.210860 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:51.210832    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:51.400823 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:51.400750    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:51.567014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:51.566983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:51.567160 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:51.567107    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:51.567160 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:51.567129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:51.567273 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:51.567198    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:59.567177737 +0000 UTC m=+52.842562902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:51.567273 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:51.567238    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:51.567384 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:51.567293    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:59.56728032 +0000 UTC m=+52.842665474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:52.196492 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:52.196459    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:52.603923 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:52.603836    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:56.403613 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:56.403579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:56.405764 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:56.405744    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73b20a23-5d22-43a4-aabe-31648175eee4-metrics-tls\") pod \"dns-default-wk7gs\" (UID: \"73b20a23-5d22-43a4-aabe-31648175eee4\") " pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:56.481480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:56.481450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:56.780947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:56.780909    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wk7gs"]
Sep 06 01:09:56.783587 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:09:56.783559    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b20a23_5d22_43a4_aabe_31648175eee4.slice/crio-b1aa79b80c7bf111d5f2783c2018ee1d8025d2e18f7ebbbc6fa39f20adde7744 WatchSource:0}: Error finding container b1aa79b80c7bf111d5f2783c2018ee1d8025d2e18f7ebbbc6fa39f20adde7744: Status 404 returned error can't find the container with id b1aa79b80c7bf111d5f2783c2018ee1d8025d2e18f7ebbbc6fa39f20adde7744
Sep 06 01:09:57.437589 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:57.437554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wk7gs" event={"ID":"73b20a23-5d22-43a4-aabe-31648175eee4","Type":"ContainerStarted","Data":"b1aa79b80c7bf111d5f2783c2018ee1d8025d2e18f7ebbbc6fa39f20adde7744"}
Sep 06 01:09:59.446760 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:59.446722    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wk7gs" event={"ID":"73b20a23-5d22-43a4-aabe-31648175eee4","Type":"ContainerStarted","Data":"9bd9d60b235a5d719971d78b9245afe91688c791b81ff80e3df242c97572ec7e"}
Sep 06 01:09:59.447173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:59.446778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wk7gs" event={"ID":"73b20a23-5d22-43a4-aabe-31648175eee4","Type":"ContainerStarted","Data":"8c69392d155360ade40e2545df69ebdfd2358cdd8b1bdc4270c0020190c7c590"}
Sep 06 01:09:59.447173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:59.446864    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:09:59.627632 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:59.627592    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:59.627822 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:59.627748    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:59.627822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:59.627799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:09:59.627978 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:09:59.627880    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls podName:33a271a3-491d-4b96-81eb-eb0845197960 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:15.627858864 +0000 UTC m=+68.903244006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77sth" (UID: "33a271a3-491d-4b96-81eb-eb0845197960") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:59.628354 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:09:59.628335    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33a271a3-491d-4b96-81eb-eb0845197960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:10:05.057823 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.057761    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wk7gs" podStartSLOduration=22.983847895 podStartE2EDuration="25.057742401s" totalImagesPullingTime="2.073894506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:59.467037155 +0000 UTC m=+52.742422316" watchObservedRunningTime="2026-09-06 01:10:05.057742401 +0000 UTC m=+58.333127554"
Sep 06 01:10:05.058365 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.058079    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54bb6f6fd7-xkd99"]
Sep 06 01:10:05.088286 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.088249    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54bb6f6fd7-xkd99"]
Sep 06 01:10:05.088415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.088374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.090940 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.090907    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 01:10:05.091085 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.090996    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x5q52\""
Sep 06 01:10:05.091085 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.091011    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 01:10:05.091832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.091814    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 01:10:05.096975 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.096956    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 01:10:05.140791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.140763    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54bb6f6fd7-xkd99"]
Sep 06 01:10:05.141002 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:10:05.140980    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-7z4wj registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-7z4wj registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99" podUID="136c9f91-3a5d-4361-a828-c133e148a466"
Sep 06 01:10:05.158769 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.158748    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-rmlkt"]
Sep 06 01:10:05.178172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.178150    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-5km8n"]
Sep 06 01:10:05.178301 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.178284    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.180735 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.180704    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 06 01:10:05.180848 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.180733    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w6bc2\""
Sep 06 01:10:05.180912 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.180867    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 06 01:10:05.214257 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.214232    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:05.216520 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.216503    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-glvqj\""
Sep 06 01:10:05.216636 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.216504    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 06 01:10:05.216636 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.216568    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 06 01:10:05.218666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.218651    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-rmlkt"]
Sep 06 01:10:05.218748 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.218682    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c6f5b4677-vpfmd"]
Sep 06 01:10:05.232061 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.232040    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-5km8n"]
Sep 06 01:10:05.232150 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.232068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6f5b4677-vpfmd"]
Sep 06 01:10:05.232150 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.232136    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.271144 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-image-registry-private-configuration\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136c9f91-3a5d-4361-a828-c133e148a466-ca-trust-extracted\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-installation-pull-secrets\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271229    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-registry-certificates\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-trusted-ca\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271266    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4wj\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-kube-api-access-7z4wj\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271284    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-bound-sa-token\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.271432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.271309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-registry-tls\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.372417 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drcnl\" (UniqueName: \"kubernetes.io/projected/b7d93543-f806-480e-b623-8b0771e23b3a-kube-api-access-drcnl\") pod \"downloads-85d98c998f-5km8n\" (UID: \"b7d93543-f806-480e-b623-8b0771e23b3a\") " pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:05.372417 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-registry-tls\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.372594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7ddadd7-0214-4c38-a723-aa3608351fda-image-registry-private-configuration\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.372594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7ddadd7-0214-4c38-a723-aa3608351fda-registry-certificates\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.372594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-installation-pull-secrets\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.372594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7ddadd7-0214-4c38-a723-aa3608351fda-ca-trust-extracted\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.372594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9mv\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-kube-api-access-nv9mv\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.372791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372603    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddadd7-0214-4c38-a723-aa3608351fda-trusted-ca\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.372791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4wj\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-kube-api-access-7z4wj\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.372791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0011c0de-f47d-48c1-ae5c-7005535ba710-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-rmlkt\" (UID: \"0011c0de-f47d-48c1-ae5c-7005535ba710\") " pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.372791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372714    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-bound-sa-token\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.372791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0011c0de-f47d-48c1-ae5c-7005535ba710-nginx-conf\") pod \"networking-console-plugin-79977f9844-rmlkt\" (UID: \"0011c0de-f47d-48c1-ae5c-7005535ba710\") " pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.372791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-image-registry-private-configuration\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.373118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-registry-certificates\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.373118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7ddadd7-0214-4c38-a723-aa3608351fda-installation-pull-secrets\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.373118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-registry-tls\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.373118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.372955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-bound-sa-token\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.373118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.373016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136c9f91-3a5d-4361-a828-c133e148a466-ca-trust-extracted\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.373118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.373052    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-trusted-ca\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.373403 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.373383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136c9f91-3a5d-4361-a828-c133e148a466-ca-trust-extracted\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.373764 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.373745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-registry-certificates\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.373905 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.373885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-trusted-ca\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.374958 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.374941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-registry-tls\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.375252 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.375236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-installation-pull-secrets\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.375344 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.375327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-image-registry-private-configuration\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.383132 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.383113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-bound-sa-token\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.383381 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.383364    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4wj\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-kube-api-access-7z4wj\") pod \"image-registry-54bb6f6fd7-xkd99\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") " pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.465283 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.465241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.473830 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.473806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7ddadd7-0214-4c38-a723-aa3608351fda-installation-pull-secrets\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.473975 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.473837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-registry-tls\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.473975 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.473870    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-bound-sa-token\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.473975 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.473919    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drcnl\" (UniqueName: \"kubernetes.io/projected/b7d93543-f806-480e-b623-8b0771e23b3a-kube-api-access-drcnl\") pod \"downloads-85d98c998f-5km8n\" (UID: \"b7d93543-f806-480e-b623-8b0771e23b3a\") " pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:05.474113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.473985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7ddadd7-0214-4c38-a723-aa3608351fda-image-registry-private-configuration\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.474113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7ddadd7-0214-4c38-a723-aa3608351fda-registry-certificates\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.474113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7ddadd7-0214-4c38-a723-aa3608351fda-ca-trust-extracted\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.474113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9mv\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-kube-api-access-nv9mv\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.474113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddadd7-0214-4c38-a723-aa3608351fda-trusted-ca\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.474113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474101    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0011c0de-f47d-48c1-ae5c-7005535ba710-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-rmlkt\" (UID: \"0011c0de-f47d-48c1-ae5c-7005535ba710\") " pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.474413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0011c0de-f47d-48c1-ae5c-7005535ba710-nginx-conf\") pod \"networking-console-plugin-79977f9844-rmlkt\" (UID: \"0011c0de-f47d-48c1-ae5c-7005535ba710\") " pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.474808 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474459    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7ddadd7-0214-4c38-a723-aa3608351fda-ca-trust-extracted\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.474940 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.474837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0011c0de-f47d-48c1-ae5c-7005535ba710-nginx-conf\") pod \"networking-console-plugin-79977f9844-rmlkt\" (UID: \"0011c0de-f47d-48c1-ae5c-7005535ba710\") " pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.475249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.475226    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7ddadd7-0214-4c38-a723-aa3608351fda-registry-certificates\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.475334 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.475279    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddadd7-0214-4c38-a723-aa3608351fda-trusted-ca\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.476458 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.476432    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7ddadd7-0214-4c38-a723-aa3608351fda-installation-pull-secrets\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.476550 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.476496    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-registry-tls\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.476605 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.476589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7ddadd7-0214-4c38-a723-aa3608351fda-image-registry-private-configuration\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.476978 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.476959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0011c0de-f47d-48c1-ae5c-7005535ba710-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-rmlkt\" (UID: \"0011c0de-f47d-48c1-ae5c-7005535ba710\") " pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.484535 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.484508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-bound-sa-token\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.487107 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.487089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt"
Sep 06 01:10:05.487508 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.487488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drcnl\" (UniqueName: \"kubernetes.io/projected/b7d93543-f806-480e-b623-8b0771e23b3a-kube-api-access-drcnl\") pod \"downloads-85d98c998f-5km8n\" (UID: \"b7d93543-f806-480e-b623-8b0771e23b3a\") " pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:05.487721 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.487704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9mv\" (UniqueName: \"kubernetes.io/projected/e7ddadd7-0214-4c38-a723-aa3608351fda-kube-api-access-nv9mv\") pod \"image-registry-7c6f5b4677-vpfmd\" (UID: \"e7ddadd7-0214-4c38-a723-aa3608351fda\") " pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.503699 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.503661    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:05.522617 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.522603    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:05.539881 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.539860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:05.676466 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676433    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-installation-pull-secrets\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676466 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676466    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z4wj\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-kube-api-access-7z4wj\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676492    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136c9f91-3a5d-4361-a828-c133e148a466-ca-trust-extracted\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676516    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-trusted-ca\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676607    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-bound-sa-token\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676654    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-image-registry-private-configuration\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676946 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676741    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136c9f91-3a5d-4361-a828-c133e148a466-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:10:05.676946 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676777    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-registry-certificates\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.676946 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676848    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-registry-tls\") pod \"136c9f91-3a5d-4361-a828-c133e148a466\" (UID: \"136c9f91-3a5d-4361-a828-c133e148a466\") "
Sep 06 01:10:05.677110 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.676983    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:05.677169 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.677102    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136c9f91-3a5d-4361-a828-c133e148a466-ca-trust-extracted\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.677169 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.677122    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-trusted-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.677169 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.677132    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:05.678732 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.678704    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-kube-api-access-7z4wj" (OuterVolumeSpecName: "kube-api-access-7z4wj") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "kube-api-access-7z4wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:05.678732 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.678719    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:05.678732 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.678722    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:05.678918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.678901    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:05.679056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.679040    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "136c9f91-3a5d-4361-a828-c133e148a466" (UID: "136c9f91-3a5d-4361-a828-c133e148a466"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:05.777506 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.777477    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-image-registry-private-configuration\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.777506 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.777504    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136c9f91-3a5d-4361-a828-c133e148a466-registry-certificates\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.777666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.777516    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-registry-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.777666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.777524    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136c9f91-3a5d-4361-a828-c133e148a466-installation-pull-secrets\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.777666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.777533    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z4wj\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-kube-api-access-7z4wj\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.777666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.777541    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136c9f91-3a5d-4361-a828-c133e148a466-bound-sa-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:10:05.789346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.789325    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-rmlkt"]
Sep 06 01:10:05.792205 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:05.792182    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0011c0de_f47d_48c1_ae5c_7005535ba710.slice/crio-14c6994ef51c5ceedfac02e246b1d000c740a9c7d28b584150249bf7685a14d6 WatchSource:0}: Error finding container 14c6994ef51c5ceedfac02e246b1d000c740a9c7d28b584150249bf7685a14d6: Status 404 returned error can't find the container with id 14c6994ef51c5ceedfac02e246b1d000c740a9c7d28b584150249bf7685a14d6
Sep 06 01:10:05.813602 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.813530    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-5km8n"]
Sep 06 01:10:05.815753 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:05.815726    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d93543_f806_480e_b623_8b0771e23b3a.slice/crio-d47a84901aceae16c33da22ad06ab79ba52d14aa8ce3f0505d1139786c9a75e1 WatchSource:0}: Error finding container d47a84901aceae16c33da22ad06ab79ba52d14aa8ce3f0505d1139786c9a75e1: Status 404 returned error can't find the container with id d47a84901aceae16c33da22ad06ab79ba52d14aa8ce3f0505d1139786c9a75e1
Sep 06 01:10:05.847843 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:05.847817    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6f5b4677-vpfmd"]
Sep 06 01:10:05.850826 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:05.850791    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ddadd7_0214_4c38_a723_aa3608351fda.slice/crio-c2bb788e58c14c08ce256b7924f6cc699c34fc3368bbe88249f488c28a471077 WatchSource:0}: Error finding container c2bb788e58c14c08ce256b7924f6cc699c34fc3368bbe88249f488c28a471077: Status 404 returned error can't find the container with id c2bb788e58c14c08ce256b7924f6cc699c34fc3368bbe88249f488c28a471077
Sep 06 01:10:06.374161 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.374131    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hm2s"
Sep 06 01:10:06.471010 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.470890    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-5km8n" event={"ID":"b7d93543-f806-480e-b623-8b0771e23b3a","Type":"ContainerStarted","Data":"d47a84901aceae16c33da22ad06ab79ba52d14aa8ce3f0505d1139786c9a75e1"}
Sep 06 01:10:06.472418 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.472377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt" event={"ID":"0011c0de-f47d-48c1-ae5c-7005535ba710","Type":"ContainerStarted","Data":"14c6994ef51c5ceedfac02e246b1d000c740a9c7d28b584150249bf7685a14d6"}
Sep 06 01:10:06.474397 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.474367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd" event={"ID":"e7ddadd7-0214-4c38-a723-aa3608351fda","Type":"ContainerStarted","Data":"43ab1b93a680d5c8d1fb7fdfc0fe0f92fa885720e8e0039ac17f87f15cefd912"}
Sep 06 01:10:06.474513 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.474410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd" event={"ID":"e7ddadd7-0214-4c38-a723-aa3608351fda","Type":"ContainerStarted","Data":"c2bb788e58c14c08ce256b7924f6cc699c34fc3368bbe88249f488c28a471077"}
Sep 06 01:10:06.474513 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.474382    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bb6f6fd7-xkd99"
Sep 06 01:10:06.474650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.474622    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:06.500920 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.500859    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd" podStartSLOduration=1.50084028 podStartE2EDuration="1.50084028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:06.499910682 +0000 UTC m=+59.775295851" watchObservedRunningTime="2026-09-06 01:10:06.50084028 +0000 UTC m=+59.776225440"
Sep 06 01:10:06.530604 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.530537    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54bb6f6fd7-xkd99"]
Sep 06 01:10:06.534336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:06.534292    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54bb6f6fd7-xkd99"]
Sep 06 01:10:07.206985 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:07.206948    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136c9f91-3a5d-4361-a828-c133e148a466" path="/var/lib/kubelet/pods/136c9f91-3a5d-4361-a828-c133e148a466/volumes"
Sep 06 01:10:07.481022 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:07.480954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt" event={"ID":"0011c0de-f47d-48c1-ae5c-7005535ba710","Type":"ContainerStarted","Data":"1074a857cf3727af35de2a3a87ac86279a7aeb2fe8d4426fa874f54e1bffca39"}
Sep 06 01:10:07.496621 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:07.496572    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-rmlkt" podStartSLOduration=1.139668135 podStartE2EDuration="2.496552537s" totalImagesPullingTime="1.356884402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:07.496063979 +0000 UTC m=+60.771449145" watchObservedRunningTime="2026-09-06 01:10:07.496552537 +0000 UTC m=+60.771937701"
Sep 06 01:10:09.452949 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:09.452909    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wk7gs"
Sep 06 01:10:12.934216 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:12.934175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:10:12.936894 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:12.936856    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 01:10:12.947499 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:12.947471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65e586b-45e9-45b8-a817-5c82923126f9-metrics-certs\") pod \"network-metrics-daemon-hbvbh\" (UID: \"a65e586b-45e9-45b8-a817-5c82923126f9\") " pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:10:13.035421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.035387    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:10:13.037861 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.037842    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 01:10:13.048516 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.048492    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16bc738a-0b7a-49c9-889e-134d75a20581-original-pull-secret\") pod \"global-pull-secret-syncer-nnkg9\" (UID: \"16bc738a-0b7a-49c9-889e-134d75a20581\") " pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:10:13.111669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.111636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnkg9"
Sep 06 01:10:13.123719 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.123690    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rhdd5\""
Sep 06 01:10:13.131625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.131602    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbvbh"
Sep 06 01:10:13.136091 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.136069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:10:13.138747 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.138729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxcn\" (UniqueName: \"kubernetes.io/projected/cf47b4ed-86d9-4781-8d71-a92b6873b5d4-kube-api-access-pmxcn\") pod \"network-check-target-5p8b2\" (UID: \"cf47b4ed-86d9-4781-8d71-a92b6873b5d4\") " pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:10:13.414618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.414594    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nnkg9"]
Sep 06 01:10:13.417071 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:13.417039    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16bc738a_0b7a_49c9_889e_134d75a20581.slice/crio-43ee41d05fa2af38ef466e6679db16e82b8e8bf52f9b983202af327a82ca4208 WatchSource:0}: Error finding container 43ee41d05fa2af38ef466e6679db16e82b8e8bf52f9b983202af327a82ca4208: Status 404 returned error can't find the container with id 43ee41d05fa2af38ef466e6679db16e82b8e8bf52f9b983202af327a82ca4208
Sep 06 01:10:13.419016 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.418994    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gxmf\""
Sep 06 01:10:13.427521 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.427499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:10:13.453420 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.453388    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbvbh"]
Sep 06 01:10:13.456480 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:13.456452    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65e586b_45e9_45b8_a817_5c82923126f9.slice/crio-8f1e6f01b153a5003b962f87e1f3265a01c0f511445fe7f2d90ac415091ddca9 WatchSource:0}: Error finding container 8f1e6f01b153a5003b962f87e1f3265a01c0f511445fe7f2d90ac415091ddca9: Status 404 returned error can't find the container with id 8f1e6f01b153a5003b962f87e1f3265a01c0f511445fe7f2d90ac415091ddca9
Sep 06 01:10:13.505561 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.505527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nnkg9" event={"ID":"16bc738a-0b7a-49c9-889e-134d75a20581","Type":"ContainerStarted","Data":"43ee41d05fa2af38ef466e6679db16e82b8e8bf52f9b983202af327a82ca4208"}
Sep 06 01:10:13.507725 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.507641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbvbh" event={"ID":"a65e586b-45e9-45b8-a817-5c82923126f9","Type":"ContainerStarted","Data":"8f1e6f01b153a5003b962f87e1f3265a01c0f511445fe7f2d90ac415091ddca9"}
Sep 06 01:10:13.707549 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:13.707415    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5p8b2"]
Sep 06 01:10:13.711790 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:13.711761    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf47b4ed_86d9_4781_8d71_a92b6873b5d4.slice/crio-72c764f44751d34fbc17bc0e3db93ecc25433d61c49fe5191453bdaaab2ab4ab WatchSource:0}: Error finding container 72c764f44751d34fbc17bc0e3db93ecc25433d61c49fe5191453bdaaab2ab4ab: Status 404 returned error can't find the container with id 72c764f44751d34fbc17bc0e3db93ecc25433d61c49fe5191453bdaaab2ab4ab
Sep 06 01:10:14.513670 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:14.513638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5p8b2" event={"ID":"cf47b4ed-86d9-4781-8d71-a92b6873b5d4","Type":"ContainerStarted","Data":"5c8565773deb1982409f70f87e421977457201def2571dbce32e286c9499f6e0"}
Sep 06 01:10:14.514021 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:14.513698    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5p8b2" event={"ID":"cf47b4ed-86d9-4781-8d71-a92b6873b5d4","Type":"ContainerStarted","Data":"72c764f44751d34fbc17bc0e3db93ecc25433d61c49fe5191453bdaaab2ab4ab"}
Sep 06 01:10:14.514021 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:14.513781    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:10:14.532646 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:14.532599    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5p8b2" podStartSLOduration=67.532579348 podStartE2EDuration="1m7.532579348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:14.531603901 +0000 UTC m=+67.806989103" watchObservedRunningTime="2026-09-06 01:10:14.532579348 +0000 UTC m=+67.807964514"
Sep 06 01:10:15.521062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.521024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbvbh" event={"ID":"a65e586b-45e9-45b8-a817-5c82923126f9","Type":"ContainerStarted","Data":"fa7f87d22e17c7c92ad101b41fe3b241bb90d185db392f970457241dba5f38b8"}
Sep 06 01:10:15.521523 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.521088    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbvbh" event={"ID":"a65e586b-45e9-45b8-a817-5c82923126f9","Type":"ContainerStarted","Data":"da9cd905016e1b9652499cb7dc087c6b78ade6836ca9f1f10349a994576c6b0b"}
Sep 06 01:10:15.540360 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.540076    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hbvbh" podStartSLOduration=67.555038685 podStartE2EDuration="1m8.54005624s" totalImagesPullingTime="985.017555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:15.53909291 +0000 UTC m=+68.814478074" watchObservedRunningTime="2026-09-06 01:10:15.54005624 +0000 UTC m=+68.815441408"
Sep 06 01:10:15.659356 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.659249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:10:15.662174 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.662148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33a271a3-491d-4b96-81eb-eb0845197960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77sth\" (UID: \"33a271a3-491d-4b96-81eb-eb0845197960\") " pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:10:15.870195 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.870092    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5j6d7\""
Sep 06 01:10:15.877679 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:15.877657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-77sth"
Sep 06 01:10:23.549201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.549069    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-77sth"]
Sep 06 01:10:23.555450 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:23.555384    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a271a3_491d_4b96_81eb_eb0845197960.slice/crio-72aa3b3fdb0822e8b0b5174c9fffa94f216fb28af106a884c4d94df7abf6ba0d WatchSource:0}: Error finding container 72aa3b3fdb0822e8b0b5174c9fffa94f216fb28af106a884c4d94df7abf6ba0d: Status 404 returned error can't find the container with id 72aa3b3fdb0822e8b0b5174c9fffa94f216fb28af106a884c4d94df7abf6ba0d
Sep 06 01:10:23.558195 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.557749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-5km8n" event={"ID":"b7d93543-f806-480e-b623-8b0771e23b3a","Type":"ContainerStarted","Data":"c2c68ea228a527b6594ef53f691bbd6b555ff4d1ed2c6a2cfc050c84db1d7e16"}
Sep 06 01:10:23.558267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.558213    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:23.559995 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.559952    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nnkg9" event={"ID":"16bc738a-0b7a-49c9-889e-134d75a20581","Type":"ContainerStarted","Data":"309146d49abc68e0d61280220b57508bbf63d16086bba048116d0af2fd2f28c3"}
Sep 06 01:10:23.573218 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.573198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-5km8n"
Sep 06 01:10:23.577256 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.577216    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-5km8n" podStartSLOduration=1.051237415 podStartE2EDuration="18.577201518s" totalImagesPullingTime="17.525964103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:23.575990625 +0000 UTC m=+76.851375784" watchObservedRunningTime="2026-09-06 01:10:23.577201518 +0000 UTC m=+76.852586682"
Sep 06 01:10:23.590714 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:23.590437    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nnkg9" podStartSLOduration=66.718250536 podStartE2EDuration="1m16.590420323s" totalImagesPullingTime="9.872169787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:23.590014962 +0000 UTC m=+76.865400126" watchObservedRunningTime="2026-09-06 01:10:23.590420323 +0000 UTC m=+76.865805488"
Sep 06 01:10:24.332292 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.332261    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fx7gx"]
Sep 06 01:10:24.337027 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.337004    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.341491 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.341464    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 01:10:24.341702 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.341684    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 01:10:24.341901 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.341880    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 01:10:24.346899 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.346859    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 01:10:24.348659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.348133    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 01:10:24.348659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.348365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qk4l2\""
Sep 06 01:10:24.349037 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.348923    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.423812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.423853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4dgl\" (UniqueName: \"kubernetes.io/projected/7e7b6946-7cf2-4b78-badd-6617a1eabba7-kube-api-access-r4dgl\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.423887    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-sys\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.423913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e7b6946-7cf2-4b78-badd-6617a1eabba7-metrics-client-ca\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.424010    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.424037    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-wtmp\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.424077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-textfile\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.424100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-tls\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.424249 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.424160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-root\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525361 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525279    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e7b6946-7cf2-4b78-badd-6617a1eabba7-metrics-client-ca\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525361 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525361 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-wtmp\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-textfile\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-tls\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525476    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-root\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525548    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dgl\" (UniqueName: \"kubernetes.io/projected/7e7b6946-7cf2-4b78-badd-6617a1eabba7-kube-api-access-r4dgl\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-sys\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525659    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-sys\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525769    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-root\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-textfile\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.525902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-wtmp\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.526109 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.525975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e7b6946-7cf2-4b78-badd-6617a1eabba7-metrics-client-ca\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.526109 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.526021    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.534987 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.528459    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-tls\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.535435 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.535396    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e7b6946-7cf2-4b78-badd-6617a1eabba7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.549944 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.547046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4dgl\" (UniqueName: \"kubernetes.io/projected/7e7b6946-7cf2-4b78-badd-6617a1eabba7-kube-api-access-r4dgl\") pod \"node-exporter-fx7gx\" (UID: \"7e7b6946-7cf2-4b78-badd-6617a1eabba7\") " pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:24.589432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.588872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77sth" event={"ID":"33a271a3-491d-4b96-81eb-eb0845197960","Type":"ContainerStarted","Data":"57eb0bfa43678b3f7a3d61e3a2de7e37b6676dd43886c2c6e648564d4ea372a4"}
Sep 06 01:10:24.589432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.588960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77sth" event={"ID":"33a271a3-491d-4b96-81eb-eb0845197960","Type":"ContainerStarted","Data":"8c17687fe2bb5ce4b9292df58ecd0d185421e98a7e7cbd4b38b82377a6292fb3"}
Sep 06 01:10:24.589432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.589006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77sth" event={"ID":"33a271a3-491d-4b96-81eb-eb0845197960","Type":"ContainerStarted","Data":"72aa3b3fdb0822e8b0b5174c9fffa94f216fb28af106a884c4d94df7abf6ba0d"}
Sep 06 01:10:24.652083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:24.652043    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fx7gx"
Sep 06 01:10:25.400170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.400133    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:10:25.425770 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.425018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.427427 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.427034    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:10:25.430814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430265    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 06 01:10:25.430814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430378    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 06 01:10:25.430814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430521    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 06 01:10:25.430814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430567    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 06 01:10:25.430814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430738    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 06 01:10:25.430814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430741    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 06 01:10:25.431226 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.430906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 06 01:10:25.431226 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.431161    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pl75p\""
Sep 06 01:10:25.434183 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.431677    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 06 01:10:25.440594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.440333    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535370    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535480    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-out\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6l5k\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-kube-api-access-f6l5k\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-web-config\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535605    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.536557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.535817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.593820 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.593781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fx7gx" event={"ID":"7e7b6946-7cf2-4b78-badd-6617a1eabba7","Type":"ContainerStarted","Data":"3786714bef6d4aa14e592c4a5736404aa389637a52ed8e4f710944d6d1bcd166"}
Sep 06 01:10:25.636373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636340    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636537 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6l5k\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-kube-api-access-f6l5k\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636537 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636537 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-web-config\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636537 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636745 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636631    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636745 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636837 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636837 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.636837 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.637039 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.637039 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.637039 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.636959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-out\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.638571 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.637210    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.638571 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:10:25.637352    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 06 01:10:25.638571 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:10:25.637416    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls podName:ac827fee-b3a6-45a7-aec4-fd70f1c5769f nodeName:}" failed. No retries permitted until 2026-09-06 01:10:26.137395463 +0000 UTC m=+79.412780627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f") : secret "alertmanager-main-tls" not found
Sep 06 01:10:25.638571 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.638131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.640945 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.638815    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.640945 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.640780    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.641063 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.641039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.642679 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.642657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.642811 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.642787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.643020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.642999    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.644615 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.644590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-web-config\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.644973 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.644917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-out\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.645274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.645252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:25.646297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:25.646280    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6l5k\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-kube-api-access-f6l5k\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:26.141808 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:26.141769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:26.144503 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:26.144474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:26.343103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:26.343065    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:10:27.329229 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.329194    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:10:27.365326 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:27.365277    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac827fee_b3a6_45a7_aec4_fd70f1c5769f.slice/crio-fe05ba6ce824e4e29b0244ce4fe535e9583a56e61c0101f3bd3ad52712ecd5e6 WatchSource:0}: Error finding container fe05ba6ce824e4e29b0244ce4fe535e9583a56e61c0101f3bd3ad52712ecd5e6: Status 404 returned error can't find the container with id fe05ba6ce824e4e29b0244ce4fe535e9583a56e61c0101f3bd3ad52712ecd5e6
Sep 06 01:10:27.486438 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.486363    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c6f5b4677-vpfmd"
Sep 06 01:10:27.604478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.604443    2567 generic.go:356] "Generic (PLEG): container finished" podID="7e7b6946-7cf2-4b78-badd-6617a1eabba7" containerID="f3ed34cdda5cd45744be0dd984644db59fa21c15b7154a6467feb8faf68db797" exitCode=0
Sep 06 01:10:27.604653 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.604539    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fx7gx" event={"ID":"7e7b6946-7cf2-4b78-badd-6617a1eabba7","Type":"ContainerDied","Data":"f3ed34cdda5cd45744be0dd984644db59fa21c15b7154a6467feb8faf68db797"}
Sep 06 01:10:27.607298 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.607231    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77sth" event={"ID":"33a271a3-491d-4b96-81eb-eb0845197960","Type":"ContainerStarted","Data":"23ff891f293517d57b792078b56c92221450e8c746e887e277b3b8225c287030"}
Sep 06 01:10:27.609047 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.609023    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"fe05ba6ce824e4e29b0244ce4fe535e9583a56e61c0101f3bd3ad52712ecd5e6"}
Sep 06 01:10:27.654123 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:27.654077    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-77sth" podStartSLOduration=41.407250774 podStartE2EDuration="44.654059995s" totalImagesPullingTime="3.246809221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:27.652437407 +0000 UTC m=+80.927822597" watchObservedRunningTime="2026-09-06 01:10:27.654059995 +0000 UTC m=+80.929445160"
Sep 06 01:10:28.615918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:28.615875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fx7gx" event={"ID":"7e7b6946-7cf2-4b78-badd-6617a1eabba7","Type":"ContainerStarted","Data":"4c2cbb10ee1a4e42992b43a9af4f91ce0396d04d07d32186ed4c1f70d47bf0db"}
Sep 06 01:10:28.616379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:28.615967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fx7gx" event={"ID":"7e7b6946-7cf2-4b78-badd-6617a1eabba7","Type":"ContainerStarted","Data":"d7837bf5730e68cc0faa91e91a66cd9c5c9fe2e4f9244fd0a5d02078a373efaf"}
Sep 06 01:10:28.650157 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:28.650104    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fx7gx" podStartSLOduration=2.289238172 podStartE2EDuration="4.650084489s" totalImagesPullingTime="2.272808559s" totalInitContainerRuntime="88.037758ms" isStatefulPod=true podCreationTimestamp="2026-09-06 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:28.64919325 +0000 UTC m=+81.924578412" watchObservedRunningTime="2026-09-06 01:10:28.650084489 +0000 UTC m=+81.925469653"
Sep 06 01:10:29.538860 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.538824    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55988bcc46-6tsp9"]
Sep 06 01:10:29.554906 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.554866    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.555311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.555093    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55988bcc46-6tsp9"]
Sep 06 01:10:29.557533 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.557503    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 06 01:10:29.557639 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.557568    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 06 01:10:29.557639 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.557511    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 06 01:10:29.557855 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.557831    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vlfk6\""
Sep 06 01:10:29.558070 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.558051    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 06 01:10:29.558255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.558238    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 06 01:10:29.563858 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.562619    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 06 01:10:29.622346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.622228    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71" exitCode=0
Sep 06 01:10:29.622346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.622314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"}
Sep 06 01:10:29.669617 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-federate-client-tls\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.669757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669621    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.669757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669709    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-telemeter-client-tls\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.669757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.669957 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669780    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-secret-telemeter-client\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.669957 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-metrics-client-ca\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.670103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.669973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b42v7\" (UniqueName: \"kubernetes.io/projected/493f6e16-348f-4353-a3f2-661fcaa78c5c-kube-api-access-b42v7\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.670353 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.670332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-serving-certs-ca-bundle\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772046 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.771996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-federate-client-tls\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772046 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-telemeter-client-tls\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-secret-telemeter-client\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-metrics-client-ca\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772527 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b42v7\" (UniqueName: \"kubernetes.io/projected/493f6e16-348f-4353-a3f2-661fcaa78c5c-kube-api-access-b42v7\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.772982 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.772957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-serving-certs-ca-bundle\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.773468 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.773442    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.773588 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.773344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-metrics-client-ca\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.775245 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.775218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-telemeter-client-tls\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.775362 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.775299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-secret-telemeter-client\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.775362 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.775336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-federate-client-tls\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.776152 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.776131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493f6e16-348f-4353-a3f2-661fcaa78c5c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.777979 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.777920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493f6e16-348f-4353-a3f2-661fcaa78c5c-serving-certs-ca-bundle\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.780795 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.780775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b42v7\" (UniqueName: \"kubernetes.io/projected/493f6e16-348f-4353-a3f2-661fcaa78c5c-kube-api-access-b42v7\") pod \"telemeter-client-55988bcc46-6tsp9\" (UID: \"493f6e16-348f-4353-a3f2-661fcaa78c5c\") " pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:29.867282 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:29.867218    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9"
Sep 06 01:10:30.168779 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:30.168743    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55988bcc46-6tsp9"]
Sep 06 01:10:30.174738 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:10:30.174547    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493f6e16_348f_4353_a3f2_661fcaa78c5c.slice/crio-c13c708d2e7010ace3e25ec86661d283749e195a0ff6fa6999ffb7079fbf7251 WatchSource:0}: Error finding container c13c708d2e7010ace3e25ec86661d283749e195a0ff6fa6999ffb7079fbf7251: Status 404 returned error can't find the container with id c13c708d2e7010ace3e25ec86661d283749e195a0ff6fa6999ffb7079fbf7251
Sep 06 01:10:30.630057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:30.629970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9" event={"ID":"493f6e16-348f-4353-a3f2-661fcaa78c5c","Type":"ContainerStarted","Data":"c13c708d2e7010ace3e25ec86661d283749e195a0ff6fa6999ffb7079fbf7251"}
Sep 06 01:10:32.640956 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:32.640877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"}
Sep 06 01:10:32.641305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:32.640981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"}
Sep 06 01:10:33.650366 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.650327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"}
Sep 06 01:10:33.650886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.650445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"}
Sep 06 01:10:33.650886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.650484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"}
Sep 06 01:10:33.653038 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.653011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9" event={"ID":"493f6e16-348f-4353-a3f2-661fcaa78c5c","Type":"ContainerStarted","Data":"4d25112096554656c60b211771b172d66b8db2145fb5b1e9fbb59519ca064b6e"}
Sep 06 01:10:33.653153 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.653073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9" event={"ID":"493f6e16-348f-4353-a3f2-661fcaa78c5c","Type":"ContainerStarted","Data":"7217541b11741583aac432b354c52918dea5f301d1ad726dce1cc6775becdbce"}
Sep 06 01:10:33.653153 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.653104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9" event={"ID":"493f6e16-348f-4353-a3f2-661fcaa78c5c","Type":"ContainerStarted","Data":"30365fb18526e8ce698458d39706bc0eb140d4a1883458f6cb44c69203fff6dc"}
Sep 06 01:10:33.676727 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:33.676674    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55988bcc46-6tsp9" podStartSLOduration=2.181317193 podStartE2EDuration="4.676655894s" totalImagesPullingTime="2.495338701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:33.674979062 +0000 UTC m=+86.950364226" watchObservedRunningTime="2026-09-06 01:10:33.676655894 +0000 UTC m=+86.952041059"
Sep 06 01:10:34.661675 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:34.661584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerStarted","Data":"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"}
Sep 06 01:10:34.689909 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:34.689860    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.696916147 podStartE2EDuration="9.689845653s" totalImagesPullingTime="4.967463049s" totalInitContainerRuntime="25.466457ms" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:34.687578204 +0000 UTC m=+87.962963380" watchObservedRunningTime="2026-09-06 01:10:34.689845653 +0000 UTC m=+87.965230816"
Sep 06 01:10:45.524115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:10:45.524082    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5p8b2"
Sep 06 01:11:44.657642 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657556    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:11:44.658065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657832    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="alertmanager" containerID="cri-o://c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989" gracePeriod=120
Sep 06 01:11:44.658065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657886    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-metric" containerID="cri-o://deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02" gracePeriod=120
Sep 06 01:11:44.658065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657949    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy" containerID="cri-o://0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106" gracePeriod=120
Sep 06 01:11:44.658065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657950    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="config-reloader" containerID="cri-o://743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b" gracePeriod=120
Sep 06 01:11:44.658065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657965    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="prom-label-proxy" containerID="cri-o://610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8" gracePeriod=120
Sep 06 01:11:44.658065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.657894    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-web" containerID="cri-o://5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7" gracePeriod=120
Sep 06 01:11:44.922116 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922089    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8" exitCode=0
Sep 06 01:11:44.922116 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922113    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106" exitCode=0
Sep 06 01:11:44.922116 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922119    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b" exitCode=0
Sep 06 01:11:44.922306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922125    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989" exitCode=0
Sep 06 01:11:44.922306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"}
Sep 06 01:11:44.922306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922226    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"}
Sep 06 01:11:44.922306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"}
Sep 06 01:11:44.922306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:44.922276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"}
Sep 06 01:11:45.892945 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.892905    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:45.920020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.919987    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-trusted-ca-bundle\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920159 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920047    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-web\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920159 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920077    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-web-config\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920159 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920105    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920159 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920141    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-volume\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920229    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920264    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-out\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920313    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-tls-assets\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920347    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-main-db\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920609 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:45.920609 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6l5k\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-kube-api-access-f6l5k\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920609 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920421    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-cluster-tls-config\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920609 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920457    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-metrics-client-ca\") pod \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\" (UID: \"ac827fee-b3a6-45a7-aec4-fd70f1c5769f\") "
Sep 06 01:11:45.920863 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.920657    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:45.921421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.921167    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:45.923046 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.923018    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:11:45.923884 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.923848    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.924122 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.924024    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.924244 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.924213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.924244 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.924225    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-out" (OuterVolumeSpecName: "config-out") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:11:45.925771 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.924434    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-volume" (OuterVolumeSpecName: "config-volume") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.925771 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.925099    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-kube-api-access-f6l5k" (OuterVolumeSpecName: "kube-api-access-f6l5k") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "kube-api-access-f6l5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:11:45.925771 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.925547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.927281 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.927174    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:11:45.930682 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.930649    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.934253 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934229    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02" exitCode=0
Sep 06 01:11:45.934253 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934251    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerID="5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7" exitCode=0
Sep 06 01:11:45.934414 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934320    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:45.934414 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934317    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"}
Sep 06 01:11:45.934414 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934398    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"}
Sep 06 01:11:45.934561 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac827fee-b3a6-45a7-aec4-fd70f1c5769f","Type":"ContainerDied","Data":"fe05ba6ce824e4e29b0244ce4fe535e9583a56e61c0101f3bd3ad52712ecd5e6"}
Sep 06 01:11:45.934561 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.934467    2567 scope.go:117] "RemoveContainer" containerID="610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"
Sep 06 01:11:45.936760 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.936739    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-web-config" (OuterVolumeSpecName: "web-config") pod "ac827fee-b3a6-45a7-aec4-fd70f1c5769f" (UID: "ac827fee-b3a6-45a7-aec4-fd70f1c5769f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:45.944104 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.944085    2567 scope.go:117] "RemoveContainer" containerID="deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"
Sep 06 01:11:45.951366 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.951337    2567 scope.go:117] "RemoveContainer" containerID="0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"
Sep 06 01:11:45.957614 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.957593    2567 scope.go:117] "RemoveContainer" containerID="5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"
Sep 06 01:11:45.965953 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.965895    2567 scope.go:117] "RemoveContainer" containerID="743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"
Sep 06 01:11:45.973615 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.973598    2567 scope.go:117] "RemoveContainer" containerID="c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"
Sep 06 01:11:45.981015 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.980997    2567 scope.go:117] "RemoveContainer" containerID="69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"
Sep 06 01:11:45.988231 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.988209    2567 scope.go:117] "RemoveContainer" containerID="610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"
Sep 06 01:11:45.988550 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.988522    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8\": container with ID starting with 610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8 not found: ID does not exist" containerID="610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"
Sep 06 01:11:45.988637 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.988561    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"} err="failed to get container status \"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8\": rpc error: code = NotFound desc = could not find container \"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8\": container with ID starting with 610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8 not found: ID does not exist"
Sep 06 01:11:45.988637 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.988602    2567 scope.go:117] "RemoveContainer" containerID="deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"
Sep 06 01:11:45.988913 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.988894    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02\": container with ID starting with deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02 not found: ID does not exist" containerID="deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"
Sep 06 01:11:45.988977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.988922    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"} err="failed to get container status \"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02\": rpc error: code = NotFound desc = could not find container \"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02\": container with ID starting with deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02 not found: ID does not exist"
Sep 06 01:11:45.988977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.988957    2567 scope.go:117] "RemoveContainer" containerID="0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"
Sep 06 01:11:45.989209 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.989188    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106\": container with ID starting with 0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106 not found: ID does not exist" containerID="0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"
Sep 06 01:11:45.989246 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.989219    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"} err="failed to get container status \"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106\": rpc error: code = NotFound desc = could not find container \"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106\": container with ID starting with 0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106 not found: ID does not exist"
Sep 06 01:11:45.989246 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.989242    2567 scope.go:117] "RemoveContainer" containerID="5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"
Sep 06 01:11:45.989509 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.989492    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7\": container with ID starting with 5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7 not found: ID does not exist" containerID="5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"
Sep 06 01:11:45.989574 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.989512    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"} err="failed to get container status \"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7\": rpc error: code = NotFound desc = could not find container \"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7\": container with ID starting with 5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7 not found: ID does not exist"
Sep 06 01:11:45.989574 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.989524    2567 scope.go:117] "RemoveContainer" containerID="743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"
Sep 06 01:11:45.989804 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.989786    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b\": container with ID starting with 743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b not found: ID does not exist" containerID="743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"
Sep 06 01:11:45.989853 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.989807    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"} err="failed to get container status \"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b\": rpc error: code = NotFound desc = could not find container \"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b\": container with ID starting with 743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b not found: ID does not exist"
Sep 06 01:11:45.989853 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.989822    2567 scope.go:117] "RemoveContainer" containerID="c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"
Sep 06 01:11:45.990092 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.990075    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989\": container with ID starting with c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989 not found: ID does not exist" containerID="c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"
Sep 06 01:11:45.990154 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990096    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"} err="failed to get container status \"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989\": rpc error: code = NotFound desc = could not find container \"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989\": container with ID starting with c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989 not found: ID does not exist"
Sep 06 01:11:45.990154 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990110    2567 scope.go:117] "RemoveContainer" containerID="69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"
Sep 06 01:11:45.990348 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:11:45.990332    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71\": container with ID starting with 69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71 not found: ID does not exist" containerID="69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"
Sep 06 01:11:45.990386 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990352    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"} err="failed to get container status \"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71\": rpc error: code = NotFound desc = could not find container \"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71\": container with ID starting with 69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71 not found: ID does not exist"
Sep 06 01:11:45.990386 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990365    2567 scope.go:117] "RemoveContainer" containerID="610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"
Sep 06 01:11:45.990604 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990585    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8"} err="failed to get container status \"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8\": rpc error: code = NotFound desc = could not find container \"610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8\": container with ID starting with 610bddbccd3a43a80e8ac67e16e1cee79c9095b586686ca7e0350c652d3e3da8 not found: ID does not exist"
Sep 06 01:11:45.990604 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990603    2567 scope.go:117] "RemoveContainer" containerID="deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"
Sep 06 01:11:45.990849 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990832    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02"} err="failed to get container status \"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02\": rpc error: code = NotFound desc = could not find container \"deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02\": container with ID starting with deb3083fd9933a14bdd199a9c2e66baff7fd00a563ad4525c5b087391dd32b02 not found: ID does not exist"
Sep 06 01:11:45.990893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.990850    2567 scope.go:117] "RemoveContainer" containerID="0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"
Sep 06 01:11:45.991106 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991088    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106"} err="failed to get container status \"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106\": rpc error: code = NotFound desc = could not find container \"0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106\": container with ID starting with 0f3f11067847dcb45228633a42d301ddbc044c67eae37ba06f84a5cb8806e106 not found: ID does not exist"
Sep 06 01:11:45.991169 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991106    2567 scope.go:117] "RemoveContainer" containerID="5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"
Sep 06 01:11:45.991332 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991316    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7"} err="failed to get container status \"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7\": rpc error: code = NotFound desc = could not find container \"5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7\": container with ID starting with 5094d2a13238fcdcaf3ee73b8866f347673790ab5fee59f64a5eeb2d9a1cb5a7 not found: ID does not exist"
Sep 06 01:11:45.991374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991332    2567 scope.go:117] "RemoveContainer" containerID="743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"
Sep 06 01:11:45.991568 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991543    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b"} err="failed to get container status \"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b\": rpc error: code = NotFound desc = could not find container \"743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b\": container with ID starting with 743e635f8b52e51a067a779511f359595c053665e7db86fbb0e7f4c8b889309b not found: ID does not exist"
Sep 06 01:11:45.991618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991574    2567 scope.go:117] "RemoveContainer" containerID="c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"
Sep 06 01:11:45.991803 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991787    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989"} err="failed to get container status \"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989\": rpc error: code = NotFound desc = could not find container \"c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989\": container with ID starting with c32060a2af90b5790199f8d9b79895e1025cbdd408832b55916224f136c71989 not found: ID does not exist"
Sep 06 01:11:45.991856 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.991804    2567 scope.go:117] "RemoveContainer" containerID="69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"
Sep 06 01:11:45.992052 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:45.992035    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71"} err="failed to get container status \"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71\": rpc error: code = NotFound desc = could not find container \"69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71\": container with ID starting with 69f0a25d8fcf473581746eed11db31f603101b9b5ca842af010f6301bda20f71 not found: ID does not exist"
Sep 06 01:11:46.021102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021080    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021100    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-out\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021109    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-tls-assets\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021117    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-alertmanager-main-db\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021127    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6l5k\" (UniqueName: \"kubernetes.io/projected/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-kube-api-access-f6l5k\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021136    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-cluster-tls-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021161    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-metrics-client-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021171    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021179    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-web-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021187    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021197    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-secret-alertmanager-main-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.021210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.021205    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac827fee-b3a6-45a7-aec4-fd70f1c5769f-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:11:46.257326 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.257295    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:11:46.261641 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.261612    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:11:46.287457 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287432    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:11:46.287738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287721    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-web"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287741    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-web"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287754    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="config-reloader"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287761    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="config-reloader"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287780    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="init-config-reloader"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287790    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="init-config-reloader"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287801    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="alertmanager"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287809    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="alertmanager"
Sep 06 01:11:46.287822 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287819    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287826    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287843    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="prom-label-proxy"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287851    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="prom-label-proxy"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287859    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-metric"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287867    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-metric"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287978    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.287990    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="config-reloader"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.288001    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="alertmanager"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.288009    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="prom-label-proxy"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.288019    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-metric"
Sep 06 01:11:46.288270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.288029    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" containerName="kube-rbac-proxy-web"
Sep 06 01:11:46.291322 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.291302    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.293718 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.293698    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 06 01:11:46.294092 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294071    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pl75p\""
Sep 06 01:11:46.294188 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294126    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 06 01:11:46.294188 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294148    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 06 01:11:46.294188 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294162    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 06 01:11:46.294336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294127    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 06 01:11:46.294336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294215    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 06 01:11:46.294475 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294459    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 06 01:11:46.294516 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.294475    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 06 01:11:46.299263 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.299246    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 06 01:11:46.304663 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.304645    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:11:46.322940 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.322906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-web-config\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323027 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.322957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986c236a-0063-4121-9039-c0c8b7c6fc98-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323027 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.322980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/986c236a-0063-4121-9039-c0c8b7c6fc98-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/986c236a-0063-4121-9039-c0c8b7c6fc98-config-out\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323198 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323112    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/986c236a-0063-4121-9039-c0c8b7c6fc98-tls-assets\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323198 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323198 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323189    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-config-volume\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323283 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vx9h\" (UniqueName: \"kubernetes.io/projected/986c236a-0063-4121-9039-c0c8b7c6fc98-kube-api-access-2vx9h\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323283 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323254    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323287    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.323342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.323303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986c236a-0063-4121-9039-c0c8b7c6fc98-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.423893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.423863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424018 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.423900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424018 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.423923    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/986c236a-0063-4121-9039-c0c8b7c6fc98-config-out\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424119 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/986c236a-0063-4121-9039-c0c8b7c6fc98-tls-assets\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424119 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-config-volume\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vx9h\" (UniqueName: \"kubernetes.io/projected/986c236a-0063-4121-9039-c0c8b7c6fc98-kube-api-access-2vx9h\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424296 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424296 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424296 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424281    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986c236a-0063-4121-9039-c0c8b7c6fc98-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424446 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-web-config\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424446 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986c236a-0063-4121-9039-c0c8b7c6fc98-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.424446 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/986c236a-0063-4121-9039-c0c8b7c6fc98-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.425025 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.424698    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/986c236a-0063-4121-9039-c0c8b7c6fc98-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.425725 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.425609    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986c236a-0063-4121-9039-c0c8b7c6fc98-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.426845 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.426802    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986c236a-0063-4121-9039-c0c8b7c6fc98-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.427445    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.427534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.427593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-config-volume\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.427729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.427782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/986c236a-0063-4121-9039-c0c8b7c6fc98-config-out\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.427855    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/986c236a-0063-4121-9039-c0c8b7c6fc98-tls-assets\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.428173    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-web-config\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.428685    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.432206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.428821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/986c236a-0063-4121-9039-c0c8b7c6fc98-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.434219 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.434187    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vx9h\" (UniqueName: \"kubernetes.io/projected/986c236a-0063-4121-9039-c0c8b7c6fc98-kube-api-access-2vx9h\") pod \"alertmanager-main-0\" (UID: \"986c236a-0063-4121-9039-c0c8b7c6fc98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.601561 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.601457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 01:11:46.879022 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.878993    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 01:11:46.880360 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:11:46.880337    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986c236a_0063_4121_9039_c0c8b7c6fc98.slice/crio-bce8ada8dc93e85fe34561252ea4903d4c5ec7a13c38c5db93c89199ca3d86df WatchSource:0}: Error finding container bce8ada8dc93e85fe34561252ea4903d4c5ec7a13c38c5db93c89199ca3d86df: Status 404 returned error can't find the container with id bce8ada8dc93e85fe34561252ea4903d4c5ec7a13c38c5db93c89199ca3d86df
Sep 06 01:11:46.939192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.939162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"fdace50704cf362bfc76957897bc8f55be7550f697e188eb3aac803e503b47c3"}
Sep 06 01:11:46.939549 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:46.939254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"bce8ada8dc93e85fe34561252ea4903d4c5ec7a13c38c5db93c89199ca3d86df"}
Sep 06 01:11:47.206360 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:47.206323    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac827fee-b3a6-45a7-aec4-fd70f1c5769f" path="/var/lib/kubelet/pods/ac827fee-b3a6-45a7-aec4-fd70f1c5769f/volumes"
Sep 06 01:11:47.945159 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:47.945127    2567 generic.go:356] "Generic (PLEG): container finished" podID="986c236a-0063-4121-9039-c0c8b7c6fc98" containerID="fdace50704cf362bfc76957897bc8f55be7550f697e188eb3aac803e503b47c3" exitCode=0
Sep 06 01:11:47.945597 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:47.945183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerDied","Data":"fdace50704cf362bfc76957897bc8f55be7550f697e188eb3aac803e503b47c3"}
Sep 06 01:11:48.953290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.953254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"e7999e6f7df52c0a105b9ac763b40ef79ef9b8578f3b5fe715ffa9f7d4e1ea8c"}
Sep 06 01:11:48.953650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.953319    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"46f6bf4361877cac782c4909d430ee89163210192796f332645faf9b50ab888a"}
Sep 06 01:11:48.953650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.953347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"b3be802fa9fb0491f2027b11849c2d48d3bdf7758a7cf69343ed10fd15e987f0"}
Sep 06 01:11:48.953650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.953370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"948ffc7feab501e109b4341292771c86c7a5636cde86e8eedbf8999e6413a780"}
Sep 06 01:11:48.953650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.953391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"f0380c56309b5a037b3e7445e74f11dd4e52f0f369525b92806e1da98628d065"}
Sep 06 01:11:48.953650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.953412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"986c236a-0063-4121-9039-c0c8b7c6fc98","Type":"ContainerStarted","Data":"9e202c31d19bd865a48bc99ccb2ccd77468f84c1e9ce18600323fc615a00c9ed"}
Sep 06 01:11:48.981651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:11:48.981610    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.962145562 podStartE2EDuration="2.981596725s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.451163ms" isStatefulPod=false podCreationTimestamp="2026-09-06 01:11:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:48.981228013 +0000 UTC m=+162.256613177" watchObservedRunningTime="2026-09-06 01:11:48.981596725 +0000 UTC m=+162.256981888"
Sep 06 01:12:41.703358 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.703328    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"]
Sep 06 01:12:41.705515 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.705497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.708083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.708060    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 01:12:41.708213 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.708106    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 01:12:41.709045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.709030    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rd6fc\""
Sep 06 01:12:41.714020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.713998    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"]
Sep 06 01:12:41.813348 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.813320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9hhf\" (UniqueName: \"kubernetes.io/projected/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-kube-api-access-b9hhf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.813509 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.813385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.813509 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.813430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.914595 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.914568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9hhf\" (UniqueName: \"kubernetes.io/projected/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-kube-api-access-b9hhf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.914685 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.914613    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.914748 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.914729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.914922 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.914908    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.915048 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.915032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:41.923440 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:41.923414    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9hhf\" (UniqueName: \"kubernetes.io/projected/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-kube-api-access-b9hhf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:42.015020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:42.014971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:12:42.284099 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:42.284077    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"]
Sep 06 01:12:42.286511 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:12:42.286485    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5e39b1_7308_49a9_82c7_e2ce2291ccb2.slice/crio-615991fa9c8973352d66c08061f1cc1e7b8ae539471076aae0e9c6d39ac0b212 WatchSource:0}: Error finding container 615991fa9c8973352d66c08061f1cc1e7b8ae539471076aae0e9c6d39ac0b212: Status 404 returned error can't find the container with id 615991fa9c8973352d66c08061f1cc1e7b8ae539471076aae0e9c6d39ac0b212
Sep 06 01:12:43.140559 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:43.140522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4" event={"ID":"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2","Type":"ContainerStarted","Data":"615991fa9c8973352d66c08061f1cc1e7b8ae539471076aae0e9c6d39ac0b212"}
Sep 06 01:12:49.166023 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:49.165988    2567 generic.go:356] "Generic (PLEG): container finished" podID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerID="2fa34d3c5ee050c871640a0181fe7d88b5c2b93e9ac6c27183dde90415c3a2cb" exitCode=0
Sep 06 01:12:49.166429 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:49.166043    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4" event={"ID":"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2","Type":"ContainerDied","Data":"2fa34d3c5ee050c871640a0181fe7d88b5c2b93e9ac6c27183dde90415c3a2cb"}
Sep 06 01:12:52.179289 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:52.179253    2567 generic.go:356] "Generic (PLEG): container finished" podID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerID="f81406810f5b080c9686a0aefc46e9e2f3f449d663488e9850717f3ab9f047d3" exitCode=0
Sep 06 01:12:52.179645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:52.179345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4" event={"ID":"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2","Type":"ContainerDied","Data":"f81406810f5b080c9686a0aefc46e9e2f3f449d663488e9850717f3ab9f047d3"}
Sep 06 01:12:59.209038 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:59.209002    2567 generic.go:356] "Generic (PLEG): container finished" podID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerID="a6d5c31f90ea4a5a06b90f16ba411050752c08f5dfea77c0781b3c384763bb97" exitCode=0
Sep 06 01:12:59.209434 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:12:59.209069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4" event={"ID":"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2","Type":"ContainerDied","Data":"a6d5c31f90ea4a5a06b90f16ba411050752c08f5dfea77c0781b3c384763bb97"}
Sep 06 01:13:00.330267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.330243    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:13:00.353700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.353675    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-util\") pod \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") "
Sep 06 01:13:00.353814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.353725    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9hhf\" (UniqueName: \"kubernetes.io/projected/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-kube-api-access-b9hhf\") pod \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") "
Sep 06 01:13:00.353814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.353772    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-bundle\") pod \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\" (UID: \"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2\") "
Sep 06 01:13:00.354424 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.354400    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-bundle" (OuterVolumeSpecName: "bundle") pod "ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" (UID: "ee5e39b1-7308-49a9-82c7-e2ce2291ccb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:00.355878 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.355851    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-kube-api-access-b9hhf" (OuterVolumeSpecName: "kube-api-access-b9hhf") pod "ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" (UID: "ee5e39b1-7308-49a9-82c7-e2ce2291ccb2"). InnerVolumeSpecName "kube-api-access-b9hhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:13:00.357725 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.357698    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-util" (OuterVolumeSpecName: "util") pod "ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" (UID: "ee5e39b1-7308-49a9-82c7-e2ce2291ccb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:00.454723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.454700    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:00.454723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.454722    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:00.454875 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:00.454730    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9hhf\" (UniqueName: \"kubernetes.io/projected/ee5e39b1-7308-49a9-82c7-e2ce2291ccb2-kube-api-access-b9hhf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:01.217436 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:01.217406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4" event={"ID":"ee5e39b1-7308-49a9-82c7-e2ce2291ccb2","Type":"ContainerDied","Data":"615991fa9c8973352d66c08061f1cc1e7b8ae539471076aae0e9c6d39ac0b212"}
Sep 06 01:13:01.217436 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:01.217435    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwsl4"
Sep 06 01:13:01.217675 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:01.217454    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="615991fa9c8973352d66c08061f1cc1e7b8ae539471076aae0e9c6d39ac0b212"
Sep 06 01:13:04.826619 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826588    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"]
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826855    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="pull"
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826865    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="pull"
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826875    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="extract"
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826882    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="extract"
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826890    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="util"
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826897    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="util"
Sep 06 01:13:04.827068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.826964    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5e39b1-7308-49a9-82c7-e2ce2291ccb2" containerName="extract"
Sep 06 01:13:04.829874 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.829859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:04.832156 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.832134    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 06 01:13:04.832367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.832354    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:13:04.832416 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.832389    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hsj9v\""
Sep 06 01:13:04.846690 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.846666    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"]
Sep 06 01:13:04.887317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.887294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fa3e182-67bf-4d94-b7ed-400384c4e0c7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fwb99\" (UID: \"1fa3e182-67bf-4d94-b7ed-400384c4e0c7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:04.887402 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.887320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzw9q\" (UniqueName: \"kubernetes.io/projected/1fa3e182-67bf-4d94-b7ed-400384c4e0c7-kube-api-access-tzw9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-fwb99\" (UID: \"1fa3e182-67bf-4d94-b7ed-400384c4e0c7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:04.988098 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.988072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fa3e182-67bf-4d94-b7ed-400384c4e0c7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fwb99\" (UID: \"1fa3e182-67bf-4d94-b7ed-400384c4e0c7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:04.988199 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.988106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzw9q\" (UniqueName: \"kubernetes.io/projected/1fa3e182-67bf-4d94-b7ed-400384c4e0c7-kube-api-access-tzw9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-fwb99\" (UID: \"1fa3e182-67bf-4d94-b7ed-400384c4e0c7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:04.988482 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.988464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fa3e182-67bf-4d94-b7ed-400384c4e0c7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fwb99\" (UID: \"1fa3e182-67bf-4d94-b7ed-400384c4e0c7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:04.997234 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:04.997210    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzw9q\" (UniqueName: \"kubernetes.io/projected/1fa3e182-67bf-4d94-b7ed-400384c4e0c7-kube-api-access-tzw9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-fwb99\" (UID: \"1fa3e182-67bf-4d94-b7ed-400384c4e0c7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:05.138597 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:05.138541    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"
Sep 06 01:13:05.413132 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:05.413110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99"]
Sep 06 01:13:05.414791 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:05.414762    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa3e182_67bf_4d94_b7ed_400384c4e0c7.slice/crio-0cfdfe9985e77837c325e3192b7a73ae9c14438de1a5b11b6bd20cf8bae7928a WatchSource:0}: Error finding container 0cfdfe9985e77837c325e3192b7a73ae9c14438de1a5b11b6bd20cf8bae7928a: Status 404 returned error can't find the container with id 0cfdfe9985e77837c325e3192b7a73ae9c14438de1a5b11b6bd20cf8bae7928a
Sep 06 01:13:06.237545 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:06.237512    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99" event={"ID":"1fa3e182-67bf-4d94-b7ed-400384c4e0c7","Type":"ContainerStarted","Data":"0cfdfe9985e77837c325e3192b7a73ae9c14438de1a5b11b6bd20cf8bae7928a"}
Sep 06 01:13:08.000332 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.000296    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2mgs4"]
Sep 06 01:13:08.003568 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.003547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.006166 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.006135    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 01:13:08.006341 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.006321    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 01:13:08.007145 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.007129    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5d77f\""
Sep 06 01:13:08.014122 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.014101    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2mgs4"]
Sep 06 01:13:08.110346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.110325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b20a83-eec1-448d-865d-15af84862988-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2mgs4\" (UID: \"95b20a83-eec1-448d-865d-15af84862988\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.110462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.110355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2fvn\" (UniqueName: \"kubernetes.io/projected/95b20a83-eec1-448d-865d-15af84862988-kube-api-access-k2fvn\") pod \"cert-manager-webhook-6486ffd997-2mgs4\" (UID: \"95b20a83-eec1-448d-865d-15af84862988\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.211342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.211313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b20a83-eec1-448d-865d-15af84862988-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2mgs4\" (UID: \"95b20a83-eec1-448d-865d-15af84862988\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.211443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.211352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2fvn\" (UniqueName: \"kubernetes.io/projected/95b20a83-eec1-448d-865d-15af84862988-kube-api-access-k2fvn\") pod \"cert-manager-webhook-6486ffd997-2mgs4\" (UID: \"95b20a83-eec1-448d-865d-15af84862988\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.219129 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.219105    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b20a83-eec1-448d-865d-15af84862988-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2mgs4\" (UID: \"95b20a83-eec1-448d-865d-15af84862988\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.219251 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.219233    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2fvn\" (UniqueName: \"kubernetes.io/projected/95b20a83-eec1-448d-865d-15af84862988-kube-api-access-k2fvn\") pod \"cert-manager-webhook-6486ffd997-2mgs4\" (UID: \"95b20a83-eec1-448d-865d-15af84862988\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.245533 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.245505    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99" event={"ID":"1fa3e182-67bf-4d94-b7ed-400384c4e0c7","Type":"ContainerStarted","Data":"0006a582ab14d06b5a2fb5beba2cce9fccd34912acbab7651b8ed3cc3df336eb"}
Sep 06 01:13:08.264659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.264583    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fwb99" podStartSLOduration=2.438977343 podStartE2EDuration="4.264569835s" totalImagesPullingTime="1.825592492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:08.26321008 +0000 UTC m=+241.538595240" watchObservedRunningTime="2026-09-06 01:13:08.264569835 +0000 UTC m=+241.539954998"
Sep 06 01:13:08.324313 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.324289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:08.597394 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:08.597366    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2mgs4"]
Sep 06 01:13:08.599483 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:08.599447    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95b20a83_eec1_448d_865d_15af84862988.slice/crio-42f7e6ef075f2a17643e0679c8e99eabb238ad10ad9b6898ca1fa45ce2c35382 WatchSource:0}: Error finding container 42f7e6ef075f2a17643e0679c8e99eabb238ad10ad9b6898ca1fa45ce2c35382: Status 404 returned error can't find the container with id 42f7e6ef075f2a17643e0679c8e99eabb238ad10ad9b6898ca1fa45ce2c35382
Sep 06 01:13:09.250158 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.250129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4" event={"ID":"95b20a83-eec1-448d-865d-15af84862988","Type":"ContainerStarted","Data":"42f7e6ef075f2a17643e0679c8e99eabb238ad10ad9b6898ca1fa45ce2c35382"}
Sep 06 01:13:09.312321 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.312291    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"]
Sep 06 01:13:09.316727 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.316710    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.319328 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.319303    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 01:13:09.319328 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.319317    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rd6fc\""
Sep 06 01:13:09.319493 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.319328    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 01:13:09.324702 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.324679    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"]
Sep 06 01:13:09.420025 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.419999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.420130 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.420033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwbcw\" (UniqueName: \"kubernetes.io/projected/f61ed102-7e72-425b-a229-1dc52add3899-kube-api-access-dwbcw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.420130 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.420112    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.520957 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.520863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.521083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.520957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.521083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.520988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwbcw\" (UniqueName: \"kubernetes.io/projected/f61ed102-7e72-425b-a229-1dc52add3899-kube-api-access-dwbcw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.521305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.521271    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.521419 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.521348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.531624 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.531595    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwbcw\" (UniqueName: \"kubernetes.io/projected/f61ed102-7e72-425b-a229-1dc52add3899-kube-api-access-dwbcw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.626431 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.626404    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:09.905914 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:09.905890    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"]
Sep 06 01:13:09.907937 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:09.907899    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61ed102_7e72_425b_a229_1dc52add3899.slice/crio-ea9d7a5d55b993eca8716f3e061d2d1084ae0c8fd9e7e3903aee22e76e66606d WatchSource:0}: Error finding container ea9d7a5d55b993eca8716f3e061d2d1084ae0c8fd9e7e3903aee22e76e66606d: Status 404 returned error can't find the container with id ea9d7a5d55b993eca8716f3e061d2d1084ae0c8fd9e7e3903aee22e76e66606d
Sep 06 01:13:10.257367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:10.257297    2567 generic.go:356] "Generic (PLEG): container finished" podID="f61ed102-7e72-425b-a229-1dc52add3899" containerID="a6090e80b1b5a4edbff712c1820980ec6e0335d8801e0b8ba4361380f91529ec" exitCode=0
Sep 06 01:13:10.257367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:10.257341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn" event={"ID":"f61ed102-7e72-425b-a229-1dc52add3899","Type":"ContainerDied","Data":"a6090e80b1b5a4edbff712c1820980ec6e0335d8801e0b8ba4361380f91529ec"}
Sep 06 01:13:10.257832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:10.257419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn" event={"ID":"f61ed102-7e72-425b-a229-1dc52add3899","Type":"ContainerStarted","Data":"ea9d7a5d55b993eca8716f3e061d2d1084ae0c8fd9e7e3903aee22e76e66606d"}
Sep 06 01:13:12.268168 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:12.268131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4" event={"ID":"95b20a83-eec1-448d-865d-15af84862988","Type":"ContainerStarted","Data":"1066854823c2c5d00f54dfdac745a8348e0eb7487fbb214d73277c2d2b0a3661"}
Sep 06 01:13:12.268644 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:12.268201    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:12.287250 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:12.287210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4" podStartSLOduration=2.4485813690000002 podStartE2EDuration="5.287195602s" totalImagesPullingTime="2.838614233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:12.286033214 +0000 UTC m=+245.561418379" watchObservedRunningTime="2026-09-06 01:13:12.287195602 +0000 UTC m=+245.562580765"
Sep 06 01:13:13.273702 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:13.273607    2567 generic.go:356] "Generic (PLEG): container finished" podID="f61ed102-7e72-425b-a229-1dc52add3899" containerID="f21ec03524adf693adf78684b5bb546ab40f3c211d8ba317f5772ac314d8d999" exitCode=0
Sep 06 01:13:13.274097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:13.273695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn" event={"ID":"f61ed102-7e72-425b-a229-1dc52add3899","Type":"ContainerDied","Data":"f21ec03524adf693adf78684b5bb546ab40f3c211d8ba317f5772ac314d8d999"}
Sep 06 01:13:14.279555 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:14.279523    2567 generic.go:356] "Generic (PLEG): container finished" podID="f61ed102-7e72-425b-a229-1dc52add3899" containerID="a734d0283efa8bc02f14c3d09a55f074a8a7b2d31004abe2e860d9f90ff1ca1c" exitCode=0
Sep 06 01:13:14.279952 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:14.279568    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn" event={"ID":"f61ed102-7e72-425b-a229-1dc52add3899","Type":"ContainerDied","Data":"a734d0283efa8bc02f14c3d09a55f074a8a7b2d31004abe2e860d9f90ff1ca1c"}
Sep 06 01:13:15.398649 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.398627    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:15.472386 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.472362    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-bundle\") pod \"f61ed102-7e72-425b-a229-1dc52add3899\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") "
Sep 06 01:13:15.472541 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.472396    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwbcw\" (UniqueName: \"kubernetes.io/projected/f61ed102-7e72-425b-a229-1dc52add3899-kube-api-access-dwbcw\") pod \"f61ed102-7e72-425b-a229-1dc52add3899\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") "
Sep 06 01:13:15.472541 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.472429    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-util\") pod \"f61ed102-7e72-425b-a229-1dc52add3899\" (UID: \"f61ed102-7e72-425b-a229-1dc52add3899\") "
Sep 06 01:13:15.472764 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.472742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-bundle" (OuterVolumeSpecName: "bundle") pod "f61ed102-7e72-425b-a229-1dc52add3899" (UID: "f61ed102-7e72-425b-a229-1dc52add3899"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:15.474375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.474354    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61ed102-7e72-425b-a229-1dc52add3899-kube-api-access-dwbcw" (OuterVolumeSpecName: "kube-api-access-dwbcw") pod "f61ed102-7e72-425b-a229-1dc52add3899" (UID: "f61ed102-7e72-425b-a229-1dc52add3899"). InnerVolumeSpecName "kube-api-access-dwbcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:13:15.476485 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.476456    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-util" (OuterVolumeSpecName: "util") pod "f61ed102-7e72-425b-a229-1dc52add3899" (UID: "f61ed102-7e72-425b-a229-1dc52add3899"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:15.573075 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.573009    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:15.573075 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.573039    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwbcw\" (UniqueName: \"kubernetes.io/projected/f61ed102-7e72-425b-a229-1dc52add3899-kube-api-access-dwbcw\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:15.573075 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:15.573048    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61ed102-7e72-425b-a229-1dc52add3899-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:16.289238 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:16.289208    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn"
Sep 06 01:13:16.289393 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:16.289212    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86gxn" event={"ID":"f61ed102-7e72-425b-a229-1dc52add3899","Type":"ContainerDied","Data":"ea9d7a5d55b993eca8716f3e061d2d1084ae0c8fd9e7e3903aee22e76e66606d"}
Sep 06 01:13:16.289393 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:16.289330    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea9d7a5d55b993eca8716f3e061d2d1084ae0c8fd9e7e3903aee22e76e66606d"
Sep 06 01:13:18.275615 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:18.275564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2mgs4"
Sep 06 01:13:19.358965 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.358920    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zjncp"]
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359189    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="extract"
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359199    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="extract"
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359219    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="pull"
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359224    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="pull"
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359232    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="util"
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359238    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="util"
Sep 06 01:13:19.359302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.359279    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61ed102-7e72-425b-a229-1dc52add3899" containerName="extract"
Sep 06 01:13:19.362318 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.362303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.364515 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.364494    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p48qp\""
Sep 06 01:13:19.369761 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.369740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zjncp"]
Sep 06 01:13:19.397831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.397806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvnqc\" (UniqueName: \"kubernetes.io/projected/73ac81c9-17ab-466e-9187-04e5f1440231-kube-api-access-rvnqc\") pod \"cert-manager-55b4d954d5-zjncp\" (UID: \"73ac81c9-17ab-466e-9187-04e5f1440231\") " pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.397913 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.397847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73ac81c9-17ab-466e-9187-04e5f1440231-bound-sa-token\") pod \"cert-manager-55b4d954d5-zjncp\" (UID: \"73ac81c9-17ab-466e-9187-04e5f1440231\") " pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.498553 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.498533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvnqc\" (UniqueName: \"kubernetes.io/projected/73ac81c9-17ab-466e-9187-04e5f1440231-kube-api-access-rvnqc\") pod \"cert-manager-55b4d954d5-zjncp\" (UID: \"73ac81c9-17ab-466e-9187-04e5f1440231\") " pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.498649 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.498570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73ac81c9-17ab-466e-9187-04e5f1440231-bound-sa-token\") pod \"cert-manager-55b4d954d5-zjncp\" (UID: \"73ac81c9-17ab-466e-9187-04e5f1440231\") " pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.507728 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.507681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73ac81c9-17ab-466e-9187-04e5f1440231-bound-sa-token\") pod \"cert-manager-55b4d954d5-zjncp\" (UID: \"73ac81c9-17ab-466e-9187-04e5f1440231\") " pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.508514 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.508492    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvnqc\" (UniqueName: \"kubernetes.io/projected/73ac81c9-17ab-466e-9187-04e5f1440231-kube-api-access-rvnqc\") pod \"cert-manager-55b4d954d5-zjncp\" (UID: \"73ac81c9-17ab-466e-9187-04e5f1440231\") " pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.671681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.671655    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zjncp"
Sep 06 01:13:19.944175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:19.944090    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zjncp"]
Sep 06 01:13:19.945984 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:19.945957    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73ac81c9_17ab_466e_9187_04e5f1440231.slice/crio-297907fc8ef8e8fc0338f23f628f8514cf4ff88fda8780a8966b4360c7618461 WatchSource:0}: Error finding container 297907fc8ef8e8fc0338f23f628f8514cf4ff88fda8780a8966b4360c7618461: Status 404 returned error can't find the container with id 297907fc8ef8e8fc0338f23f628f8514cf4ff88fda8780a8966b4360c7618461
Sep 06 01:13:20.305908 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:20.305833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zjncp" event={"ID":"73ac81c9-17ab-466e-9187-04e5f1440231","Type":"ContainerStarted","Data":"fe7de29a8faf35da2edb19c87f2a4bf7659ba2d1c4b18cc254c13c883915146e"}
Sep 06 01:13:20.305908 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:20.305877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zjncp" event={"ID":"73ac81c9-17ab-466e-9187-04e5f1440231","Type":"ContainerStarted","Data":"297907fc8ef8e8fc0338f23f628f8514cf4ff88fda8780a8966b4360c7618461"}
Sep 06 01:13:20.322503 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:20.322461    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zjncp" podStartSLOduration=1.322449428 podStartE2EDuration="1.322449428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:20.321264161 +0000 UTC m=+253.596649325" watchObservedRunningTime="2026-09-06 01:13:20.322449428 +0000 UTC m=+253.597834591"
Sep 06 01:13:27.690360 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.690320    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"]
Sep 06 01:13:27.698134 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.698118    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.700998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.700971    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 01:13:27.701265 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.701245    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rd6fc\""
Sep 06 01:13:27.701396 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.701371    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 01:13:27.702364 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.702344    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"]
Sep 06 01:13:27.759944 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.759911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d86wq\" (UniqueName: \"kubernetes.io/projected/c0645eef-d643-490f-8e9a-1f04e8483ed1-kube-api-access-d86wq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.760040 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.759972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.760040 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.759994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.860953 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.860900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.861049 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.860985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.861049 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.861022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d86wq\" (UniqueName: \"kubernetes.io/projected/c0645eef-d643-490f-8e9a-1f04e8483ed1-kube-api-access-d86wq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.861242 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.861226    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.861300 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.861283    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:27.868699 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:27.868673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d86wq\" (UniqueName: \"kubernetes.io/projected/c0645eef-d643-490f-8e9a-1f04e8483ed1-kube-api-access-d86wq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:28.009649 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:28.009595    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:28.278812 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:28.278791    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"]
Sep 06 01:13:28.281237 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:28.281213    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0645eef_d643_490f_8e9a_1f04e8483ed1.slice/crio-97919494bfb0385fdfada96c85493b4c8f041e6c503e26fdcdbfa43c97bf4d16 WatchSource:0}: Error finding container 97919494bfb0385fdfada96c85493b4c8f041e6c503e26fdcdbfa43c97bf4d16: Status 404 returned error can't find the container with id 97919494bfb0385fdfada96c85493b4c8f041e6c503e26fdcdbfa43c97bf4d16
Sep 06 01:13:28.340321 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:28.340287    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54" event={"ID":"c0645eef-d643-490f-8e9a-1f04e8483ed1","Type":"ContainerStarted","Data":"bcbbccbd463fa53acf36b77cd2568c7d21ed3dff2d14587a24413c4268df036f"}
Sep 06 01:13:28.340426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:28.340348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54" event={"ID":"c0645eef-d643-490f-8e9a-1f04e8483ed1","Type":"ContainerStarted","Data":"97919494bfb0385fdfada96c85493b4c8f041e6c503e26fdcdbfa43c97bf4d16"}
Sep 06 01:13:29.345910 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:29.345878    2567 generic.go:356] "Generic (PLEG): container finished" podID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerID="bcbbccbd463fa53acf36b77cd2568c7d21ed3dff2d14587a24413c4268df036f" exitCode=0
Sep 06 01:13:29.346317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:29.345963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54" event={"ID":"c0645eef-d643-490f-8e9a-1f04e8483ed1","Type":"ContainerDied","Data":"bcbbccbd463fa53acf36b77cd2568c7d21ed3dff2d14587a24413c4268df036f"}
Sep 06 01:13:30.351562 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:30.351528    2567 generic.go:356] "Generic (PLEG): container finished" podID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerID="7d978b671c4d670525149ab04d38a6c5c36c510081c0371de559a2bac8bab68f" exitCode=0
Sep 06 01:13:30.351962 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:30.351611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54" event={"ID":"c0645eef-d643-490f-8e9a-1f04e8483ed1","Type":"ContainerDied","Data":"7d978b671c4d670525149ab04d38a6c5c36c510081c0371de559a2bac8bab68f"}
Sep 06 01:13:31.357734 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:31.357701    2567 generic.go:356] "Generic (PLEG): container finished" podID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerID="a894cfdda221a7d6fa8c2785c8ca23e44882b6f0cba88bd3e644d92a7e5582bb" exitCode=0
Sep 06 01:13:31.357734 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:31.357740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54" event={"ID":"c0645eef-d643-490f-8e9a-1f04e8483ed1","Type":"ContainerDied","Data":"a894cfdda221a7d6fa8c2785c8ca23e44882b6f0cba88bd3e644d92a7e5582bb"}
Sep 06 01:13:32.501906 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.501880    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:32.594376 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.594346    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-bundle\") pod \"c0645eef-d643-490f-8e9a-1f04e8483ed1\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") "
Sep 06 01:13:32.594490 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.594382    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d86wq\" (UniqueName: \"kubernetes.io/projected/c0645eef-d643-490f-8e9a-1f04e8483ed1-kube-api-access-d86wq\") pod \"c0645eef-d643-490f-8e9a-1f04e8483ed1\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") "
Sep 06 01:13:32.594490 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.594435    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-util\") pod \"c0645eef-d643-490f-8e9a-1f04e8483ed1\" (UID: \"c0645eef-d643-490f-8e9a-1f04e8483ed1\") "
Sep 06 01:13:32.595026 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.594997    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-bundle" (OuterVolumeSpecName: "bundle") pod "c0645eef-d643-490f-8e9a-1f04e8483ed1" (UID: "c0645eef-d643-490f-8e9a-1f04e8483ed1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.596379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.596357    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0645eef-d643-490f-8e9a-1f04e8483ed1-kube-api-access-d86wq" (OuterVolumeSpecName: "kube-api-access-d86wq") pod "c0645eef-d643-490f-8e9a-1f04e8483ed1" (UID: "c0645eef-d643-490f-8e9a-1f04e8483ed1"). InnerVolumeSpecName "kube-api-access-d86wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:13:32.600077 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.600045    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-util" (OuterVolumeSpecName: "util") pod "c0645eef-d643-490f-8e9a-1f04e8483ed1" (UID: "c0645eef-d643-490f-8e9a-1f04e8483ed1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.695578 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.695560    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.695578 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.695580    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0645eef-d643-490f-8e9a-1f04e8483ed1-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.695728 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:32.695588    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d86wq\" (UniqueName: \"kubernetes.io/projected/c0645eef-d643-490f-8e9a-1f04e8483ed1-kube-api-access-d86wq\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:33.368116 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:33.368084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54" event={"ID":"c0645eef-d643-490f-8e9a-1f04e8483ed1","Type":"ContainerDied","Data":"97919494bfb0385fdfada96c85493b4c8f041e6c503e26fdcdbfa43c97bf4d16"}
Sep 06 01:13:33.368300 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:33.368120    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqtx54"
Sep 06 01:13:33.368300 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:33.368133    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97919494bfb0385fdfada96c85493b4c8f041e6c503e26fdcdbfa43c97bf4d16"
Sep 06 01:13:38.315630 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.315591    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"]
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316026    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="pull"
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316045    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="pull"
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316063    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="util"
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316071    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="util"
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316088    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="extract"
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316096    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="extract"
Sep 06 01:13:38.316165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.316167    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0645eef-d643-490f-8e9a-1f04e8483ed1" containerName="extract"
Sep 06 01:13:38.318592 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.318571    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.320994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.320970    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 01:13:38.321110 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.321005    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 01:13:38.321994 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.321980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rd6fc\""
Sep 06 01:13:38.330149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.330123    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"]
Sep 06 01:13:38.442201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.442170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.442336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.442223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.442336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.442274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqrk2\" (UniqueName: \"kubernetes.io/projected/faeda466-b292-4089-a235-084ecba17d8e-kube-api-access-bqrk2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.542599 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.542568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqrk2\" (UniqueName: \"kubernetes.io/projected/faeda466-b292-4089-a235-084ecba17d8e-kube-api-access-bqrk2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.542759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.542611    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.542759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.542712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.543006 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.542988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.543074 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.543057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.559264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.559245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqrk2\" (UniqueName: \"kubernetes.io/projected/faeda466-b292-4089-a235-084ecba17d8e-kube-api-access-bqrk2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.627173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.627115    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:38.709173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.709144    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"]
Sep 06 01:13:38.713154 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.713127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.716858 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.716836    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 01:13:38.717707 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.717679    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:13:38.717707 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.717691    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jv294\""
Sep 06 01:13:38.717852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.717686    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 06 01:13:38.717852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.717756    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 06 01:13:38.717852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.717686    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 06 01:13:38.725073 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.725053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"]
Sep 06 01:13:38.844130 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.844096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmnmc\" (UniqueName: \"kubernetes.io/projected/2ad07e34-0952-48fa-a84d-abf9d9e2f612-kube-api-access-dmnmc\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.844130 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.844129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad07e34-0952-48fa-a84d-abf9d9e2f612-metrics-cert\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.844316 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.844193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ad07e34-0952-48fa-a84d-abf9d9e2f612-manager-config\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.844316 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.844211    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ad07e34-0952-48fa-a84d-abf9d9e2f612-cert\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.895839 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.895731    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"]
Sep 06 01:13:38.897913 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:38.897885    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaeda466_b292_4089_a235_084ecba17d8e.slice/crio-3c36c894f2d3965e24cae9bdc1d89291c252ba81b3fcca536bfa98c401bec4b4 WatchSource:0}: Error finding container 3c36c894f2d3965e24cae9bdc1d89291c252ba81b3fcca536bfa98c401bec4b4: Status 404 returned error can't find the container with id 3c36c894f2d3965e24cae9bdc1d89291c252ba81b3fcca536bfa98c401bec4b4
Sep 06 01:13:38.945057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.945038    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ad07e34-0952-48fa-a84d-abf9d9e2f612-manager-config\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.945119 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.945067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ad07e34-0952-48fa-a84d-abf9d9e2f612-cert\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.945119 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.945101    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmnmc\" (UniqueName: \"kubernetes.io/projected/2ad07e34-0952-48fa-a84d-abf9d9e2f612-kube-api-access-dmnmc\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.945186 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.945129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad07e34-0952-48fa-a84d-abf9d9e2f612-metrics-cert\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.945753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.945733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ad07e34-0952-48fa-a84d-abf9d9e2f612-manager-config\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.947289 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.947272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ad07e34-0952-48fa-a84d-abf9d9e2f612-cert\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.947400 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.947384    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad07e34-0952-48fa-a84d-abf9d9e2f612-metrics-cert\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:38.956357 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:38.956334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmnmc\" (UniqueName: \"kubernetes.io/projected/2ad07e34-0952-48fa-a84d-abf9d9e2f612-kube-api-access-dmnmc\") pod \"lws-controller-manager-68cb9d866d-vc6t6\" (UID: \"2ad07e34-0952-48fa-a84d-abf9d9e2f612\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:39.023293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:39.023271    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:39.291580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:39.291540    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"]
Sep 06 01:13:39.294012 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:39.293983    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad07e34_0952_48fa_a84d_abf9d9e2f612.slice/crio-b6b9484a5e807e3f8b7adc699fc43b9b43093989ff28ee86a657c5a94111333d WatchSource:0}: Error finding container b6b9484a5e807e3f8b7adc699fc43b9b43093989ff28ee86a657c5a94111333d: Status 404 returned error can't find the container with id b6b9484a5e807e3f8b7adc699fc43b9b43093989ff28ee86a657c5a94111333d
Sep 06 01:13:39.394939 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:39.394902    2567 generic.go:356] "Generic (PLEG): container finished" podID="faeda466-b292-4089-a235-084ecba17d8e" containerID="34299e689a03f71cc26f29f7f1da2872f25de34c285b3b6cf311708b7b4dc494" exitCode=0
Sep 06 01:13:39.395274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:39.394983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc" event={"ID":"faeda466-b292-4089-a235-084ecba17d8e","Type":"ContainerDied","Data":"34299e689a03f71cc26f29f7f1da2872f25de34c285b3b6cf311708b7b4dc494"}
Sep 06 01:13:39.395274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:39.395029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc" event={"ID":"faeda466-b292-4089-a235-084ecba17d8e","Type":"ContainerStarted","Data":"3c36c894f2d3965e24cae9bdc1d89291c252ba81b3fcca536bfa98c401bec4b4"}
Sep 06 01:13:39.396339 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:39.396318    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6" event={"ID":"2ad07e34-0952-48fa-a84d-abf9d9e2f612","Type":"ContainerStarted","Data":"b6b9484a5e807e3f8b7adc699fc43b9b43093989ff28ee86a657c5a94111333d"}
Sep 06 01:13:40.403381 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.403294    2567 generic.go:356] "Generic (PLEG): container finished" podID="faeda466-b292-4089-a235-084ecba17d8e" containerID="f440575a441e6153b6e974efd7a9240753de518446081e17ff730883eba80eb3" exitCode=0
Sep 06 01:13:40.403381 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.403361    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc" event={"ID":"faeda466-b292-4089-a235-084ecba17d8e","Type":"ContainerDied","Data":"f440575a441e6153b6e974efd7a9240753de518446081e17ff730883eba80eb3"}
Sep 06 01:13:40.639062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.639032    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"]
Sep 06 01:13:40.642757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.642737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.645209 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.645185    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2rcbr\""
Sep 06 01:13:40.645416 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.645398    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 01:13:40.645697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.645655    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 01:13:40.645697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.645681    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 01:13:40.645830 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.645717    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 01:13:40.661190 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.661133    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"]
Sep 06 01:13:40.761443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.761410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.761613 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.761449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4dn\" (UniqueName: \"kubernetes.io/projected/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-kube-api-access-mh4dn\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.761613 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.761566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.761613 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.761601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.761761 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.761660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.862347 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.862318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.862467 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.862372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.862467 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.862390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.862467 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.862408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4dn\" (UniqueName: \"kubernetes.io/projected/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-kube-api-access-mh4dn\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.862467 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.862458    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.862678 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.862657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.864389 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.864367    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.864619 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.864603    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.864675 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.864658    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.871530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.871508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4dn\" (UniqueName: \"kubernetes.io/projected/24b4ff0e-0884-4185-b4d3-0b1f003a5fdf-kube-api-access-mh4dn\") pod \"opendatahub-operator-controller-manager-bb49d79fd-wj62m\" (UID: \"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:40.953681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:40.953663    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:41.241751 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.241727    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"]
Sep 06 01:13:41.243490 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:13:41.243463    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b4ff0e_0884_4185_b4d3_0b1f003a5fdf.slice/crio-68bd0ae1d1e9b92fe84391a1555dcae19713c8c1d8daeca74bd0f7a3a1357c3a WatchSource:0}: Error finding container 68bd0ae1d1e9b92fe84391a1555dcae19713c8c1d8daeca74bd0f7a3a1357c3a: Status 404 returned error can't find the container with id 68bd0ae1d1e9b92fe84391a1555dcae19713c8c1d8daeca74bd0f7a3a1357c3a
Sep 06 01:13:41.408680 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.408641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m" event={"ID":"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf","Type":"ContainerStarted","Data":"68bd0ae1d1e9b92fe84391a1555dcae19713c8c1d8daeca74bd0f7a3a1357c3a"}
Sep 06 01:13:41.410650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.410625    2567 generic.go:356] "Generic (PLEG): container finished" podID="faeda466-b292-4089-a235-084ecba17d8e" containerID="8fcd1f591a24ce5e436305c9e751a0a45d99ba4eac6e51bab52ad6e6ad16e3e9" exitCode=0
Sep 06 01:13:41.410778 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.410714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc" event={"ID":"faeda466-b292-4089-a235-084ecba17d8e","Type":"ContainerDied","Data":"8fcd1f591a24ce5e436305c9e751a0a45d99ba4eac6e51bab52ad6e6ad16e3e9"}
Sep 06 01:13:41.412164 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.412146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6" event={"ID":"2ad07e34-0952-48fa-a84d-abf9d9e2f612","Type":"ContainerStarted","Data":"7dc99011db182537774a7638f1c18a5c69c8440a6e85072472c9165279ab1087"}
Sep 06 01:13:41.412265 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.412250    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:41.449014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:41.448971    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6" podStartSLOduration=1.834103128 podStartE2EDuration="3.448957308s" totalImagesPullingTime="1.61485418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:41.447581348 +0000 UTC m=+274.722966511" watchObservedRunningTime="2026-09-06 01:13:41.448957308 +0000 UTC m=+274.724342472"
Sep 06 01:13:44.071627 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.071602    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:44.194261 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.194233    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-bundle\") pod \"faeda466-b292-4089-a235-084ecba17d8e\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") "
Sep 06 01:13:44.194343 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.194285    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqrk2\" (UniqueName: \"kubernetes.io/projected/faeda466-b292-4089-a235-084ecba17d8e-kube-api-access-bqrk2\") pod \"faeda466-b292-4089-a235-084ecba17d8e\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") "
Sep 06 01:13:44.194377 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.194345    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-util\") pod \"faeda466-b292-4089-a235-084ecba17d8e\" (UID: \"faeda466-b292-4089-a235-084ecba17d8e\") "
Sep 06 01:13:44.194984 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.194960    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-bundle" (OuterVolumeSpecName: "bundle") pod "faeda466-b292-4089-a235-084ecba17d8e" (UID: "faeda466-b292-4089-a235-084ecba17d8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:44.196142 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.196120    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faeda466-b292-4089-a235-084ecba17d8e-kube-api-access-bqrk2" (OuterVolumeSpecName: "kube-api-access-bqrk2") pod "faeda466-b292-4089-a235-084ecba17d8e" (UID: "faeda466-b292-4089-a235-084ecba17d8e"). InnerVolumeSpecName "kube-api-access-bqrk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:13:44.201811 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.201786    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-util" (OuterVolumeSpecName: "util") pod "faeda466-b292-4089-a235-084ecba17d8e" (UID: "faeda466-b292-4089-a235-084ecba17d8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:44.295205 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.295177    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqrk2\" (UniqueName: \"kubernetes.io/projected/faeda466-b292-4089-a235-084ecba17d8e-kube-api-access-bqrk2\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:44.295205 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.295201    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:44.295205 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.295211    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/faeda466-b292-4089-a235-084ecba17d8e-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:13:44.428907 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.428858    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m" event={"ID":"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf","Type":"ContainerStarted","Data":"bc04e8a040c0fa1961b5136d1909d2d19780909007ac1b1438d73698b7afe338"}
Sep 06 01:13:44.430759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.430736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc" event={"ID":"faeda466-b292-4089-a235-084ecba17d8e","Type":"ContainerDied","Data":"3c36c894f2d3965e24cae9bdc1d89291c252ba81b3fcca536bfa98c401bec4b4"}
Sep 06 01:13:44.430759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.430759    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09cbvc"
Sep 06 01:13:44.430904 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:44.430770    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c36c894f2d3965e24cae9bdc1d89291c252ba81b3fcca536bfa98c401bec4b4"
Sep 06 01:13:45.436659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:45.436619    2567 generic.go:356] "Generic (PLEG): container finished" podID="24b4ff0e-0884-4185-b4d3-0b1f003a5fdf" containerID="bc04e8a040c0fa1961b5136d1909d2d19780909007ac1b1438d73698b7afe338" exitCode=0
Sep 06 01:13:45.437081 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:45.436666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m" event={"ID":"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf","Type":"ContainerDied","Data":"bc04e8a040c0fa1961b5136d1909d2d19780909007ac1b1438d73698b7afe338"}
Sep 06 01:13:46.445382 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:46.445349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m" event={"ID":"24b4ff0e-0884-4185-b4d3-0b1f003a5fdf","Type":"ContainerStarted","Data":"5f332fe75b30c5b24a9129302acba1757b7bfda91f661d28e064d260153f88b5"}
Sep 06 01:13:46.445768 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:46.445492    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:13:46.468337 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:46.468288    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m" podStartSLOduration=2.219898941 podStartE2EDuration="6.468274073s" totalImagesPullingTime="3.177659949s" totalInitContainerRuntime="1.070715183s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:46.465865358 +0000 UTC m=+279.741250519" watchObservedRunningTime="2026-09-06 01:13:46.468274073 +0000 UTC m=+279.743659236"
Sep 06 01:13:52.420134 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:52.420103    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-vc6t6"
Sep 06 01:13:57.452330 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:13:57.452300    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-wj62m"
Sep 06 01:14:07.163746 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:07.163720    2567 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 01:14:08.797733 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.797698    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"]
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="extract"
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798189    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="extract"
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798205    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="util"
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798214    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="util"
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798230    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="pull"
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798239    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="pull"
Sep 06 01:14:08.800062 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.798326    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="faeda466-b292-4089-a235-084ecba17d8e" containerName="extract"
Sep 06 01:14:08.801341 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.801319    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.803866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.803845    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 01:14:08.804004 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.803867    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 01:14:08.804004 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.803847    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 01:14:08.804145 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.804010    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7xrlp\""
Sep 06 01:14:08.813484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.813460    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"]
Sep 06 01:14:08.875120 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875248 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875248 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875151    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875248 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ms24\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-kube-api-access-8ms24\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.875375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.875353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976352 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976488 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976488 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976387    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976488 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976488 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ms24\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-kube-api-access-8ms24\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976488 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976739 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976887 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.976887 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.977011 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.976997    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.977067 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.977020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.977270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.977250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.978819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.978790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.979065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.979038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.984189 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.984163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:08.984863 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:08.984828    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ms24\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-kube-api-access-8ms24\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckhxxh\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:09.069909 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.069851    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"]
Sep 06 01:14:09.074753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.074736    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077041 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077133 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077133 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a25348-4b45-4628-8590-2e4624f1e752-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077205 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a25348-4b45-4628-8590-2e4624f1e752-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077205 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thlcb\" (UniqueName: \"kubernetes.io/projected/70a25348-4b45-4628-8590-2e4624f1e752-kube-api-access-thlcb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077205 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077199    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077359 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077359 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.077430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.077361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a25348-4b45-4628-8590-2e4624f1e752-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.084539 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.084516    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"]
Sep 06 01:14:09.113255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.113229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:09.198792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.198746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.198792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.198782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.198853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.198881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a25348-4b45-4628-8590-2e4624f1e752-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199250 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199319 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199319 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a25348-4b45-4628-8590-2e4624f1e752-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199435 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a25348-4b45-4628-8590-2e4624f1e752-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199435 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thlcb\" (UniqueName: \"kubernetes.io/projected/70a25348-4b45-4628-8590-2e4624f1e752-kube-api-access-thlcb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199662 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199633    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.199806 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.199674    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.200266 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.200223    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.200266 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.200242    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.200382 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.200346    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a25348-4b45-4628-8590-2e4624f1e752-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.202290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.202261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a25348-4b45-4628-8590-2e4624f1e752-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.204294 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.204269    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a25348-4b45-4628-8590-2e4624f1e752-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.209352 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.209332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a25348-4b45-4628-8590-2e4624f1e752-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.211588 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.211567    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thlcb\" (UniqueName: \"kubernetes.io/projected/70a25348-4b45-4628-8590-2e4624f1e752-kube-api-access-thlcb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz\" (UID: \"70a25348-4b45-4628-8590-2e4624f1e752\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.386458 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.386390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:09.391399 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.391374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"]
Sep 06 01:14:09.393157 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:14:09.393130    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c74ca3_2e86_4b9e_b675_15f988c16b9d.slice/crio-14c2f51f5f3eaa692f7850724c30676e4b4cb12f5b346252c396315f94c9ea6a WatchSource:0}: Error finding container 14c2f51f5f3eaa692f7850724c30676e4b4cb12f5b346252c396315f94c9ea6a: Status 404 returned error can't find the container with id 14c2f51f5f3eaa692f7850724c30676e4b4cb12f5b346252c396315f94c9ea6a
Sep 06 01:14:09.395303 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.395289    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:14:09.548102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.548068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" event={"ID":"43c74ca3-2e86-4b9e-b675-15f988c16b9d","Type":"ContainerStarted","Data":"14c2f51f5f3eaa692f7850724c30676e4b4cb12f5b346252c396315f94c9ea6a"}
Sep 06 01:14:09.664704 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:09.664677    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"]
Sep 06 01:14:09.666465 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:14:09.666439    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a25348_4b45_4628_8590_2e4624f1e752.slice/crio-7247cb00614f2ad37b9d996591fa84ca7362a9f6583b08c10c83021785cd1c61 WatchSource:0}: Error finding container 7247cb00614f2ad37b9d996591fa84ca7362a9f6583b08c10c83021785cd1c61: Status 404 returned error can't find the container with id 7247cb00614f2ad37b9d996591fa84ca7362a9f6583b08c10c83021785cd1c61
Sep 06 01:14:10.145380 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.145346    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4rwc7"]
Sep 06 01:14:10.150066 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.150038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.152418 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.152395    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 06 01:14:10.152622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.152606    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wr76g\""
Sep 06 01:14:10.157655 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.157309    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4rwc7"]
Sep 06 01:14:10.208409 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.208363    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e64195fd-7588-460d-81f4-a69902e241a2-cert\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.208587 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.208502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h6p7\" (UniqueName: \"kubernetes.io/projected/e64195fd-7588-460d-81f4-a69902e241a2-kube-api-access-9h6p7\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.309490 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.309456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h6p7\" (UniqueName: \"kubernetes.io/projected/e64195fd-7588-460d-81f4-a69902e241a2-kube-api-access-9h6p7\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.309649 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.309519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e64195fd-7588-460d-81f4-a69902e241a2-cert\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.309698 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:14:10.309682    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 06 01:14:10.309770 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:14:10.309757    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64195fd-7588-460d-81f4-a69902e241a2-cert podName:e64195fd-7588-460d-81f4-a69902e241a2 nodeName:}" failed. No retries permitted until 2026-09-06 01:14:10.809733846 +0000 UTC m=+304.085118993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e64195fd-7588-460d-81f4-a69902e241a2-cert") pod "odh-model-controller-7998c67dc4-4rwc7" (UID: "e64195fd-7588-460d-81f4-a69902e241a2") : secret "odh-model-controller-webhook-cert" not found
Sep 06 01:14:10.320993 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.320964    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h6p7\" (UniqueName: \"kubernetes.io/projected/e64195fd-7588-460d-81f4-a69902e241a2-kube-api-access-9h6p7\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.566948 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.566809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz" event={"ID":"70a25348-4b45-4628-8590-2e4624f1e752","Type":"ContainerStarted","Data":"7247cb00614f2ad37b9d996591fa84ca7362a9f6583b08c10c83021785cd1c61"}
Sep 06 01:14:10.817034 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.816954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e64195fd-7588-460d-81f4-a69902e241a2-cert\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:10.820856 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:10.820829    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e64195fd-7588-460d-81f4-a69902e241a2-cert\") pod \"odh-model-controller-7998c67dc4-4rwc7\" (UID: \"e64195fd-7588-460d-81f4-a69902e241a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:11.062511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:11.062479    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:11.372725 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:11.372693    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4rwc7"]
Sep 06 01:14:11.576148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:11.576085    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7" event={"ID":"e64195fd-7588-460d-81f4-a69902e241a2","Type":"ContainerStarted","Data":"9eb4decd7a2d94eaaa9022e22b59b96c9a7fde591879b1e249d18c15cc7c4c87"}
Sep 06 01:14:12.786207 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:12.786148    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:12.786510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:12.786255    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:12.786510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:12.786294    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:12.797960 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:12.797917    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:12.798050 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:12.797988    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:12.798050 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:12.798021    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:13.592102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:13.592069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" event={"ID":"43c74ca3-2e86-4b9e-b675-15f988c16b9d","Type":"ContainerStarted","Data":"fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5"}
Sep 06 01:14:13.594390 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:13.594347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz" event={"ID":"70a25348-4b45-4628-8590-2e4624f1e752","Type":"ContainerStarted","Data":"2b0580ff623bad5c35ff75db44e8b7ca803e5570bf0bf556579cd81e5c1c559f"}
Sep 06 01:14:13.611165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:13.610723    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" podStartSLOduration=2.220267421 podStartE2EDuration="5.61070542s" totalImagesPullingTime="3.390437999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:13.609810792 +0000 UTC m=+306.885195983" watchObservedRunningTime="2026-09-06 01:14:13.61070542 +0000 UTC m=+306.886090584"
Sep 06 01:14:13.627832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:13.627711    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz" podStartSLOduration=1.498421961 podStartE2EDuration="4.62769317s" totalImagesPullingTime="3.129271209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:13.627380986 +0000 UTC m=+306.902766151" watchObservedRunningTime="2026-09-06 01:14:13.62769317 +0000 UTC m=+306.903078393"
Sep 06 01:14:14.114067 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.114030    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:14.115976 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.115921    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 06 01:14:14.116122 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.116006    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 06 01:14:14.387385 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.387298    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:14.392975 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.392950    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:14.600709 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.600669    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:14.601699 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.601679    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz"
Sep 06 01:14:14.650279 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:14.650203    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"]
Sep 06 01:14:15.114387 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:15.114350    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 06 01:14:15.114810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:15.114422    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 06 01:14:15.606769 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:15.606735    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7" event={"ID":"e64195fd-7588-460d-81f4-a69902e241a2","Type":"ContainerStarted","Data":"dff0eb031bebfba43278aace61bb0264b3bbef229b4d7c76259d5277d7e8ed02"}
Sep 06 01:14:15.623972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:15.623913    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7" podStartSLOduration=1.577600171 podStartE2EDuration="5.623897823s" totalImagesPullingTime="4.046297652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:15.622049911 +0000 UTC m=+308.897435076" watchObservedRunningTime="2026-09-06 01:14:15.623897823 +0000 UTC m=+308.899282986"
Sep 06 01:14:16.114469 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:16.114431    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 06 01:14:16.114817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:16.114484    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 06 01:14:16.612523 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:16.612479    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy" containerID="cri-o://fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5" gracePeriod=30
Sep 06 01:14:16.612844 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:16.612808    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:14:18.151064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.151028    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"]
Sep 06 01:14:18.154548 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.154532    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.158346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.158325    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 01:14:18.159386 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.159369    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 01:14:18.159465 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.159391    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 01:14:18.160111 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.160091    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7pm9p\""
Sep 06 01:14:18.185955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.185920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"]
Sep 06 01:14:18.286580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29868411-8804-4b28-b55c-c58413fa48dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.286738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.286738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.286738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29868411-8804-4b28-b55c-c58413fa48dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.286738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29868411-8804-4b28-b55c-c58413fa48dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.286949 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvxhm\" (UniqueName: \"kubernetes.io/projected/29868411-8804-4b28-b55c-c58413fa48dc-kube-api-access-hvxhm\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.286949 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.286852    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387447 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387548 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29868411-8804-4b28-b55c-c58413fa48dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387548 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387548 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387707 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29868411-8804-4b28-b55c-c58413fa48dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387764 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29868411-8804-4b28-b55c-c58413fa48dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.387815 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.387786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvxhm\" (UniqueName: \"kubernetes.io/projected/29868411-8804-4b28-b55c-c58413fa48dc-kube-api-access-hvxhm\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.388304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.388283    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29868411-8804-4b28-b55c-c58413fa48dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.389984 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.389957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.390074 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.390051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.390291 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.390268    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29868411-8804-4b28-b55c-c58413fa48dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.390438 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.390413    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29868411-8804-4b28-b55c-c58413fa48dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.398970 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.398945    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvxhm\" (UniqueName: \"kubernetes.io/projected/29868411-8804-4b28-b55c-c58413fa48dc-kube-api-access-hvxhm\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.399590 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.399563    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29868411-8804-4b28-b55c-c58413fa48dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rcd49\" (UID: \"29868411-8804-4b28-b55c-c58413fa48dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.463990 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.463965    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:18.738793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:18.738769    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"]
Sep 06 01:14:18.740793 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:14:18.740759    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29868411_8804_4b28_b55c_c58413fa48dc.slice/crio-ba4d18d320062544256da777ef0ee4f3c0774e3cc4ff8234592c8a9b0bdb14a8 WatchSource:0}: Error finding container ba4d18d320062544256da777ef0ee4f3c0774e3cc4ff8234592c8a9b0bdb14a8: Status 404 returned error can't find the container with id ba4d18d320062544256da777ef0ee4f3c0774e3cc4ff8234592c8a9b0bdb14a8
Sep 06 01:14:19.627958 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:19.627905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49" event={"ID":"29868411-8804-4b28-b55c-c58413fa48dc","Type":"ContainerStarted","Data":"ba4d18d320062544256da777ef0ee4f3c0774e3cc4ff8234592c8a9b0bdb14a8"}
Sep 06 01:14:21.378953 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:21.378903    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:21.379235 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:21.378983    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:14:21.639709 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:21.639672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49" event={"ID":"29868411-8804-4b28-b55c-c58413fa48dc","Type":"ContainerStarted","Data":"2c2431e576cb4b202f087b1c6052adcd6a679e8fdbd030e3f88bc84b73c03cf0"}
Sep 06 01:14:21.639812 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:21.639744    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:21.884555 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:21.884500    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:21.928761 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:21.928697    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49" podStartSLOduration=1.2930296110000001 podStartE2EDuration="3.928676926s" totalImagesPullingTime="2.635647315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:21.665152913 +0000 UTC m=+314.940538077" watchObservedRunningTime="2026-09-06 01:14:21.928676926 +0000 UTC m=+315.204062090"
Sep 06 01:14:22.023973 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.023914    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-podinfo\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.023973 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.023979    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-envoy\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024020    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ms24\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-kube-api-access-8ms24\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024047    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-certs\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024182    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-socket\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024384 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024226    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istiod-ca-cert\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024384 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024257    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-credential-socket\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024384 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024280    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-data\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024384 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024336    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-token\") pod \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\" (UID: \"43c74ca3-2e86-4b9e-b675-15f988c16b9d\") "
Sep 06 01:14:22.024384 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024343    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:14:22.024627 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024402    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:14:22.024627 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024611    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.024627 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:14:22.024779 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024630    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.024779 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024671    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:14:22.024779 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.024744    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:14:22.026410 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.026382    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:14:22.026544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.026449    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:14:22.026544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.026511    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:14:22.026544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.026508    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-kube-api-access-8ms24" (OuterVolumeSpecName: "kube-api-access-8ms24") pod "43c74ca3-2e86-4b9e-b675-15f988c16b9d" (UID: "43c74ca3-2e86-4b9e-b675-15f988c16b9d"). InnerVolumeSpecName "kube-api-access-8ms24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:14:22.125142 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125105    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.125142 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125134    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.125349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125151    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.125349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125166    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.125349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125178    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.125349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125195    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c74ca3-2e86-4b9e-b675-15f988c16b9d-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.125349 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.125209    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ms24\" (UniqueName: \"kubernetes.io/projected/43c74ca3-2e86-4b9e-b675-15f988c16b9d-kube-api-access-8ms24\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:14:22.645827 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.645790    2567 generic.go:356] "Generic (PLEG): container finished" podID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerID="fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5" exitCode=0
Sep 06 01:14:22.646290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.645853    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"
Sep 06 01:14:22.646290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.645885    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" event={"ID":"43c74ca3-2e86-4b9e-b675-15f988c16b9d","Type":"ContainerDied","Data":"fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5"}
Sep 06 01:14:22.646290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.645999    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh" event={"ID":"43c74ca3-2e86-4b9e-b675-15f988c16b9d","Type":"ContainerDied","Data":"14c2f51f5f3eaa692f7850724c30676e4b4cb12f5b346252c396315f94c9ea6a"}
Sep 06 01:14:22.646290 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.646034    2567 scope.go:117] "RemoveContainer" containerID="fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5"
Sep 06 01:14:22.648447 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.648429    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rcd49"
Sep 06 01:14:22.655451 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.655437    2567 scope.go:117] "RemoveContainer" containerID="fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5"
Sep 06 01:14:22.655748 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:14:22.655715    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5\": container with ID starting with fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5 not found: ID does not exist" containerID="fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5"
Sep 06 01:14:22.655797 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.655760    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5"} err="failed to get container status \"fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5\": rpc error: code = NotFound desc = could not find container \"fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5\": container with ID starting with fbe2276cecae0dabe13d8c116fa2e9594dee034ad5ef34a7088be846cd674eb5 not found: ID does not exist"
Sep 06 01:14:22.685376 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.685353    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"]
Sep 06 01:14:22.692685 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:22.692662    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhxxh"]
Sep 06 01:14:23.206945 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:23.206907    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" path="/var/lib/kubelet/pods/43c74ca3-2e86-4b9e-b675-15f988c16b9d/volumes"
Sep 06 01:14:27.618704 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:14:27.618671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4rwc7"
Sep 06 01:15:14.912961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.912915    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"]
Sep 06 01:15:14.913415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.913231    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy"
Sep 06 01:15:14.913415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.913242    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy"
Sep 06 01:15:14.913415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.913303    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c74ca3-2e86-4b9e-b675-15f988c16b9d" containerName="istio-proxy"
Sep 06 01:15:14.918055 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.918015    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:14.920508 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.920484    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rd6fc\""
Sep 06 01:15:14.920643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.920488    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 01:15:14.921602 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.921584    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 01:15:14.923898 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:14.923875    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"]
Sep 06 01:15:15.010183 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.010154    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"]
Sep 06 01:15:15.013756 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.013739    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.021852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.021829    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"]
Sep 06 01:15:15.029036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.029007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5smn\" (UniqueName: \"kubernetes.io/projected/b649a5af-4ea9-4d61-9435-b3b8de41f210-kube-api-access-t5smn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.029149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.029116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.029213 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.029183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.130424 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.130389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5smn\" (UniqueName: \"kubernetes.io/projected/b649a5af-4ea9-4d61-9435-b3b8de41f210-kube-api-access-t5smn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.130650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.130443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.130650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.130466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.130650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.130495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.130650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.130512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.130650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.130533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6x8\" (UniqueName: \"kubernetes.io/projected/8b1abc1c-bb98-40a4-8dab-bd4590d89668-kube-api-access-tn6x8\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.131147 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.131119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.131320 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.131145    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.133172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.133152    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"]
Sep 06 01:15:15.136676 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.136661    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.139803 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.139775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5smn\" (UniqueName: \"kubernetes.io/projected/b649a5af-4ea9-4d61-9435-b3b8de41f210-kube-api-access-t5smn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.146186 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.146163    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"]
Sep 06 01:15:15.221957 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.221914    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"]
Sep 06 01:15:15.225448 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.225432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.228519 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.228501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:15.231145 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.231123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.231677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.231350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.231677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.231418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.231677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.231493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.231677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.231543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6x8\" (UniqueName: \"kubernetes.io/projected/8b1abc1c-bb98-40a4-8dab-bd4590d89668-kube-api-access-tn6x8\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.231677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.231640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkm7k\" (UniqueName: \"kubernetes.io/projected/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-kube-api-access-rkm7k\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.232323 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.232299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.232323 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.232375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.234097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.234075    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"]
Sep 06 01:15:15.240995 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.240971    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6x8\" (UniqueName: \"kubernetes.io/projected/8b1abc1c-bb98-40a4-8dab-bd4590d89668-kube-api-access-tn6x8\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.323406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.323375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:15.332192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xjzv\" (UniqueName: \"kubernetes.io/projected/cdd71a3e-be5d-4684-99c0-1965a6c29eae-kube-api-access-8xjzv\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.332192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm7k\" (UniqueName: \"kubernetes.io/projected/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-kube-api-access-rkm7k\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.332192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.332346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.332346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.332346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.332610 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.332678 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.332652    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.341151 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.341125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkm7k\" (UniqueName: \"kubernetes.io/projected/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-kube-api-access-rkm7k\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.432909 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.432876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.433079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.432977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.433079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.433039    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xjzv\" (UniqueName: \"kubernetes.io/projected/cdd71a3e-be5d-4684-99c0-1965a6c29eae-kube-api-access-8xjzv\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.433311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.433290    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.433353 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.433337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.441118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.441089    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xjzv\" (UniqueName: \"kubernetes.io/projected/cdd71a3e-be5d-4684-99c0-1965a6c29eae-kube-api-access-8xjzv\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.454886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.454863    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:15.504201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.503728    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"]
Sep 06 01:15:15.506055 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:15:15.506014    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb649a5af_4ea9_4d61_9435_b3b8de41f210.slice/crio-8a5dabc815e1890e84191645500c83c8b0db1771a059a39616885fea5c8f03bb WatchSource:0}: Error finding container 8a5dabc815e1890e84191645500c83c8b0db1771a059a39616885fea5c8f03bb: Status 404 returned error can't find the container with id 8a5dabc815e1890e84191645500c83c8b0db1771a059a39616885fea5c8f03bb
Sep 06 01:15:15.534445 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.534423    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:15.606262 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.606227    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"]
Sep 06 01:15:15.609621 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:15:15.609588    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1abc1c_bb98_40a4_8dab_bd4590d89668.slice/crio-ce81c59e1379d7f69bf096f911ce09d54121ee50d42cbcf046ca04f3d2fcaf1c WatchSource:0}: Error finding container ce81c59e1379d7f69bf096f911ce09d54121ee50d42cbcf046ca04f3d2fcaf1c: Status 404 returned error can't find the container with id ce81c59e1379d7f69bf096f911ce09d54121ee50d42cbcf046ca04f3d2fcaf1c
Sep 06 01:15:15.736797 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:15:15.736752    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a91eff_f7b1_4cd2_8346_c3ccf0398d34.slice/crio-1646c56336740598548b50c6941ae8afad1156714f5feef2108ff3068c1f7258 WatchSource:0}: Error finding container 1646c56336740598548b50c6941ae8afad1156714f5feef2108ff3068c1f7258: Status 404 returned error can't find the container with id 1646c56336740598548b50c6941ae8afad1156714f5feef2108ff3068c1f7258
Sep 06 01:15:15.736920 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.736876    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"]
Sep 06 01:15:15.812680 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.812656    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"]
Sep 06 01:15:15.841822 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:15:15.841782    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd71a3e_be5d_4684_99c0_1965a6c29eae.slice/crio-9af118b25009a56ee7e9dfd58cf86c38c73fb47f4b00edd63b57888669313bf4 WatchSource:0}: Error finding container 9af118b25009a56ee7e9dfd58cf86c38c73fb47f4b00edd63b57888669313bf4: Status 404 returned error can't find the container with id 9af118b25009a56ee7e9dfd58cf86c38c73fb47f4b00edd63b57888669313bf4
Sep 06 01:15:15.895773 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.895734    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz" event={"ID":"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34","Type":"ContainerStarted","Data":"500c11e00dadcae2483fe9a4da2d156fca8653b10299e9488397bb400fa4592e"}
Sep 06 01:15:15.895945 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.895796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz" event={"ID":"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34","Type":"ContainerStarted","Data":"1646c56336740598548b50c6941ae8afad1156714f5feef2108ff3068c1f7258"}
Sep 06 01:15:15.898176 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.898152    2567 generic.go:356] "Generic (PLEG): container finished" podID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerID="e7a086a1c550775a50d16c61c286a10b42022878af2973c5f64cdc53d22ff85f" exitCode=0
Sep 06 01:15:15.898273 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.898253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq" event={"ID":"8b1abc1c-bb98-40a4-8dab-bd4590d89668","Type":"ContainerDied","Data":"e7a086a1c550775a50d16c61c286a10b42022878af2973c5f64cdc53d22ff85f"}
Sep 06 01:15:15.898348 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.898294    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq" event={"ID":"8b1abc1c-bb98-40a4-8dab-bd4590d89668","Type":"ContainerStarted","Data":"ce81c59e1379d7f69bf096f911ce09d54121ee50d42cbcf046ca04f3d2fcaf1c"}
Sep 06 01:15:15.900577 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.900302    2567 generic.go:356] "Generic (PLEG): container finished" podID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerID="a93eff31be306933c7a764f6dfa9964812340b7d5b6ebab08556b4567bb9f9e9" exitCode=0
Sep 06 01:15:15.900577 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.900446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm" event={"ID":"b649a5af-4ea9-4d61-9435-b3b8de41f210","Type":"ContainerDied","Data":"a93eff31be306933c7a764f6dfa9964812340b7d5b6ebab08556b4567bb9f9e9"}
Sep 06 01:15:15.900577 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.900486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm" event={"ID":"b649a5af-4ea9-4d61-9435-b3b8de41f210","Type":"ContainerStarted","Data":"8a5dabc815e1890e84191645500c83c8b0db1771a059a39616885fea5c8f03bb"}
Sep 06 01:15:15.903641 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:15.903533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8" event={"ID":"cdd71a3e-be5d-4684-99c0-1965a6c29eae","Type":"ContainerStarted","Data":"9af118b25009a56ee7e9dfd58cf86c38c73fb47f4b00edd63b57888669313bf4"}
Sep 06 01:15:16.911059 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:16.911025    2567 generic.go:356] "Generic (PLEG): container finished" podID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerID="60465f8974edb54dabaa25a84692e7f9cb7cb8a0a96fb2f895f13bdb5ef750cd" exitCode=0
Sep 06 01:15:16.911445 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:16.911109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8" event={"ID":"cdd71a3e-be5d-4684-99c0-1965a6c29eae","Type":"ContainerDied","Data":"60465f8974edb54dabaa25a84692e7f9cb7cb8a0a96fb2f895f13bdb5ef750cd"}
Sep 06 01:15:16.912662 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:16.912644    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerID="500c11e00dadcae2483fe9a4da2d156fca8653b10299e9488397bb400fa4592e" exitCode=0
Sep 06 01:15:16.912747 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:16.912728    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz" event={"ID":"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34","Type":"ContainerDied","Data":"500c11e00dadcae2483fe9a4da2d156fca8653b10299e9488397bb400fa4592e"}
Sep 06 01:15:17.923918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:17.923801    2567 generic.go:356] "Generic (PLEG): container finished" podID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerID="5b214ec9200c663132a5cf30d8ffa81564e8451080b9d8bab940ef1f814d1a3e" exitCode=0
Sep 06 01:15:17.923918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:17.923856    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq" event={"ID":"8b1abc1c-bb98-40a4-8dab-bd4590d89668","Type":"ContainerDied","Data":"5b214ec9200c663132a5cf30d8ffa81564e8451080b9d8bab940ef1f814d1a3e"}
Sep 06 01:15:17.927312 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:17.927268    2567 generic.go:356] "Generic (PLEG): container finished" podID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerID="cc4fb8f4f8f45420fb29108ec4ad3f8fab049e35f79f47ab0ea6b9c2705ac020" exitCode=0
Sep 06 01:15:17.927418 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:17.927379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm" event={"ID":"b649a5af-4ea9-4d61-9435-b3b8de41f210","Type":"ContainerDied","Data":"cc4fb8f4f8f45420fb29108ec4ad3f8fab049e35f79f47ab0ea6b9c2705ac020"}
Sep 06 01:15:18.934268 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.934238    2567 generic.go:356] "Generic (PLEG): container finished" podID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerID="069cefdd496d430b991e4fb5fb0986e0ddecd510faa475cb532b633cc9fc66be" exitCode=0
Sep 06 01:15:18.934672 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.934311    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8" event={"ID":"cdd71a3e-be5d-4684-99c0-1965a6c29eae","Type":"ContainerDied","Data":"069cefdd496d430b991e4fb5fb0986e0ddecd510faa475cb532b633cc9fc66be"}
Sep 06 01:15:18.936353 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.936334    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerID="f7e85401bcfad5efdf8a6d03d43daea71d70de7c18ed94cf5a3f55b2fb51f45f" exitCode=0
Sep 06 01:15:18.936443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.936403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz" event={"ID":"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34","Type":"ContainerDied","Data":"f7e85401bcfad5efdf8a6d03d43daea71d70de7c18ed94cf5a3f55b2fb51f45f"}
Sep 06 01:15:18.938693 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.938664    2567 generic.go:356] "Generic (PLEG): container finished" podID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerID="7ddac5931bb30680ca3cbb088338ad4b61e25853d670e09dd8942a28adf3cf1c" exitCode=0
Sep 06 01:15:18.938787 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.938743    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq" event={"ID":"8b1abc1c-bb98-40a4-8dab-bd4590d89668","Type":"ContainerDied","Data":"7ddac5931bb30680ca3cbb088338ad4b61e25853d670e09dd8942a28adf3cf1c"}
Sep 06 01:15:18.941039 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.941006    2567 generic.go:356] "Generic (PLEG): container finished" podID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerID="df250bcf38ac2845058c101c2d13c9472d593f5b9943b4a8746ecc6ed2769788" exitCode=0
Sep 06 01:15:18.941135 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:18.941037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm" event={"ID":"b649a5af-4ea9-4d61-9435-b3b8de41f210","Type":"ContainerDied","Data":"df250bcf38ac2845058c101c2d13c9472d593f5b9943b4a8746ecc6ed2769788"}
Sep 06 01:15:19.948007 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:19.947972    2567 generic.go:356] "Generic (PLEG): container finished" podID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerID="68dfac9d7b9906917e535fe0db35394ef8f35d85f2bcfcd4d907aab8a6420a9d" exitCode=0
Sep 06 01:15:19.948428 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:19.948057    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8" event={"ID":"cdd71a3e-be5d-4684-99c0-1965a6c29eae","Type":"ContainerDied","Data":"68dfac9d7b9906917e535fe0db35394ef8f35d85f2bcfcd4d907aab8a6420a9d"}
Sep 06 01:15:19.950224 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:19.950202    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerID="13de555603b5065ebab58423059d0a801e309404646968f5f73faabfc0d83ef4" exitCode=0
Sep 06 01:15:19.950331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:19.950287    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz" event={"ID":"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34","Type":"ContainerDied","Data":"13de555603b5065ebab58423059d0a801e309404646968f5f73faabfc0d83ef4"}
Sep 06 01:15:20.077628 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.077607    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:20.112326 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.112295    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:20.170005 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.169979    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-util\") pod \"b649a5af-4ea9-4d61-9435-b3b8de41f210\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") "
Sep 06 01:15:20.170128 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170030    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn6x8\" (UniqueName: \"kubernetes.io/projected/8b1abc1c-bb98-40a4-8dab-bd4590d89668-kube-api-access-tn6x8\") pod \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") "
Sep 06 01:15:20.170128 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170070    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-bundle\") pod \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") "
Sep 06 01:15:20.170128 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170105    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-bundle\") pod \"b649a5af-4ea9-4d61-9435-b3b8de41f210\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") "
Sep 06 01:15:20.170265 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-util\") pod \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\" (UID: \"8b1abc1c-bb98-40a4-8dab-bd4590d89668\") "
Sep 06 01:15:20.170265 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5smn\" (UniqueName: \"kubernetes.io/projected/b649a5af-4ea9-4d61-9435-b3b8de41f210-kube-api-access-t5smn\") pod \"b649a5af-4ea9-4d61-9435-b3b8de41f210\" (UID: \"b649a5af-4ea9-4d61-9435-b3b8de41f210\") "
Sep 06 01:15:20.170607 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170574    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-bundle" (OuterVolumeSpecName: "bundle") pod "b649a5af-4ea9-4d61-9435-b3b8de41f210" (UID: "b649a5af-4ea9-4d61-9435-b3b8de41f210"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:20.170733 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.170632    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-bundle" (OuterVolumeSpecName: "bundle") pod "8b1abc1c-bb98-40a4-8dab-bd4590d89668" (UID: "8b1abc1c-bb98-40a4-8dab-bd4590d89668"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:20.172317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.172297    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b649a5af-4ea9-4d61-9435-b3b8de41f210-kube-api-access-t5smn" (OuterVolumeSpecName: "kube-api-access-t5smn") pod "b649a5af-4ea9-4d61-9435-b3b8de41f210" (UID: "b649a5af-4ea9-4d61-9435-b3b8de41f210"). InnerVolumeSpecName "kube-api-access-t5smn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:20.172496 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.172479    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1abc1c-bb98-40a4-8dab-bd4590d89668-kube-api-access-tn6x8" (OuterVolumeSpecName: "kube-api-access-tn6x8") pod "8b1abc1c-bb98-40a4-8dab-bd4590d89668" (UID: "8b1abc1c-bb98-40a4-8dab-bd4590d89668"). InnerVolumeSpecName "kube-api-access-tn6x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:20.175803 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.175772    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-util" (OuterVolumeSpecName: "util") pod "b649a5af-4ea9-4d61-9435-b3b8de41f210" (UID: "b649a5af-4ea9-4d61-9435-b3b8de41f210"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:20.176529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.176508    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-util" (OuterVolumeSpecName: "util") pod "8b1abc1c-bb98-40a4-8dab-bd4590d89668" (UID: "8b1abc1c-bb98-40a4-8dab-bd4590d89668"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:20.271045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.270990    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn6x8\" (UniqueName: \"kubernetes.io/projected/8b1abc1c-bb98-40a4-8dab-bd4590d89668-kube-api-access-tn6x8\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:20.271045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.271011    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:20.271045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.271021    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:20.271045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.271029    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1abc1c-bb98-40a4-8dab-bd4590d89668-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:20.271045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.271037    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5smn\" (UniqueName: \"kubernetes.io/projected/b649a5af-4ea9-4d61-9435-b3b8de41f210-kube-api-access-t5smn\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:20.271045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.271046    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b649a5af-4ea9-4d61-9435-b3b8de41f210-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:20.957420 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.957393    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq"
Sep 06 01:15:20.957420 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.957403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cmc9gq" event={"ID":"8b1abc1c-bb98-40a4-8dab-bd4590d89668","Type":"ContainerDied","Data":"ce81c59e1379d7f69bf096f911ce09d54121ee50d42cbcf046ca04f3d2fcaf1c"}
Sep 06 01:15:20.957850 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.957450    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce81c59e1379d7f69bf096f911ce09d54121ee50d42cbcf046ca04f3d2fcaf1c"
Sep 06 01:15:20.959154 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.959136    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm"
Sep 06 01:15:20.959287 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.959165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0gbjvm" event={"ID":"b649a5af-4ea9-4d61-9435-b3b8de41f210","Type":"ContainerDied","Data":"8a5dabc815e1890e84191645500c83c8b0db1771a059a39616885fea5c8f03bb"}
Sep 06 01:15:20.959287 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:20.959198    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a5dabc815e1890e84191645500c83c8b0db1771a059a39616885fea5c8f03bb"
Sep 06 01:15:21.088374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.088353    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:21.112851 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.112826    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:21.177080 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177053    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xjzv\" (UniqueName: \"kubernetes.io/projected/cdd71a3e-be5d-4684-99c0-1965a6c29eae-kube-api-access-8xjzv\") pod \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") "
Sep 06 01:15:21.177232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177098    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-bundle\") pod \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") "
Sep 06 01:15:21.177232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-bundle\") pod \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") "
Sep 06 01:15:21.177232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177156    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkm7k\" (UniqueName: \"kubernetes.io/projected/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-kube-api-access-rkm7k\") pod \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") "
Sep 06 01:15:21.177232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177175    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-util\") pod \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\" (UID: \"cdd71a3e-be5d-4684-99c0-1965a6c29eae\") "
Sep 06 01:15:21.177232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177206    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-util\") pod \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\" (UID: \"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34\") "
Sep 06 01:15:21.177757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177728    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-bundle" (OuterVolumeSpecName: "bundle") pod "cdd71a3e-be5d-4684-99c0-1965a6c29eae" (UID: "cdd71a3e-be5d-4684-99c0-1965a6c29eae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:21.177856 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.177836    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-bundle" (OuterVolumeSpecName: "bundle") pod "a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" (UID: "a6a91eff-f7b1-4cd2-8346-c3ccf0398d34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:21.179242 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.179209    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-kube-api-access-rkm7k" (OuterVolumeSpecName: "kube-api-access-rkm7k") pod "a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" (UID: "a6a91eff-f7b1-4cd2-8346-c3ccf0398d34"). InnerVolumeSpecName "kube-api-access-rkm7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:21.179329 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.179238    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd71a3e-be5d-4684-99c0-1965a6c29eae-kube-api-access-8xjzv" (OuterVolumeSpecName: "kube-api-access-8xjzv") pod "cdd71a3e-be5d-4684-99c0-1965a6c29eae" (UID: "cdd71a3e-be5d-4684-99c0-1965a6c29eae"). InnerVolumeSpecName "kube-api-access-8xjzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:21.278204 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.278126    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xjzv\" (UniqueName: \"kubernetes.io/projected/cdd71a3e-be5d-4684-99c0-1965a6c29eae-kube-api-access-8xjzv\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:21.278204 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.278156    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:21.278204 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.278173    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:21.278204 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.278186    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkm7k\" (UniqueName: \"kubernetes.io/projected/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-kube-api-access-rkm7k\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:21.295841 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.295806    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-util" (OuterVolumeSpecName: "util") pod "cdd71a3e-be5d-4684-99c0-1965a6c29eae" (UID: "cdd71a3e-be5d-4684-99c0-1965a6c29eae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:21.297633 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.297607    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-util" (OuterVolumeSpecName: "util") pod "a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" (UID: "a6a91eff-f7b1-4cd2-8346-c3ccf0398d34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:21.378806 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.378775    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdd71a3e-be5d-4684-99c0-1965a6c29eae-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:21.378806 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.378802    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a91eff-f7b1-4cd2-8346-c3ccf0398d34-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:15:21.966870 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.966846    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8"
Sep 06 01:15:21.967340 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.966865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgf5r8" event={"ID":"cdd71a3e-be5d-4684-99c0-1965a6c29eae","Type":"ContainerDied","Data":"9af118b25009a56ee7e9dfd58cf86c38c73fb47f4b00edd63b57888669313bf4"}
Sep 06 01:15:21.967340 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.966916    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9af118b25009a56ee7e9dfd58cf86c38c73fb47f4b00edd63b57888669313bf4"
Sep 06 01:15:21.968842 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.968823    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz"
Sep 06 01:15:21.968964 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.968842    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jl8mz" event={"ID":"a6a91eff-f7b1-4cd2-8346-c3ccf0398d34","Type":"ContainerDied","Data":"1646c56336740598548b50c6941ae8afad1156714f5feef2108ff3068c1f7258"}
Sep 06 01:15:21.968964 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:15:21.968896    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1646c56336740598548b50c6941ae8afad1156714f5feef2108ff3068c1f7258"
Sep 06 01:16:22.692669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.692627    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"]
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693129    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="pull"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="pull"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693168    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="pull"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693176    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="pull"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693187    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693195    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693210    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693219    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693229    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="extract"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693237    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="extract"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693252    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693259    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693270    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="util"
Sep 06 01:16:22.693274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693278    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="util"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693285    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="pull"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693292    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="pull"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693308    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="pull"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693315    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="pull"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693325    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693333    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693345    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693352    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693361    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693369    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693440    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a91eff-f7b1-4cd2-8346-c3ccf0398d34" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693455    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b649a5af-4ea9-4d61-9435-b3b8de41f210" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693464    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1abc1c-bb98-40a4-8dab-bd4590d89668" containerName="extract"
Sep 06 01:16:22.693942 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.693475    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdd71a3e-be5d-4684-99c0-1965a6c29eae" containerName="extract"
Sep 06 01:16:22.696882 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.696858    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.699298 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.699276    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cbzn5\""
Sep 06 01:16:22.706366 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.706324    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"]
Sep 06 01:16:22.800127 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800127 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zczx5\" (UniqueName: \"kubernetes.io/projected/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-kube-api-access-zczx5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.800363 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.800335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901257 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zczx5\" (UniqueName: \"kubernetes.io/projected/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-kube-api-access-zczx5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901882 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901793    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.901983 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.901956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.902050 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.902019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.902250 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.902232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.903549 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.903531    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.904096 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.904080    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.908745 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.908722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:22.909197 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:22.909177    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zczx5\" (UniqueName: \"kubernetes.io/projected/1dbc75b2-ba36-4a25-bca5-1a9e127087e4-kube-api-access-zczx5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4jh69\" (UID: \"1dbc75b2-ba36-4a25-bca5-1a9e127087e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:23.008431 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:23.008340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:23.284955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:23.284898    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"]
Sep 06 01:16:23.286297 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:16:23.286272    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbc75b2_ba36_4a25_bca5_1a9e127087e4.slice/crio-8778c55c2bfe13ca4d0e6b28f2b05c3659344247c3888072f9ae480cd09728ff WatchSource:0}: Error finding container 8778c55c2bfe13ca4d0e6b28f2b05c3659344247c3888072f9ae480cd09728ff: Status 404 returned error can't find the container with id 8778c55c2bfe13ca4d0e6b28f2b05c3659344247c3888072f9ae480cd09728ff
Sep 06 01:16:23.288421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:23.288386    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:16:23.288498 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:23.288465    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:16:23.288536 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:23.288506    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:16:24.273871 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:24.273833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" event={"ID":"1dbc75b2-ba36-4a25-bca5-1a9e127087e4","Type":"ContainerStarted","Data":"6c69a10021c396c1e0c3feab5ad9e3b587b88bdb31dafbe3bf824689e9f85337"}
Sep 06 01:16:24.274261 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:24.273916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" event={"ID":"1dbc75b2-ba36-4a25-bca5-1a9e127087e4","Type":"ContainerStarted","Data":"8778c55c2bfe13ca4d0e6b28f2b05c3659344247c3888072f9ae480cd09728ff"}
Sep 06 01:16:24.294648 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:24.294605    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" podStartSLOduration=2.294592389 podStartE2EDuration="2.294592389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:24.293666234 +0000 UTC m=+437.569051420" watchObservedRunningTime="2026-09-06 01:16:24.294592389 +0000 UTC m=+437.569977551"
Sep 06 01:16:25.008811 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:25.008771    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:25.013422 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:25.013397    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:25.279646 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:25.279562    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:16:25.280519 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:16:25.280493    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:17:16.375307 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.375270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74d564bf49-n6qb5"]
Sep 06 01:17:16.379046 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.379023    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.381612 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.381585    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:17:16.381735 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.381615    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:17:16.381735 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.381703    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:17:16.381837 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.381766    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f8grl\""
Sep 06 01:17:16.388086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.388062    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74d564bf49-n6qb5"]
Sep 06 01:17:16.463373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.463339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-webhook-cert\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.463373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.463378    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-metrics-certs\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.463603 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.463514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv4pb\" (UniqueName: \"kubernetes.io/projected/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-kube-api-access-pv4pb\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.564010 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.563982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-webhook-cert\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.564010 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.564015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-metrics-certs\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.564247 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.564076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv4pb\" (UniqueName: \"kubernetes.io/projected/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-kube-api-access-pv4pb\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.566504 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.566472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-metrics-certs\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.566608 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.566472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-webhook-cert\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.574432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.574403    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv4pb\" (UniqueName: \"kubernetes.io/projected/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-kube-api-access-pv4pb\") pod \"maas-controller-74d564bf49-n6qb5\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") " pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.692573 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.692542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:16.966387 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:16.966358    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74d564bf49-n6qb5"]
Sep 06 01:17:16.967999 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:17:16.967976    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3e02fe_cb65_45cb_938e_791f7f8e48e0.slice/crio-c9a34f2fd6bda414d32c36566484c9070ba6738b75d701736fed1ee17b4080d9 WatchSource:0}: Error finding container c9a34f2fd6bda414d32c36566484c9070ba6738b75d701736fed1ee17b4080d9: Status 404 returned error can't find the container with id c9a34f2fd6bda414d32c36566484c9070ba6738b75d701736fed1ee17b4080d9
Sep 06 01:17:17.546347 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:17.546298    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d564bf49-n6qb5" event={"ID":"1d3e02fe-cb65-45cb-938e-791f7f8e48e0","Type":"ContainerStarted","Data":"c9a34f2fd6bda414d32c36566484c9070ba6738b75d701736fed1ee17b4080d9"}
Sep 06 01:17:19.558398 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:19.558309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d564bf49-n6qb5" event={"ID":"1d3e02fe-cb65-45cb-938e-791f7f8e48e0","Type":"ContainerStarted","Data":"ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c"}
Sep 06 01:17:19.558743 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:19.558454    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:19.581831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:19.581786    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74d564bf49-n6qb5" podStartSLOduration=1.24287424 podStartE2EDuration="3.581773317s" totalImagesPullingTime="2.338899077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:19.579727524 +0000 UTC m=+492.855112678" watchObservedRunningTime="2026-09-06 01:17:19.581773317 +0000 UTC m=+492.857158481"
Sep 06 01:17:30.565522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:30.565487    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:30.726275 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:30.726220    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74d564bf49-n6qb5"]
Sep 06 01:17:30.726448 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:30.726423    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74d564bf49-n6qb5" podUID="1d3e02fe-cb65-45cb-938e-791f7f8e48e0" containerName="manager" containerID="cri-o://ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c" gracePeriod=30
Sep 06 01:17:30.966225 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:30.966202    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:31.095696 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.095571    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv4pb\" (UniqueName: \"kubernetes.io/projected/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-kube-api-access-pv4pb\") pod \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") "
Sep 06 01:17:31.095696 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.095665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-metrics-certs\") pod \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") "
Sep 06 01:17:31.095907 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.095720    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-webhook-cert\") pod \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\" (UID: \"1d3e02fe-cb65-45cb-938e-791f7f8e48e0\") "
Sep 06 01:17:31.097983 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.097951    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1d3e02fe-cb65-45cb-938e-791f7f8e48e0" (UID: "1d3e02fe-cb65-45cb-938e-791f7f8e48e0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:17:31.098099 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.098037    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-kube-api-access-pv4pb" (OuterVolumeSpecName: "kube-api-access-pv4pb") pod "1d3e02fe-cb65-45cb-938e-791f7f8e48e0" (UID: "1d3e02fe-cb65-45cb-938e-791f7f8e48e0"). InnerVolumeSpecName "kube-api-access-pv4pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:17:31.098099 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.098077    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1d3e02fe-cb65-45cb-938e-791f7f8e48e0" (UID: "1d3e02fe-cb65-45cb-938e-791f7f8e48e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:17:31.197301 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.197269    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv4pb\" (UniqueName: \"kubernetes.io/projected/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-kube-api-access-pv4pb\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:17:31.197301 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.197296    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-metrics-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:17:31.197301 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.197305    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d3e02fe-cb65-45cb-938e-791f7f8e48e0-webhook-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:17:31.618030 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.617993    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d3e02fe-cb65-45cb-938e-791f7f8e48e0" containerID="ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c" exitCode=0
Sep 06 01:17:31.618452 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.618037    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d564bf49-n6qb5"
Sep 06 01:17:31.618452 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.618078    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d564bf49-n6qb5" event={"ID":"1d3e02fe-cb65-45cb-938e-791f7f8e48e0","Type":"ContainerDied","Data":"ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c"}
Sep 06 01:17:31.618452 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.618130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d564bf49-n6qb5" event={"ID":"1d3e02fe-cb65-45cb-938e-791f7f8e48e0","Type":"ContainerDied","Data":"c9a34f2fd6bda414d32c36566484c9070ba6738b75d701736fed1ee17b4080d9"}
Sep 06 01:17:31.618452 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.618152    2567 scope.go:117] "RemoveContainer" containerID="ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c"
Sep 06 01:17:31.626522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.626496    2567 scope.go:117] "RemoveContainer" containerID="ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c"
Sep 06 01:17:31.626778 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:17:31.626759    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c\": container with ID starting with ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c not found: ID does not exist" containerID="ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c"
Sep 06 01:17:31.626817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.626787    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c"} err="failed to get container status \"ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c\": rpc error: code = NotFound desc = could not find container \"ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c\": container with ID starting with ae753ab6d5ded1ddad5878dca47f849ffe751b5f3d8a8d44570182ea3dc4331c not found: ID does not exist"
Sep 06 01:17:31.661332 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.661309    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74d564bf49-n6qb5"]
Sep 06 01:17:31.671873 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:31.671845    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74d564bf49-n6qb5"]
Sep 06 01:17:33.207847 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:33.207816    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d3e02fe-cb65-45cb-938e-791f7f8e48e0" path="/var/lib/kubelet/pods/1d3e02fe-cb65-45cb-938e-791f7f8e48e0/volumes"
Sep 06 01:17:53.236843 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.236806    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"]
Sep 06 01:17:53.237311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.237169    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3e02fe-cb65-45cb-938e-791f7f8e48e0" containerName="manager"
Sep 06 01:17:53.237311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.237183    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3e02fe-cb65-45cb-938e-791f7f8e48e0" containerName="manager"
Sep 06 01:17:53.237311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.237238    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d3e02fe-cb65-45cb-938e-791f7f8e48e0" containerName="manager"
Sep 06 01:17:53.242433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.242414    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.245577 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.245556    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8pr66\""
Sep 06 01:17:53.245691 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.245603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 06 01:17:53.247729 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.247705    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"]
Sep 06 01:17:53.275749 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.275703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db0b0d71-b56d-49ef-a3ed-eaa7acce9c60-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-dwbm4\" (UID: \"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.275896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.275775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cnmj\" (UniqueName: \"kubernetes.io/projected/db0b0d71-b56d-49ef-a3ed-eaa7acce9c60-kube-api-access-7cnmj\") pod \"payload-processing-5b54b7fbb7-dwbm4\" (UID: \"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.377015 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.376979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db0b0d71-b56d-49ef-a3ed-eaa7acce9c60-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-dwbm4\" (UID: \"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.377192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.377060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cnmj\" (UniqueName: \"kubernetes.io/projected/db0b0d71-b56d-49ef-a3ed-eaa7acce9c60-kube-api-access-7cnmj\") pod \"payload-processing-5b54b7fbb7-dwbm4\" (UID: \"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.377775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.377744    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db0b0d71-b56d-49ef-a3ed-eaa7acce9c60-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-dwbm4\" (UID: \"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.385777 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.385750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cnmj\" (UniqueName: \"kubernetes.io/projected/db0b0d71-b56d-49ef-a3ed-eaa7acce9c60-kube-api-access-7cnmj\") pod \"payload-processing-5b54b7fbb7-dwbm4\" (UID: \"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.553689 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.553602    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:53.823172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:53.823144    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"]
Sep 06 01:17:53.824512 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:17:53.824483    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0b0d71_b56d_49ef_a3ed_eaa7acce9c60.slice/crio-7fffabbd53d58628925b7ce40fed9fef54208c3a2b31230a49502651c6329fcd WatchSource:0}: Error finding container 7fffabbd53d58628925b7ce40fed9fef54208c3a2b31230a49502651c6329fcd: Status 404 returned error can't find the container with id 7fffabbd53d58628925b7ce40fed9fef54208c3a2b31230a49502651c6329fcd
Sep 06 01:17:54.766876 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:54.766835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4" event={"ID":"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60","Type":"ContainerStarted","Data":"7fffabbd53d58628925b7ce40fed9fef54208c3a2b31230a49502651c6329fcd"}
Sep 06 01:17:55.773516 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:55.773479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4" event={"ID":"db0b0d71-b56d-49ef-a3ed-eaa7acce9c60","Type":"ContainerStarted","Data":"a354e2347644cbec73d46af17f6994925427b50c1303ada3774246db3643ec5e"}
Sep 06 01:17:55.773998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:55.773577    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:17:55.789848 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:17:55.789684    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4" podStartSLOduration=0.931428762 podStartE2EDuration="2.789666017s" totalImagesPullingTime="1.858237255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:55.789091089 +0000 UTC m=+529.064476251" watchObservedRunningTime="2026-09-06 01:17:55.789666017 +0000 UTC m=+529.065051181"
Sep 06 01:18:02.811641 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:02.811606    2567 generic.go:356] "Generic (PLEG): container finished" podID="1dbc75b2-ba36-4a25-bca5-1a9e127087e4" containerID="6c69a10021c396c1e0c3feab5ad9e3b587b88bdb31dafbe3bf824689e9f85337" exitCode=0
Sep 06 01:18:02.812072 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:02.811673    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" event={"ID":"1dbc75b2-ba36-4a25-bca5-1a9e127087e4","Type":"ContainerDied","Data":"6c69a10021c396c1e0c3feab5ad9e3b587b88bdb31dafbe3bf824689e9f85337"}
Sep 06 01:18:02.812147 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:02.812132    2567 scope.go:117] "RemoveContainer" containerID="6c69a10021c396c1e0c3feab5ad9e3b587b88bdb31dafbe3bf824689e9f85337"
Sep 06 01:18:02.813120 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:02.813091    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:18:02.813212 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:02.813170    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:18:02.813269 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:02.813232    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:18:03.821825 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:03.821792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" event={"ID":"1dbc75b2-ba36-4a25-bca5-1a9e127087e4","Type":"ContainerStarted","Data":"2a2cf140796e46237454776137edce686e57ce5618ae3876c2cbd3bb7187911f"}
Sep 06 01:18:04.009431 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:04.009393    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:18:04.009602 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:04.009579    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4jh69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 01:18:04.009647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:04.009627    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" podUID="1dbc75b2-ba36-4a25-bca5-1a9e127087e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 01:18:05.008945 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:05.008899    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4jh69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 01:18:05.009320 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:05.008977    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" podUID="1dbc75b2-ba36-4a25-bca5-1a9e127087e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 01:18:06.009371 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:06.009334    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4jh69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 01:18:06.009754 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:06.009404    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" podUID="1dbc75b2-ba36-4a25-bca5-1a9e127087e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 01:18:06.781107 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:06.781070    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-dwbm4"
Sep 06 01:18:07.009164 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:07.009115    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4jh69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 01:18:07.009338 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:07.009187    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" podUID="1dbc75b2-ba36-4a25-bca5-1a9e127087e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 01:18:08.009569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:08.009533    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4jh69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 01:18:08.009951 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:08.009583    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69" podUID="1dbc75b2-ba36-4a25-bca5-1a9e127087e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 01:18:09.047513 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:09.047482    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:18:09.048013 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:09.047967    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:18:09.048777 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:09.048744    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4jh69"
Sep 06 01:18:14.841426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.841394    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"]
Sep 06 01:18:14.844448 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.844432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:14.847069 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.847047    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 01:18:14.848043 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.848018    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 01:18:14.848189 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.848140    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2m2m5\""
Sep 06 01:18:14.848189 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.848167    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 06 01:18:14.862422 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.862399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"]
Sep 06 01:18:14.962808 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.962775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2686f132-4df6-4e1f-b309-dc513a7bc344-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:14.962977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.962817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:14.962977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.962842    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:14.962977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.962892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:14.962977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.962918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:14.962977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:14.962945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5nn\" (UniqueName: \"kubernetes.io/projected/2686f132-4df6-4e1f-b309-dc513a7bc344-kube-api-access-nq5nn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064303 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064472 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064472 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5nn\" (UniqueName: \"kubernetes.io/projected/2686f132-4df6-4e1f-b309-dc513a7bc344-kube-api-access-nq5nn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064472 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2686f132-4df6-4e1f-b309-dc513a7bc344-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064472 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064679 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064735 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064710    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064819 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.064878 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.064860    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.066727 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.066701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2686f132-4df6-4e1f-b309-dc513a7bc344-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.067009 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.066989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2686f132-4df6-4e1f-b309-dc513a7bc344-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.071523 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.071500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5nn\" (UniqueName: \"kubernetes.io/projected/2686f132-4df6-4e1f-b309-dc513a7bc344-kube-api-access-nq5nn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g\" (UID: \"2686f132-4df6-4e1f-b309-dc513a7bc344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.157820 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.157756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:15.429299 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.429274    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"]
Sep 06 01:18:15.432012 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:18:15.431985    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2686f132_4df6_4e1f_b309_dc513a7bc344.slice/crio-f1784e020d2c34256d4a24156d2854746da76dce62fb4cfc9c20fef8dd4db23f WatchSource:0}: Error finding container f1784e020d2c34256d4a24156d2854746da76dce62fb4cfc9c20fef8dd4db23f: Status 404 returned error can't find the container with id f1784e020d2c34256d4a24156d2854746da76dce62fb4cfc9c20fef8dd4db23f
Sep 06 01:18:15.887442 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:15.887352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g" event={"ID":"2686f132-4df6-4e1f-b309-dc513a7bc344","Type":"ContainerStarted","Data":"f1784e020d2c34256d4a24156d2854746da76dce62fb4cfc9c20fef8dd4db23f"}
Sep 06 01:18:16.893866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:16.893782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g" event={"ID":"2686f132-4df6-4e1f-b309-dc513a7bc344","Type":"ContainerStarted","Data":"e03a805350d7ab61851c0a8c7b1b2c69c6acd9d5e1c229a93ae183df8d9a572b"}
Sep 06 01:18:16.912855 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:16.912809    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g" podStartSLOduration=1.870448456 podStartE2EDuration="2.912795376s" totalImagesPullingTime="1.04234692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:18:16.909585954 +0000 UTC m=+550.184971117" watchObservedRunningTime="2026-09-06 01:18:16.912795376 +0000 UTC m=+550.188180540"
Sep 06 01:18:25.158450 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:25.158416    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:25.158814 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:25.158477    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:25.171089 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:25.171065    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:25.948774 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:25.948739    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g"
Sep 06 01:18:46.047988 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.047953    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"]
Sep 06 01:18:46.052280 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.052256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.055222 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.055196    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 06 01:18:46.056911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.056887    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"]
Sep 06 01:18:46.134388 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.134365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.134510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.134393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.134510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.134415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.134510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.134437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c12ad93-f39e-4b18-b009-f2b8a999fedb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.134510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.134495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.134648 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.134575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72tst\" (UniqueName: \"kubernetes.io/projected/6c12ad93-f39e-4b18-b009-f2b8a999fedb-kube-api-access-72tst\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.234995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c12ad93-f39e-4b18-b009-f2b8a999fedb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235230 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235303 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72tst\" (UniqueName: \"kubernetes.io/projected/6c12ad93-f39e-4b18-b009-f2b8a999fedb-kube-api-access-72tst\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235418 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235487 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235615 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235594    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235615 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.235866 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.235845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.237434 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.237406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c12ad93-f39e-4b18-b009-f2b8a999fedb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.237560 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.237546    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c12ad93-f39e-4b18-b009-f2b8a999fedb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.243090 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.243072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72tst\" (UniqueName: \"kubernetes.io/projected/6c12ad93-f39e-4b18-b009-f2b8a999fedb-kube-api-access-72tst\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vcf7z\" (UID: \"6c12ad93-f39e-4b18-b009-f2b8a999fedb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.363265 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.363203    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:46.630346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:46.630322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"]
Sep 06 01:18:46.632579 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:18:46.632552    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c12ad93_f39e_4b18_b009_f2b8a999fedb.slice/crio-259728d538d32ef2ed0440d7db2a067d828c6603d76cc9916d9dca4c24e4d3fe WatchSource:0}: Error finding container 259728d538d32ef2ed0440d7db2a067d828c6603d76cc9916d9dca4c24e4d3fe: Status 404 returned error can't find the container with id 259728d538d32ef2ed0440d7db2a067d828c6603d76cc9916d9dca4c24e4d3fe
Sep 06 01:18:47.047202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:47.047168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z" event={"ID":"6c12ad93-f39e-4b18-b009-f2b8a999fedb","Type":"ContainerStarted","Data":"a3eac26af5f34e001d5c1ee05218b7d695363cb7cdee55b21701ef5f5d1c6105"}
Sep 06 01:18:47.047394 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:47.047229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z" event={"ID":"6c12ad93-f39e-4b18-b009-f2b8a999fedb","Type":"ContainerStarted","Data":"259728d538d32ef2ed0440d7db2a067d828c6603d76cc9916d9dca4c24e4d3fe"}
Sep 06 01:18:47.090009 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:47.089961    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z" podStartSLOduration=0.932912547 podStartE2EDuration="1.08994568s" totalImagesPullingTime="157.033133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:18:47.088951009 +0000 UTC m=+580.364336170" watchObservedRunningTime="2026-09-06 01:18:47.08994568 +0000 UTC m=+580.365330834"
Sep 06 01:18:56.364331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:56.364295    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:56.364849 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:56.364379    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:56.376774 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:56.376752    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:18:57.114569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:18:57.114541    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vcf7z"
Sep 06 01:19:00.439181 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.439148    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"]
Sep 06 01:19:00.441522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.441506    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.443960 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.443917    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 06 01:19:00.450878 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.450853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"]
Sep 06 01:19:00.554452 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.554418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.554600 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.554485    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.554600 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.554505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.554600 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.554520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06aa6a31-47bb-464c-9a6d-acc93eb6286b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.554736 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.554614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.554736 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.554659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4bcc\" (UniqueName: \"kubernetes.io/projected/06aa6a31-47bb-464c-9a6d-acc93eb6286b-kube-api-access-h4bcc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655280 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655280 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655280 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06aa6a31-47bb-464c-9a6d-acc93eb6286b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655564 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655564 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655365    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4bcc\" (UniqueName: \"kubernetes.io/projected/06aa6a31-47bb-464c-9a6d-acc93eb6286b-kube-api-access-h4bcc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655564 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655726 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655688    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655804 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655751    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.655964 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.655914    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.657577 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.657550    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06aa6a31-47bb-464c-9a6d-acc93eb6286b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.657698 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.657683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06aa6a31-47bb-464c-9a6d-acc93eb6286b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.662982 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.662966    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4bcc\" (UniqueName: \"kubernetes.io/projected/06aa6a31-47bb-464c-9a6d-acc93eb6286b-kube-api-access-h4bcc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xzckp\" (UID: \"06aa6a31-47bb-464c-9a6d-acc93eb6286b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:00.753051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:00.752983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:01.021998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:01.021974    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"]
Sep 06 01:19:01.023489 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:19:01.023461    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06aa6a31_47bb_464c_9a6d_acc93eb6286b.slice/crio-659f129064166f287a476ea312ebdb26d9db59dc694c67b6c73c6db61ae88ef1 WatchSource:0}: Error finding container 659f129064166f287a476ea312ebdb26d9db59dc694c67b6c73c6db61ae88ef1: Status 404 returned error can't find the container with id 659f129064166f287a476ea312ebdb26d9db59dc694c67b6c73c6db61ae88ef1
Sep 06 01:19:01.123629 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:01.123596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp" event={"ID":"06aa6a31-47bb-464c-9a6d-acc93eb6286b","Type":"ContainerStarted","Data":"659f129064166f287a476ea312ebdb26d9db59dc694c67b6c73c6db61ae88ef1"}
Sep 06 01:19:02.130548 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:02.130509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp" event={"ID":"06aa6a31-47bb-464c-9a6d-acc93eb6286b","Type":"ContainerStarted","Data":"5daf6167257a261faa8a114f0df65556b0fcd059a92bc413f98bf5791325c060"}
Sep 06 01:19:02.150922 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:02.150877    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp" podStartSLOduration=2.001402119 podStartE2EDuration="2.150862807s" totalImagesPullingTime="149.460688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:19:02.148125643 +0000 UTC m=+595.423510820" watchObservedRunningTime="2026-09-06 01:19:02.150862807 +0000 UTC m=+595.426247969"
Sep 06 01:19:10.753944 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:10.753902    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:10.754331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:10.753988    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:10.766470 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:10.766439    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:19:11.200753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:19:11.200720    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xzckp"
Sep 06 01:20:37.312723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.312687    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"]
Sep 06 01:20:37.315862 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.315846    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.318274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.318251    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-b63fa0\""
Sep 06 01:20:37.318407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.318370    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-b63fa0-dockercfg-dnjbg\""
Sep 06 01:20:37.325998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.325978    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"]
Sep 06 01:20:37.330293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.330270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"]
Sep 06 01:20:37.333267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.333250    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.342706 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.342683    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"]
Sep 06 01:20:37.369056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.369024    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af29f904-bb06-4208-b73e-a0dc5eae764a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.369175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.369076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7pbf\" (UniqueName: \"kubernetes.io/projected/8dc7770e-9043-41c2-83f1-15be399e69bf-kube-api-access-k7pbf\") pod \"payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.369175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.369098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc7770e-9043-41c2-83f1-15be399e69bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.369175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.369160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826n4\" (UniqueName: \"kubernetes.io/projected/af29f904-bb06-4208-b73e-a0dc5eae764a-kube-api-access-826n4\") pod \"payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.469805 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.469767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af29f904-bb06-4208-b73e-a0dc5eae764a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.469996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.469820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7pbf\" (UniqueName: \"kubernetes.io/projected/8dc7770e-9043-41c2-83f1-15be399e69bf-kube-api-access-k7pbf\") pod \"payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.469996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.469852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc7770e-9043-41c2-83f1-15be399e69bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.469996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.469877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826n4\" (UniqueName: \"kubernetes.io/projected/af29f904-bb06-4208-b73e-a0dc5eae764a-kube-api-access-826n4\") pod \"payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.470552 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.470529    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc7770e-9043-41c2-83f1-15be399e69bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.470594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.470536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af29f904-bb06-4208-b73e-a0dc5eae764a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.477795 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.477772    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-826n4\" (UniqueName: \"kubernetes.io/projected/af29f904-bb06-4208-b73e-a0dc5eae764a-kube-api-access-826n4\") pod \"payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.477908 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.477842    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7pbf\" (UniqueName: \"kubernetes.io/projected/8dc7770e-9043-41c2-83f1-15be399e69bf-kube-api-access-k7pbf\") pod \"payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.627107 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.627031    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:37.644094 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.644066    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:37.900402 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.900369    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"]
Sep 06 01:20:37.902051 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:20:37.902021    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc7770e_9043_41c2_83f1_15be399e69bf.slice/crio-43ae651fa4fc99539b33125749d667aaf18629c902902ca2910cb7cb25b06852 WatchSource:0}: Error finding container 43ae651fa4fc99539b33125749d667aaf18629c902902ca2910cb7cb25b06852: Status 404 returned error can't find the container with id 43ae651fa4fc99539b33125749d667aaf18629c902902ca2910cb7cb25b06852
Sep 06 01:20:37.925953 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:37.925921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"]
Sep 06 01:20:37.938887 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:20:37.938850    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf29f904_bb06_4208_b73e_a0dc5eae764a.slice/crio-22643646109de269c67d12d2fd4db297a60a321d23917dd2d57b1bc062cfa19f WatchSource:0}: Error finding container 22643646109de269c67d12d2fd4db297a60a321d23917dd2d57b1bc062cfa19f: Status 404 returned error can't find the container with id 22643646109de269c67d12d2fd4db297a60a321d23917dd2d57b1bc062cfa19f
Sep 06 01:20:38.634198 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.634160    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g" event={"ID":"af29f904-bb06-4208-b73e-a0dc5eae764a","Type":"ContainerStarted","Data":"5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21"}
Sep 06 01:20:38.634642 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.634226    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g" event={"ID":"af29f904-bb06-4208-b73e-a0dc5eae764a","Type":"ContainerStarted","Data":"22643646109de269c67d12d2fd4db297a60a321d23917dd2d57b1bc062cfa19f"}
Sep 06 01:20:38.634642 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.634260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:38.635996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.635965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t" event={"ID":"8dc7770e-9043-41c2-83f1-15be399e69bf","Type":"ContainerStarted","Data":"4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e"}
Sep 06 01:20:38.636187 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.636173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t" event={"ID":"8dc7770e-9043-41c2-83f1-15be399e69bf","Type":"ContainerStarted","Data":"43ae651fa4fc99539b33125749d667aaf18629c902902ca2910cb7cb25b06852"}
Sep 06 01:20:38.636308 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.636287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:38.685505 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.685459    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g" podStartSLOduration=1.6854417750000001 podStartE2EDuration="1.685441775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:38.683682784 +0000 UTC m=+691.959067948" watchObservedRunningTime="2026-09-06 01:20:38.685441775 +0000 UTC m=+691.960826943"
Sep 06 01:20:38.716171 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:38.716130    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t" podStartSLOduration=1.716116833 podStartE2EDuration="1.716116833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:38.713916517 +0000 UTC m=+691.989301682" watchObservedRunningTime="2026-09-06 01:20:38.716116833 +0000 UTC m=+691.991502004"
Sep 06 01:20:41.665470 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.665439    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"]
Sep 06 01:20:41.670227 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.670202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.672773 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.672747    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-20c535-openshift-default-dockercfg-jcl5f\""
Sep 06 01:20:41.701094 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.701062    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"]
Sep 06 01:20:41.811505 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfrb\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-kube-api-access-wcfrb\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811678 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-podinfo\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811678 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-credential-socket\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811678 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-token\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-certs\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-envoy\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istiod-ca-cert\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811962 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-socket\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.811962 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.811868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-data\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.912918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.912871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-certs\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913129 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.912963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-envoy\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913129 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istiod-ca-cert\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913129 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-socket\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913129 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-data\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913355 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfrb\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-kube-api-access-wcfrb\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913355 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-podinfo\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913355 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-credential-socket\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913355 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913279    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-token\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913584 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913361    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-certs\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913584 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913491    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-socket\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.913748 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.913705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-credential-socket\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.914039 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.914013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-data\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.914272 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.914250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istiod-ca-cert\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.915893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.915840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-envoy\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.916677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.916658    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-podinfo\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.923317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.923298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfrb\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-kube-api-access-wcfrb\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.923317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.923313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-token\") pod \"e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") " pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:41.988148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:41.988119    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:42.281714 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.281684    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"]
Sep 06 01:20:42.282634 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:20:42.282600    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7ecf66_8e62_46cc_a8eb_b96f3c743e9a.slice/crio-67846adce062e20096d964c16fc4caa6ad16098822faca70afb6a3fe9e260d4e WatchSource:0}: Error finding container 67846adce062e20096d964c16fc4caa6ad16098822faca70afb6a3fe9e260d4e: Status 404 returned error can't find the container with id 67846adce062e20096d964c16fc4caa6ad16098822faca70afb6a3fe9e260d4e
Sep 06 01:20:42.285029 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.284990    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:20:42.285098 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.285059    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:20:42.285098 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.285086    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:20:42.661011 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.660905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" event={"ID":"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a","Type":"ContainerStarted","Data":"136acf9ac320b894f2421c21441080fd20b68f3dab1c4f0aa3d0bc3844abd74a"}
Sep 06 01:20:42.661231 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.661010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" event={"ID":"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a","Type":"ContainerStarted","Data":"67846adce062e20096d964c16fc4caa6ad16098822faca70afb6a3fe9e260d4e"}
Sep 06 01:20:42.683065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.683023    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podStartSLOduration=1.683007446 podStartE2EDuration="1.683007446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:42.682519196 +0000 UTC m=+695.957904359" watchObservedRunningTime="2026-09-06 01:20:42.683007446 +0000 UTC m=+695.958392608"
Sep 06 01:20:42.987306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.987256    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"]
Sep 06 01:20:42.990801 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.990779    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:42.990963 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.990876    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:42.993200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.993181    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-267e7071\""
Sep 06 01:20:42.993296 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:42.993278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-267e7071-dockercfg-k5rhh\""
Sep 06 01:20:43.002898 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.002877    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"]
Sep 06 01:20:43.123281 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.123244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90228957-0341-47ae-848b-8442817d266e-plugins-config-volume\") pod \"payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") " pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.123457 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.123291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn68n\" (UniqueName: \"kubernetes.io/projected/90228957-0341-47ae-848b-8442817d266e-kube-api-access-nn68n\") pod \"payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") " pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.224457 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.224427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90228957-0341-47ae-848b-8442817d266e-plugins-config-volume\") pod \"payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") " pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.224626 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.224471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn68n\" (UniqueName: \"kubernetes.io/projected/90228957-0341-47ae-848b-8442817d266e-kube-api-access-nn68n\") pod \"payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") " pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.225273 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.225255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90228957-0341-47ae-848b-8442817d266e-plugins-config-volume\") pod \"payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") " pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.232255 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.232228    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn68n\" (UniqueName: \"kubernetes.io/projected/90228957-0341-47ae-848b-8442817d266e-kube-api-access-nn68n\") pod \"payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") " pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.302580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.302502    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:43.587860 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.587835    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"]
Sep 06 01:20:43.589079 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:20:43.589051    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90228957_0341_47ae_848b_8442817d266e.slice/crio-0ea3bbe8e74377c7b729dd41b7cefbb48835a83d5e42d7bac2c28730f9e21b2e WatchSource:0}: Error finding container 0ea3bbe8e74377c7b729dd41b7cefbb48835a83d5e42d7bac2c28730f9e21b2e: Status 404 returned error can't find the container with id 0ea3bbe8e74377c7b729dd41b7cefbb48835a83d5e42d7bac2c28730f9e21b2e
Sep 06 01:20:43.669233 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.669195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm" event={"ID":"90228957-0341-47ae-848b-8442817d266e","Type":"ContainerStarted","Data":"854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9"}
Sep 06 01:20:43.669362 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.669247    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm" event={"ID":"90228957-0341-47ae-848b-8442817d266e","Type":"ContainerStarted","Data":"0ea3bbe8e74377c7b729dd41b7cefbb48835a83d5e42d7bac2c28730f9e21b2e"}
Sep 06 01:20:43.687496 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.687453    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm" podStartSLOduration=1.687438363 podStartE2EDuration="1.687438363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:43.68643733 +0000 UTC m=+696.961822494" watchObservedRunningTime="2026-09-06 01:20:43.687438363 +0000 UTC m=+696.962823527"
Sep 06 01:20:43.993514 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:43.993481    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:44.675907 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:44.675868    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:44.676101 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:44.675923    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:44.676829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:44.676813    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:20:46.951603 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:46.951568    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"]
Sep 06 01:20:46.955302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:46.955281    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:46.958208 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:46.958191    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-20c535\""
Sep 06 01:20:46.958298 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:46.958229    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-20c535-dockercfg-smftl\""
Sep 06 01:20:46.964844 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:46.964816    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"]
Sep 06 01:20:47.060881 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.060836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4s86\" (UniqueName: \"kubernetes.io/projected/54132369-ee0e-4bbe-aee2-939208361783-kube-api-access-v4s86\") pod \"payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") " pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.061091 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.060902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54132369-ee0e-4bbe-aee2-939208361783-plugins-config-volume\") pod \"payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") " pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.162287 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.162252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4s86\" (UniqueName: \"kubernetes.io/projected/54132369-ee0e-4bbe-aee2-939208361783-kube-api-access-v4s86\") pod \"payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") " pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.162450 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.162297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54132369-ee0e-4bbe-aee2-939208361783-plugins-config-volume\") pod \"payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") " pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.163097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.163074    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54132369-ee0e-4bbe-aee2-939208361783-plugins-config-volume\") pod \"payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") " pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.170874 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.170845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4s86\" (UniqueName: \"kubernetes.io/projected/54132369-ee0e-4bbe-aee2-939208361783-kube-api-access-v4s86\") pod \"payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") " pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.267947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.267853    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.536681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.536657    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"]
Sep 06 01:20:47.537807 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:20:47.537775    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54132369_ee0e_4bbe_aee2_939208361783.slice/crio-abc154da7dfeb8d76a19d35f704fe209107fac199021005a800f5fc1012fa713 WatchSource:0}: Error finding container abc154da7dfeb8d76a19d35f704fe209107fac199021005a800f5fc1012fa713: Status 404 returned error can't find the container with id abc154da7dfeb8d76a19d35f704fe209107fac199021005a800f5fc1012fa713
Sep 06 01:20:47.701033 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.700995    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv" event={"ID":"54132369-ee0e-4bbe-aee2-939208361783","Type":"ContainerStarted","Data":"ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e"}
Sep 06 01:20:47.701187 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.701045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv" event={"ID":"54132369-ee0e-4bbe-aee2-939208361783","Type":"ContainerStarted","Data":"abc154da7dfeb8d76a19d35f704fe209107fac199021005a800f5fc1012fa713"}
Sep 06 01:20:47.701187 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.701168    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:20:47.722918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:47.722861    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv" podStartSLOduration=1.7228435389999999 podStartE2EDuration="1.722843539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:47.722103371 +0000 UTC m=+700.997488535" watchObservedRunningTime="2026-09-06 01:20:47.722843539 +0000 UTC m=+700.998228705"
Sep 06 01:20:49.643103 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:49.643076    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:20:49.643510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:49.643229    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:20:55.690305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:55.690276    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:20:58.710659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:20:58.710629    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:21:05.687086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.687017    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"]
Sep 06 01:21:05.689394 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.689374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:05.691771 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.691740    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-4b217a-dockercfg-pkbxj\""
Sep 06 01:21:05.691897 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.691815    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-4b217a\""
Sep 06 01:21:05.705355 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.705329    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"]
Sep 06 01:21:05.739911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.739889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:05.740022 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.739965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2dq\" (UniqueName: \"kubernetes.io/projected/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-kube-api-access-vg2dq\") pod \"payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:05.815651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.815622    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerID="136acf9ac320b894f2421c21441080fd20b68f3dab1c4f0aa3d0bc3844abd74a" exitCode=0
Sep 06 01:21:05.815838 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.815701    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" event={"ID":"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a","Type":"ContainerDied","Data":"136acf9ac320b894f2421c21441080fd20b68f3dab1c4f0aa3d0bc3844abd74a"}
Sep 06 01:21:05.816180 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.816164    2567 scope.go:117] "RemoveContainer" containerID="136acf9ac320b894f2421c21441080fd20b68f3dab1c4f0aa3d0bc3844abd74a"
Sep 06 01:21:05.817336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.817312    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:21:05.817407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.817373    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:21:05.817444 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.817405    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:21:05.840346 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.840323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:05.840465 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.840374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2dq\" (UniqueName: \"kubernetes.io/projected/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-kube-api-access-vg2dq\") pod \"payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:05.841228 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.841202    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:05.853160 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:05.853135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2dq\" (UniqueName: \"kubernetes.io/projected/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-kube-api-access-vg2dq\") pod \"payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:06.000208 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.000114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:06.278417 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.278392    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"]
Sep 06 01:21:06.278417 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:21:06.278406    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f2d5e7_f88f_4b4c_bb03_6fb15b4459a4.slice/crio-3ef018a6cb59a9ff750bd82cdf2ddd1963bf67b269a342529523898c36eb127d WatchSource:0}: Error finding container 3ef018a6cb59a9ff750bd82cdf2ddd1963bf67b269a342529523898c36eb127d: Status 404 returned error can't find the container with id 3ef018a6cb59a9ff750bd82cdf2ddd1963bf67b269a342529523898c36eb127d
Sep 06 01:21:06.823610 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.823573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6" event={"ID":"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4","Type":"ContainerStarted","Data":"f44fadb767c0241fddbb7b83efb89f3fac4d15150b9cba554e60c385a6caf2ee"}
Sep 06 01:21:06.824036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.823638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6" event={"ID":"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4","Type":"ContainerStarted","Data":"3ef018a6cb59a9ff750bd82cdf2ddd1963bf67b269a342529523898c36eb127d"}
Sep 06 01:21:06.824036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.823671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:06.825482 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.825459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" event={"ID":"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a","Type":"ContainerStarted","Data":"22463a9c9778275b06576bbe7ab323c6d620fff0def4de5ab8d7ea6e35f1c3c0"}
Sep 06 01:21:06.842951 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.841544    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6" podStartSLOduration=1.841523833 podStartE2EDuration="1.841523833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:06.839552762 +0000 UTC m=+720.114937927" watchObservedRunningTime="2026-09-06 01:21:06.841523833 +0000 UTC m=+720.116909009"
Sep 06 01:21:06.988645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.988597    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:21:06.988837 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.988807    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 06 01:21:06.988904 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:06.988874    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 06 01:21:07.989171 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:07.989139    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 06 01:21:07.989614 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:07.989197    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 06 01:21:08.988433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:08.988389    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 06 01:21:08.988433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:08.988435    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 06 01:21:09.989218 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:09.989184    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 06 01:21:09.989599 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:09.989235    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 06 01:21:10.989325 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:10.989292    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 06 01:21:10.989704 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:10.989348    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 06 01:21:11.988520 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:11.988476    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 06 01:21:11.988729 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:11.988547    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 06 01:21:12.992227 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:12.992198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:21:12.992589 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:12.992566    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:21:12.993341 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:12.993321    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:21:17.834092 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:17.834062    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:21:23.429753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.429718    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"]
Sep 06 01:21:23.430186 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.429981    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm" podUID="90228957-0341-47ae-848b-8442817d266e" containerName="payload-processing" containerID="cri-o://854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9" gracePeriod=30
Sep 06 01:21:23.690207 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.690129    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:21:23.805115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.805086    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn68n\" (UniqueName: \"kubernetes.io/projected/90228957-0341-47ae-848b-8442817d266e-kube-api-access-nn68n\") pod \"90228957-0341-47ae-848b-8442817d266e\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") "
Sep 06 01:21:23.805267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.805184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90228957-0341-47ae-848b-8442817d266e-plugins-config-volume\") pod \"90228957-0341-47ae-848b-8442817d266e\" (UID: \"90228957-0341-47ae-848b-8442817d266e\") "
Sep 06 01:21:23.805534 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.805500    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90228957-0341-47ae-848b-8442817d266e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90228957-0341-47ae-848b-8442817d266e" (UID: "90228957-0341-47ae-848b-8442817d266e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:21:23.807181 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.807156    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90228957-0341-47ae-848b-8442817d266e-kube-api-access-nn68n" (OuterVolumeSpecName: "kube-api-access-nn68n") pod "90228957-0341-47ae-848b-8442817d266e" (UID: "90228957-0341-47ae-848b-8442817d266e"). InnerVolumeSpecName "kube-api-access-nn68n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:21:23.906535 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.906506    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn68n\" (UniqueName: \"kubernetes.io/projected/90228957-0341-47ae-848b-8442817d266e-kube-api-access-nn68n\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.906535 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.906530    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90228957-0341-47ae-848b-8442817d266e-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.943879 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.943810    2567 generic.go:356] "Generic (PLEG): container finished" podID="90228957-0341-47ae-848b-8442817d266e" containerID="854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9" exitCode=0
Sep 06 01:21:23.943879 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.943855    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"
Sep 06 01:21:23.943879 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.943875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm" event={"ID":"90228957-0341-47ae-848b-8442817d266e","Type":"ContainerDied","Data":"854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9"}
Sep 06 01:21:23.944104 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.943956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm" event={"ID":"90228957-0341-47ae-848b-8442817d266e","Type":"ContainerDied","Data":"0ea3bbe8e74377c7b729dd41b7cefbb48835a83d5e42d7bac2c28730f9e21b2e"}
Sep 06 01:21:23.944104 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.943966    2567 scope.go:117] "RemoveContainer" containerID="854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9"
Sep 06 01:21:23.953538 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.953523    2567 scope.go:117] "RemoveContainer" containerID="854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9"
Sep 06 01:21:23.953810 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:21:23.953793    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9\": container with ID starting with 854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9 not found: ID does not exist" containerID="854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9"
Sep 06 01:21:23.953873 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.953818    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9"} err="failed to get container status \"854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9\": rpc error: code = NotFound desc = could not find container \"854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9\": container with ID starting with 854a1ba94624ca1db2ca650ac6f9c7b407c7f0d2c4c85746cc9aa3df068e1ed9 not found: ID does not exist"
Sep 06 01:21:23.965743 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.965722    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"]
Sep 06 01:21:23.969821 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:23.969801    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-267e7071-cf89f95cc-r6tqm"]
Sep 06 01:21:25.211342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:25.211307    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90228957-0341-47ae-848b-8442817d266e" path="/var/lib/kubelet/pods/90228957-0341-47ae-848b-8442817d266e/volumes"
Sep 06 01:21:28.401872 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.401838    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"]
Sep 06 01:21:28.402272 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.402258    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90228957-0341-47ae-848b-8442817d266e" containerName="payload-processing"
Sep 06 01:21:28.402313 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.402274    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="90228957-0341-47ae-848b-8442817d266e" containerName="payload-processing"
Sep 06 01:21:28.402354 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.402345    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="90228957-0341-47ae-848b-8442817d266e" containerName="payload-processing"
Sep 06 01:21:28.405802 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.405784    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.408299 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.408278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-52c53f94-dockercfg-wwgd5\""
Sep 06 01:21:28.408633 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.408616    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-52c53f94\""
Sep 06 01:21:28.414894 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.414874    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"]
Sep 06 01:21:28.546307 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.546276    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqg57\" (UniqueName: \"kubernetes.io/projected/96cb328c-48dd-48cd-8e06-ec00de649927-kube-api-access-tqg57\") pod \"payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.546307 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.546312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96cb328c-48dd-48cd-8e06-ec00de649927-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.646832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.646802    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqg57\" (UniqueName: \"kubernetes.io/projected/96cb328c-48dd-48cd-8e06-ec00de649927-kube-api-access-tqg57\") pod \"payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.647010 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.646837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96cb328c-48dd-48cd-8e06-ec00de649927-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.647498 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.647480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96cb328c-48dd-48cd-8e06-ec00de649927-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.655003 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.654944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqg57\" (UniqueName: \"kubernetes.io/projected/96cb328c-48dd-48cd-8e06-ec00de649927-kube-api-access-tqg57\") pod \"payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.715973 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.715951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:28.994688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:28.994663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"]
Sep 06 01:21:28.996493 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:21:28.996467    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cb328c_48dd_48cd_8e06_ec00de649927.slice/crio-8e8a93d0a9302d56f922639ffe49ae0dcb517591b9b588020b4950ba470508c7 WatchSource:0}: Error finding container 8e8a93d0a9302d56f922639ffe49ae0dcb517591b9b588020b4950ba470508c7: Status 404 returned error can't find the container with id 8e8a93d0a9302d56f922639ffe49ae0dcb517591b9b588020b4950ba470508c7
Sep 06 01:21:29.978717 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:29.978678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42" event={"ID":"96cb328c-48dd-48cd-8e06-ec00de649927","Type":"ContainerStarted","Data":"715a035ee5072cfe90b713bd6e5aac60ecc6e81589fa48f69b303ac2714175a1"}
Sep 06 01:21:29.979279 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:29.978736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42" event={"ID":"96cb328c-48dd-48cd-8e06-ec00de649927","Type":"ContainerStarted","Data":"8e8a93d0a9302d56f922639ffe49ae0dcb517591b9b588020b4950ba470508c7"}
Sep 06 01:21:29.979279 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:29.978775    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:21:30.000831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:30.000783    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42" podStartSLOduration=2.000771297 podStartE2EDuration="2.000771297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:29.999421628 +0000 UTC m=+743.274806791" watchObservedRunningTime="2026-09-06 01:21:30.000771297 +0000 UTC m=+743.276156461"
Sep 06 01:21:40.986247 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:21:40.986218    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:22:09.012515 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.012480    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"]
Sep 06 01:22:09.013017 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.012760    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42" podUID="96cb328c-48dd-48cd-8e06-ec00de649927" containerName="payload-pre-processing" containerID="cri-o://715a035ee5072cfe90b713bd6e5aac60ecc6e81589fa48f69b303ac2714175a1" gracePeriod=30
Sep 06 01:22:09.195056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.195019    2567 generic.go:356] "Generic (PLEG): container finished" podID="96cb328c-48dd-48cd-8e06-ec00de649927" containerID="715a035ee5072cfe90b713bd6e5aac60ecc6e81589fa48f69b303ac2714175a1" exitCode=0
Sep 06 01:22:09.195202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.195094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42" event={"ID":"96cb328c-48dd-48cd-8e06-ec00de649927","Type":"ContainerDied","Data":"715a035ee5072cfe90b713bd6e5aac60ecc6e81589fa48f69b303ac2714175a1"}
Sep 06 01:22:09.312049 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.310816    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:22:09.410391 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.410356    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96cb328c-48dd-48cd-8e06-ec00de649927-plugins-config-volume\") pod \"96cb328c-48dd-48cd-8e06-ec00de649927\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") "
Sep 06 01:22:09.410562 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.410430    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqg57\" (UniqueName: \"kubernetes.io/projected/96cb328c-48dd-48cd-8e06-ec00de649927-kube-api-access-tqg57\") pod \"96cb328c-48dd-48cd-8e06-ec00de649927\" (UID: \"96cb328c-48dd-48cd-8e06-ec00de649927\") "
Sep 06 01:22:09.410725 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.410701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96cb328c-48dd-48cd-8e06-ec00de649927-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96cb328c-48dd-48cd-8e06-ec00de649927" (UID: "96cb328c-48dd-48cd-8e06-ec00de649927"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:09.412411 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.412387    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cb328c-48dd-48cd-8e06-ec00de649927-kube-api-access-tqg57" (OuterVolumeSpecName: "kube-api-access-tqg57") pod "96cb328c-48dd-48cd-8e06-ec00de649927" (UID: "96cb328c-48dd-48cd-8e06-ec00de649927"). InnerVolumeSpecName "kube-api-access-tqg57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:09.511364 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.511336    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96cb328c-48dd-48cd-8e06-ec00de649927-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:22:09.511364 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:09.511359    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqg57\" (UniqueName: \"kubernetes.io/projected/96cb328c-48dd-48cd-8e06-ec00de649927-kube-api-access-tqg57\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:22:10.201758 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:10.201730    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"
Sep 06 01:22:10.202232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:10.201727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42" event={"ID":"96cb328c-48dd-48cd-8e06-ec00de649927","Type":"ContainerDied","Data":"8e8a93d0a9302d56f922639ffe49ae0dcb517591b9b588020b4950ba470508c7"}
Sep 06 01:22:10.202232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:10.201882    2567 scope.go:117] "RemoveContainer" containerID="715a035ee5072cfe90b713bd6e5aac60ecc6e81589fa48f69b303ac2714175a1"
Sep 06 01:22:10.223071 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:10.223046    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"]
Sep 06 01:22:10.232361 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:10.232337    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-52c53f94-6cccb5f5d6-bpz42"]
Sep 06 01:22:11.209086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:11.209055    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96cb328c-48dd-48cd-8e06-ec00de649927" path="/var/lib/kubelet/pods/96cb328c-48dd-48cd-8e06-ec00de649927/volumes"
Sep 06 01:22:14.486977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.486943    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"]
Sep 06 01:22:14.487399 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.487367    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb328c-48dd-48cd-8e06-ec00de649927" containerName="payload-pre-processing"
Sep 06 01:22:14.487399 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.487379    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb328c-48dd-48cd-8e06-ec00de649927" containerName="payload-pre-processing"
Sep 06 01:22:14.487472 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.487457    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="96cb328c-48dd-48cd-8e06-ec00de649927" containerName="payload-pre-processing"
Sep 06 01:22:14.492041 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.492025    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.494916 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.494895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-62f64172-dockercfg-j5z8m\""
Sep 06 01:22:14.495200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.495184    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-62f64172\""
Sep 06 01:22:14.505422 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.505403    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"]
Sep 06 01:22:14.559667 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.559610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-plugins-config-volume\") pod \"payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") " pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.559917 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.559756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbrq\" (UniqueName: \"kubernetes.io/projected/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-kube-api-access-fjbrq\") pod \"payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") " pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.661010 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.660978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbrq\" (UniqueName: \"kubernetes.io/projected/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-kube-api-access-fjbrq\") pod \"payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") " pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.661175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.661051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-plugins-config-volume\") pod \"payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") " pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.661714 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.661695    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-plugins-config-volume\") pod \"payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") " pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.669374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.669345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbrq\" (UniqueName: \"kubernetes.io/projected/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-kube-api-access-fjbrq\") pod \"payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") " pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:14.802140 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:14.802056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:15.082244 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:15.082208    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"]
Sep 06 01:22:15.082987 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:22:15.082961    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef3ed0d_033d_440a_9eca_c3cb7fed1d70.slice/crio-fa90ddce6fe5181b1039fd49de86509f6269c4d7c675af3eb29c228f6e4b0404 WatchSource:0}: Error finding container fa90ddce6fe5181b1039fd49de86509f6269c4d7c675af3eb29c228f6e4b0404: Status 404 returned error can't find the container with id fa90ddce6fe5181b1039fd49de86509f6269c4d7c675af3eb29c228f6e4b0404
Sep 06 01:22:15.231206 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:15.231162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b" event={"ID":"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70","Type":"ContainerStarted","Data":"9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c"}
Sep 06 01:22:15.231375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:15.231225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b" event={"ID":"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70","Type":"ContainerStarted","Data":"fa90ddce6fe5181b1039fd49de86509f6269c4d7c675af3eb29c228f6e4b0404"}
Sep 06 01:22:15.231375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:15.231273    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:26.240351 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:26.240319    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:26.257910 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:26.257861    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b" podStartSLOduration=12.257847767 podStartE2EDuration="12.257847767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:15.25059169 +0000 UTC m=+788.525976854" watchObservedRunningTime="2026-09-06 01:22:26.257847767 +0000 UTC m=+799.533232931"
Sep 06 01:22:44.284360 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.284329    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"]
Sep 06 01:22:44.284792 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.284567    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b" podUID="6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" containerName="payload-processing" containerID="cri-o://9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c" gracePeriod=30
Sep 06 01:22:44.532847 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.532796    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:44.621896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.621866    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-plugins-config-volume\") pod \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") "
Sep 06 01:22:44.621896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.621898    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjbrq\" (UniqueName: \"kubernetes.io/projected/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-kube-api-access-fjbrq\") pod \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\" (UID: \"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70\") "
Sep 06 01:22:44.622227 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.622204    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" (UID: "6ef3ed0d-033d-440a-9eca-c3cb7fed1d70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:44.624065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.624035    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-kube-api-access-fjbrq" (OuterVolumeSpecName: "kube-api-access-fjbrq") pod "6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" (UID: "6ef3ed0d-033d-440a-9eca-c3cb7fed1d70"). InnerVolumeSpecName "kube-api-access-fjbrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:44.723473 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.723391    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:22:44.723473 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:44.723419    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjbrq\" (UniqueName: \"kubernetes.io/projected/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70-kube-api-access-fjbrq\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:22:45.397611 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.397578    2567 generic.go:356] "Generic (PLEG): container finished" podID="6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" containerID="9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c" exitCode=0
Sep 06 01:22:45.398014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.397623    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"
Sep 06 01:22:45.398014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.397635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b" event={"ID":"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70","Type":"ContainerDied","Data":"9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c"}
Sep 06 01:22:45.398014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.397676    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b" event={"ID":"6ef3ed0d-033d-440a-9eca-c3cb7fed1d70","Type":"ContainerDied","Data":"fa90ddce6fe5181b1039fd49de86509f6269c4d7c675af3eb29c228f6e4b0404"}
Sep 06 01:22:45.398014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.397696    2567 scope.go:117] "RemoveContainer" containerID="9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c"
Sep 06 01:22:45.406442 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.406408    2567 scope.go:117] "RemoveContainer" containerID="9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c"
Sep 06 01:22:45.406712 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:22:45.406688    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c\": container with ID starting with 9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c not found: ID does not exist" containerID="9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c"
Sep 06 01:22:45.406791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.406717    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c"} err="failed to get container status \"9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c\": rpc error: code = NotFound desc = could not find container \"9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c\": container with ID starting with 9a255fd289a49e5601e2d60da7e086c9122860803336a706222f54d9d194679c not found: ID does not exist"
Sep 06 01:22:45.417247 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.417227    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"]
Sep 06 01:22:45.423070 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:45.423051    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-62f64172-747dcf8cc5-5p79b"]
Sep 06 01:22:47.207765 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:22:47.207732    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" path="/var/lib/kubelet/pods/6ef3ed0d-033d-440a-9eca-c3cb7fed1d70/volumes"
Sep 06 01:24:21.177645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.177609    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"]
Sep 06 01:24:21.178132 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.177908    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv" podUID="54132369-ee0e-4bbe-aee2-939208361783" containerName="payload-processing" containerID="cri-o://ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e" gracePeriod=30
Sep 06 01:24:21.444430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.444372    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:24:21.484144 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.484117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54132369-ee0e-4bbe-aee2-939208361783-plugins-config-volume\") pod \"54132369-ee0e-4bbe-aee2-939208361783\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") "
Sep 06 01:24:21.484297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.484185    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4s86\" (UniqueName: \"kubernetes.io/projected/54132369-ee0e-4bbe-aee2-939208361783-kube-api-access-v4s86\") pod \"54132369-ee0e-4bbe-aee2-939208361783\" (UID: \"54132369-ee0e-4bbe-aee2-939208361783\") "
Sep 06 01:24:21.484509 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.484483    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54132369-ee0e-4bbe-aee2-939208361783-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54132369-ee0e-4bbe-aee2-939208361783" (UID: "54132369-ee0e-4bbe-aee2-939208361783"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:21.486369 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.486336    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54132369-ee0e-4bbe-aee2-939208361783-kube-api-access-v4s86" (OuterVolumeSpecName: "kube-api-access-v4s86") pod "54132369-ee0e-4bbe-aee2-939208361783" (UID: "54132369-ee0e-4bbe-aee2-939208361783"). InnerVolumeSpecName "kube-api-access-v4s86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:21.585379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.585352    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4s86\" (UniqueName: \"kubernetes.io/projected/54132369-ee0e-4bbe-aee2-939208361783-kube-api-access-v4s86\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:21.585379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.585374    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54132369-ee0e-4bbe-aee2-939208361783-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:21.928614 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.928581    2567 generic.go:356] "Generic (PLEG): container finished" podID="54132369-ee0e-4bbe-aee2-939208361783" containerID="ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e" exitCode=0
Sep 06 01:24:21.928775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.928627    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"
Sep 06 01:24:21.928775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.928664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv" event={"ID":"54132369-ee0e-4bbe-aee2-939208361783","Type":"ContainerDied","Data":"ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e"}
Sep 06 01:24:21.928775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.928719    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv" event={"ID":"54132369-ee0e-4bbe-aee2-939208361783","Type":"ContainerDied","Data":"abc154da7dfeb8d76a19d35f704fe209107fac199021005a800f5fc1012fa713"}
Sep 06 01:24:21.928775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.928761    2567 scope.go:117] "RemoveContainer" containerID="ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e"
Sep 06 01:24:21.938096 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.938079    2567 scope.go:117] "RemoveContainer" containerID="ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e"
Sep 06 01:24:21.938337 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:24:21.938311    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e\": container with ID starting with ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e not found: ID does not exist" containerID="ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e"
Sep 06 01:24:21.938396 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.938349    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e"} err="failed to get container status \"ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e\": rpc error: code = NotFound desc = could not find container \"ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e\": container with ID starting with ba3ea69dce7d638f38563ce394432232654fb894bc7aaf79f9b383542ef0663e not found: ID does not exist"
Sep 06 01:24:21.951971 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.951911    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"]
Sep 06 01:24:21.956129 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:21.956109    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-20c535-6bd86cf8fc-trxgv"]
Sep 06 01:24:23.208165 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:23.208130    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54132369-ee0e-4bbe-aee2-939208361783" path="/var/lib/kubelet/pods/54132369-ee0e-4bbe-aee2-939208361783/volumes"
Sep 06 01:24:27.880178 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:27.880137    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"]
Sep 06 01:24:27.880635 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:27.880397    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" containerID="cri-o://22463a9c9778275b06576bbe7ab323c6d620fff0def4de5ab8d7ea6e35f1c3c0" gracePeriod=30
Sep 06 01:24:27.995672 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:27.995638    2567 patch_prober.go:28] interesting pod/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:24:27.995860 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:27.995702    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:24:33.010334 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.010300    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerID="22463a9c9778275b06576bbe7ab323c6d620fff0def4de5ab8d7ea6e35f1c3c0" exitCode=0
Sep 06 01:24:33.010722 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.010360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" event={"ID":"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a","Type":"ContainerDied","Data":"22463a9c9778275b06576bbe7ab323c6d620fff0def4de5ab8d7ea6e35f1c3c0"}
Sep 06 01:24:33.010722 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.010435    2567 scope.go:117] "RemoveContainer" containerID="136acf9ac320b894f2421c21441080fd20b68f3dab1c4f0aa3d0bc3844abd74a"
Sep 06 01:24:33.123225 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.123199    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:24:33.189638 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189607    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-certs\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.189810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189659    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-envoy\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.189810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istiod-ca-cert\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.189810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189751    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-podinfo\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.189810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189775    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-token\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.189810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-credential-socket\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.190170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189814    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcfrb\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-kube-api-access-wcfrb\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.190170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189854    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-socket\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.190170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189886    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-data\") pod \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\" (UID: \"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a\") "
Sep 06 01:24:33.190170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.189917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:33.190170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190132    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:33.190170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190164    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:33.190413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190173    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:33.190413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190234    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.190413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190252    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.190413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190265    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.190413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.190368    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:33.191899 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.191869    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:33.192100 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.192081    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:24:33.192368 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.192349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:33.192409 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.192345    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-kube-api-access-wcfrb" (OuterVolumeSpecName: "kube-api-access-wcfrb") pod "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" (UID: "3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a"). InnerVolumeSpecName "kube-api-access-wcfrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:33.291478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.291446    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.291478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.291478    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.291686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.291491    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcfrb\" (UniqueName: \"kubernetes.io/projected/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-kube-api-access-wcfrb\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.291686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.291504    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.291686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.291516    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.291686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.291527    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:33.891322 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891292    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"]
Sep 06 01:24:33.891666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891654    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" containerName="payload-processing"
Sep 06 01:24:33.891723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891668    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" containerName="payload-processing"
Sep 06 01:24:33.891723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891680    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy"
Sep 06 01:24:33.891723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891685    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy"
Sep 06 01:24:33.891723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891697    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54132369-ee0e-4bbe-aee2-939208361783" containerName="payload-processing"
Sep 06 01:24:33.891723 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891703    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="54132369-ee0e-4bbe-aee2-939208361783" containerName="payload-processing"
Sep 06 01:24:33.891883 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891776    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy"
Sep 06 01:24:33.891883 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891786    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy"
Sep 06 01:24:33.891883 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891792    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef3ed0d-033d-440a-9eca-c3cb7fed1d70" containerName="payload-processing"
Sep 06 01:24:33.891883 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.891801    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="54132369-ee0e-4bbe-aee2-939208361783" containerName="payload-processing"
Sep 06 01:24:33.895214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.895190    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:33.898523 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.898502    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-109eb6-dockercfg-wng2z\""
Sep 06 01:24:33.898842 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.898827    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-109eb6\""
Sep 06 01:24:33.904567 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.904539    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"]
Sep 06 01:24:33.997044 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.997014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:33.997044 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:33.997052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54lbf\" (UniqueName: \"kubernetes.io/projected/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-kube-api-access-54lbf\") pod \"payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:34.017192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.017168    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"
Sep 06 01:24:34.017634 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.017211    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf" event={"ID":"3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a","Type":"ContainerDied","Data":"67846adce062e20096d964c16fc4caa6ad16098822faca70afb6a3fe9e260d4e"}
Sep 06 01:24:34.017634 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.017269    2567 scope.go:117] "RemoveContainer" containerID="22463a9c9778275b06576bbe7ab323c6d620fff0def4de5ab8d7ea6e35f1c3c0"
Sep 06 01:24:34.034602 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.034580    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"]
Sep 06 01:24:34.040776 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.040750    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-20c535-openshift-default-76ff884cdb-qxdtf"]
Sep 06 01:24:34.098175 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.098150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:34.098272 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.098180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lbf\" (UniqueName: \"kubernetes.io/projected/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-kube-api-access-54lbf\") pod \"payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:34.098849 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.098830    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:34.106279 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.106256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54lbf\" (UniqueName: \"kubernetes.io/projected/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-kube-api-access-54lbf\") pod \"payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:34.205783 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.205760    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:34.479741 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:34.479712    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"]
Sep 06 01:24:34.480578 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:24:34.480551    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96feec36_d18f_48ab_a09e_14c6b1c4c8e2.slice/crio-c0d13a0307fa8adf075a816afa4a9b533ef515ef202ffbe0f74c1d799b5d1845 WatchSource:0}: Error finding container c0d13a0307fa8adf075a816afa4a9b533ef515ef202ffbe0f74c1d799b5d1845: Status 404 returned error can't find the container with id c0d13a0307fa8adf075a816afa4a9b533ef515ef202ffbe0f74c1d799b5d1845
Sep 06 01:24:35.027575 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:35.027533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz" event={"ID":"96feec36-d18f-48ab-a09e-14c6b1c4c8e2","Type":"ContainerStarted","Data":"f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c"}
Sep 06 01:24:35.028032 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:35.027602    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:35.028032 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:35.027628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz" event={"ID":"96feec36-d18f-48ab-a09e-14c6b1c4c8e2","Type":"ContainerStarted","Data":"c0d13a0307fa8adf075a816afa4a9b533ef515ef202ffbe0f74c1d799b5d1845"}
Sep 06 01:24:35.044485 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:35.044439    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz" podStartSLOduration=2.044424216 podStartE2EDuration="2.044424216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:35.042780048 +0000 UTC m=+928.318165214" watchObservedRunningTime="2026-09-06 01:24:35.044424216 +0000 UTC m=+928.319809380"
Sep 06 01:24:35.207823 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:35.207792    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" path="/var/lib/kubelet/pods/3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a/volumes"
Sep 06 01:24:46.036278 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:46.036248    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:24:47.338752 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.338702    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"]
Sep 06 01:24:47.339215 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.338992    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g" podUID="af29f904-bb06-4208-b73e-a0dc5eae764a" containerName="payload-processing" containerID="cri-o://5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21" gracePeriod=30
Sep 06 01:24:47.345977 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.345951    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"]
Sep 06 01:24:47.346190 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.346163    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t" podUID="8dc7770e-9043-41c2-83f1-15be399e69bf" containerName="payload-pre-processing" containerID="cri-o://4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e" gracePeriod=30
Sep 06 01:24:47.411757 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:24:47.411724    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc7770e_9043_41c2_83f1_15be399e69bf.slice/crio-conmon-4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf29f904_bb06_4208_b73e_a0dc5eae764a.slice/crio-conmon-5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21.scope\": RecentStats: unable to find data in memory cache]"
Sep 06 01:24:47.618645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.618621    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:24:47.621382 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.621365    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:24:47.713423 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.713394    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-826n4\" (UniqueName: \"kubernetes.io/projected/af29f904-bb06-4208-b73e-a0dc5eae764a-kube-api-access-826n4\") pod \"af29f904-bb06-4208-b73e-a0dc5eae764a\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") "
Sep 06 01:24:47.713579 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.713441    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af29f904-bb06-4208-b73e-a0dc5eae764a-plugins-config-volume\") pod \"af29f904-bb06-4208-b73e-a0dc5eae764a\" (UID: \"af29f904-bb06-4208-b73e-a0dc5eae764a\") "
Sep 06 01:24:47.713579 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.713465    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc7770e-9043-41c2-83f1-15be399e69bf-plugins-config-volume\") pod \"8dc7770e-9043-41c2-83f1-15be399e69bf\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") "
Sep 06 01:24:47.713579 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.713499    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7pbf\" (UniqueName: \"kubernetes.io/projected/8dc7770e-9043-41c2-83f1-15be399e69bf-kube-api-access-k7pbf\") pod \"8dc7770e-9043-41c2-83f1-15be399e69bf\" (UID: \"8dc7770e-9043-41c2-83f1-15be399e69bf\") "
Sep 06 01:24:47.713801 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.713778    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af29f904-bb06-4208-b73e-a0dc5eae764a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af29f904-bb06-4208-b73e-a0dc5eae764a" (UID: "af29f904-bb06-4208-b73e-a0dc5eae764a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:47.713911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.713889    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc7770e-9043-41c2-83f1-15be399e69bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8dc7770e-9043-41c2-83f1-15be399e69bf" (UID: "8dc7770e-9043-41c2-83f1-15be399e69bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:47.715510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.715478    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af29f904-bb06-4208-b73e-a0dc5eae764a-kube-api-access-826n4" (OuterVolumeSpecName: "kube-api-access-826n4") pod "af29f904-bb06-4208-b73e-a0dc5eae764a" (UID: "af29f904-bb06-4208-b73e-a0dc5eae764a"). InnerVolumeSpecName "kube-api-access-826n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:47.715603 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.715524    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc7770e-9043-41c2-83f1-15be399e69bf-kube-api-access-k7pbf" (OuterVolumeSpecName: "kube-api-access-k7pbf") pod "8dc7770e-9043-41c2-83f1-15be399e69bf" (UID: "8dc7770e-9043-41c2-83f1-15be399e69bf"). InnerVolumeSpecName "kube-api-access-k7pbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:47.814482 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.814443    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-826n4\" (UniqueName: \"kubernetes.io/projected/af29f904-bb06-4208-b73e-a0dc5eae764a-kube-api-access-826n4\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:47.814482 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.814489    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af29f904-bb06-4208-b73e-a0dc5eae764a-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:47.814648 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.814500    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc7770e-9043-41c2-83f1-15be399e69bf-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:47.814648 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:47.814509    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7pbf\" (UniqueName: \"kubernetes.io/projected/8dc7770e-9043-41c2-83f1-15be399e69bf-kube-api-access-k7pbf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:24:48.101504 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.101471    2567 generic.go:356] "Generic (PLEG): container finished" podID="8dc7770e-9043-41c2-83f1-15be399e69bf" containerID="4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e" exitCode=0
Sep 06 01:24:48.101686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.101530    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"
Sep 06 01:24:48.101686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.101551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t" event={"ID":"8dc7770e-9043-41c2-83f1-15be399e69bf","Type":"ContainerDied","Data":"4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e"}
Sep 06 01:24:48.101686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.101624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t" event={"ID":"8dc7770e-9043-41c2-83f1-15be399e69bf","Type":"ContainerDied","Data":"43ae651fa4fc99539b33125749d667aaf18629c902902ca2910cb7cb25b06852"}
Sep 06 01:24:48.101686 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.101647    2567 scope.go:117] "RemoveContainer" containerID="4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e"
Sep 06 01:24:48.103016 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.102995    2567 generic.go:356] "Generic (PLEG): container finished" podID="af29f904-bb06-4208-b73e-a0dc5eae764a" containerID="5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21" exitCode=0
Sep 06 01:24:48.103141 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.103040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g" event={"ID":"af29f904-bb06-4208-b73e-a0dc5eae764a","Type":"ContainerDied","Data":"5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21"}
Sep 06 01:24:48.103141 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.103053    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"
Sep 06 01:24:48.103141 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.103086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g" event={"ID":"af29f904-bb06-4208-b73e-a0dc5eae764a","Type":"ContainerDied","Data":"22643646109de269c67d12d2fd4db297a60a321d23917dd2d57b1bc062cfa19f"}
Sep 06 01:24:48.111434 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.111410    2567 scope.go:117] "RemoveContainer" containerID="4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e"
Sep 06 01:24:48.111654 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:24:48.111636    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e\": container with ID starting with 4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e not found: ID does not exist" containerID="4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e"
Sep 06 01:24:48.111720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.111660    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e"} err="failed to get container status \"4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e\": rpc error: code = NotFound desc = could not find container \"4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e\": container with ID starting with 4bb1ce20486c50902246ca63974b8359bcf05c3dc119a4446764518908bcd96e not found: ID does not exist"
Sep 06 01:24:48.111720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.111681    2567 scope.go:117] "RemoveContainer" containerID="5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21"
Sep 06 01:24:48.119674 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.119656    2567 scope.go:117] "RemoveContainer" containerID="5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21"
Sep 06 01:24:48.119984 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:24:48.119964    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21\": container with ID starting with 5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21 not found: ID does not exist" containerID="5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21"
Sep 06 01:24:48.120069 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.119989    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21"} err="failed to get container status \"5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21\": rpc error: code = NotFound desc = could not find container \"5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21\": container with ID starting with 5828545d3405be2337b3bcbc2ba2d63065e5fb4d6413ca176afd3cf0d4f20c21 not found: ID does not exist"
Sep 06 01:24:48.126695 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.126674    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"]
Sep 06 01:24:48.130444 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.130423    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b63fa0-79c68f659d-6774t"]
Sep 06 01:24:48.142922 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.142903    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"]
Sep 06 01:24:48.148757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:48.148736    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b63fa0-7f8f98d7b5-thm8g"]
Sep 06 01:24:49.208733 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:49.208686    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dc7770e-9043-41c2-83f1-15be399e69bf" path="/var/lib/kubelet/pods/8dc7770e-9043-41c2-83f1-15be399e69bf/volumes"
Sep 06 01:24:49.209295 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:49.209272    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af29f904-bb06-4208-b73e-a0dc5eae764a" path="/var/lib/kubelet/pods/af29f904-bb06-4208-b73e-a0dc5eae764a/volumes"
Sep 06 01:24:54.307159 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307118    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"]
Sep 06 01:24:54.307680 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307660    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy"
Sep 06 01:24:54.307793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307684    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7ecf66-8e62-46cc-a8eb-b96f3c743e9a" containerName="istio-proxy"
Sep 06 01:24:54.307793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307704    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc7770e-9043-41c2-83f1-15be399e69bf" containerName="payload-pre-processing"
Sep 06 01:24:54.307793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307719    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc7770e-9043-41c2-83f1-15be399e69bf" containerName="payload-pre-processing"
Sep 06 01:24:54.307793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307770    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af29f904-bb06-4208-b73e-a0dc5eae764a" containerName="payload-processing"
Sep 06 01:24:54.307793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307778    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="af29f904-bb06-4208-b73e-a0dc5eae764a" containerName="payload-processing"
Sep 06 01:24:54.308070 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307867    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="af29f904-bb06-4208-b73e-a0dc5eae764a" containerName="payload-processing"
Sep 06 01:24:54.308070 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.307881    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc7770e-9043-41c2-83f1-15be399e69bf" containerName="payload-pre-processing"
Sep 06 01:24:54.312149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.312127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:24:54.315837 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.315816    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:24:54.316148 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.315913    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:24:54.319087 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.319068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"]
Sep 06 01:24:54.475288 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.475237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3da0c09-bdb4-4e60-8003-c601822daf95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l\" (UID: \"b3da0c09-bdb4-4e60-8003-c601822daf95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:24:54.576658 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.576580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3da0c09-bdb4-4e60-8003-c601822daf95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l\" (UID: \"b3da0c09-bdb4-4e60-8003-c601822daf95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:24:54.577230 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.577206    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3da0c09-bdb4-4e60-8003-c601822daf95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l\" (UID: \"b3da0c09-bdb4-4e60-8003-c601822daf95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:24:54.623670 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.623647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:24:54.893239 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.893215    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"]
Sep 06 01:24:54.894963 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:24:54.894923    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3da0c09_bdb4_4e60_8003_c601822daf95.slice/crio-63e16e85d224d05c21b7db08d5f55967ac19e98d2272bba6a8d789189da3306c WatchSource:0}: Error finding container 63e16e85d224d05c21b7db08d5f55967ac19e98d2272bba6a8d789189da3306c: Status 404 returned error can't find the container with id 63e16e85d224d05c21b7db08d5f55967ac19e98d2272bba6a8d789189da3306c
Sep 06 01:24:54.897334 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:54.897315    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:24:55.155060 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:55.154982    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l" event={"ID":"b3da0c09-bdb4-4e60-8003-c601822daf95","Type":"ContainerStarted","Data":"63e16e85d224d05c21b7db08d5f55967ac19e98d2272bba6a8d789189da3306c"}
Sep 06 01:24:58.179980 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:58.179921    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l" event={"ID":"b3da0c09-bdb4-4e60-8003-c601822daf95","Type":"ContainerStarted","Data":"ae1ca0a9c22972354a8faf3fd4d2b3504327b2bd5d927c05b441166d5e500931"}
Sep 06 01:24:58.197829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:58.197784    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l" podStartSLOduration=1.54116193 podStartE2EDuration="4.197771202s" totalImagesPullingTime="2.656609272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:58.196909304 +0000 UTC m=+951.472294470" watchObservedRunningTime="2026-09-06 01:24:58.197771202 +0000 UTC m=+951.473156377"
Sep 06 01:24:59.187580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:59.187546    2567 generic.go:356] "Generic (PLEG): container finished" podID="b3da0c09-bdb4-4e60-8003-c601822daf95" containerID="ae1ca0a9c22972354a8faf3fd4d2b3504327b2bd5d927c05b441166d5e500931" exitCode=0
Sep 06 01:24:59.188033 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:24:59.187627    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l" event={"ID":"b3da0c09-bdb4-4e60-8003-c601822daf95","Type":"ContainerDied","Data":"ae1ca0a9c22972354a8faf3fd4d2b3504327b2bd5d927c05b441166d5e500931"}
Sep 06 01:25:00.330443 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:00.330420    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:25:00.430018 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:00.429990    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3da0c09-bdb4-4e60-8003-c601822daf95-maas-api-service-ca\") pod \"b3da0c09-bdb4-4e60-8003-c601822daf95\" (UID: \"b3da0c09-bdb4-4e60-8003-c601822daf95\") "
Sep 06 01:25:00.430353 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:00.430333    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3da0c09-bdb4-4e60-8003-c601822daf95-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3da0c09-bdb4-4e60-8003-c601822daf95" (UID: "b3da0c09-bdb4-4e60-8003-c601822daf95"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:00.531278 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:00.531217    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3da0c09-bdb4-4e60-8003-c601822daf95-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:01.199307 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:01.199263    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"
Sep 06 01:25:01.199474 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:01.199321    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l" event={"ID":"b3da0c09-bdb4-4e60-8003-c601822daf95","Type":"ContainerDied","Data":"63e16e85d224d05c21b7db08d5f55967ac19e98d2272bba6a8d789189da3306c"}
Sep 06 01:25:01.199474 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:01.199369    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63e16e85d224d05c21b7db08d5f55967ac19e98d2272bba6a8d789189da3306c"
Sep 06 01:25:02.071956 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.071908    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"]
Sep 06 01:25:02.072331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.072282    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3da0c09-bdb4-4e60-8003-c601822daf95" containerName="revoke-keys"
Sep 06 01:25:02.072331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.072293    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3da0c09-bdb4-4e60-8003-c601822daf95" containerName="revoke-keys"
Sep 06 01:25:02.072409 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.072362    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3da0c09-bdb4-4e60-8003-c601822daf95" containerName="revoke-keys"
Sep 06 01:25:02.075502 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.075486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.079179 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.079158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f2686adc-dockercfg-whmpn\""
Sep 06 01:25:02.079476 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.079461    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f2686adc\""
Sep 06 01:25:02.093902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.093877    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"]
Sep 06 01:25:02.104917 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.104891    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"]
Sep 06 01:25:02.109138 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.109118    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.116856 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.116832    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"]
Sep 06 01:25:02.145131 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.145094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d40615-a658-4125-b834-3ae4c7d7bf47-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.145305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.145158    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtk4\" (UniqueName: \"kubernetes.io/projected/a8d40615-a658-4125-b834-3ae4c7d7bf47-kube-api-access-9dtk4\") pod \"payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.145305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.145222    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzdj\" (UniqueName: \"kubernetes.io/projected/48759637-543c-4c34-9a7c-071342b88127-kube-api-access-pmzdj\") pod \"payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") " pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.145305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.145271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48759637-543c-4c34-9a7c-071342b88127-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") " pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.246064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.246023    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48759637-543c-4c34-9a7c-071342b88127-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") " pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.246267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.246082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d40615-a658-4125-b834-3ae4c7d7bf47-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.246267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.246123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtk4\" (UniqueName: \"kubernetes.io/projected/a8d40615-a658-4125-b834-3ae4c7d7bf47-kube-api-access-9dtk4\") pod \"payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.246267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.246159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzdj\" (UniqueName: \"kubernetes.io/projected/48759637-543c-4c34-9a7c-071342b88127-kube-api-access-pmzdj\") pod \"payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") " pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.246829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.246806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d40615-a658-4125-b834-3ae4c7d7bf47-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.246880 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.246810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48759637-543c-4c34-9a7c-071342b88127-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") " pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.254127 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.254096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtk4\" (UniqueName: \"kubernetes.io/projected/a8d40615-a658-4125-b834-3ae4c7d7bf47-kube-api-access-9dtk4\") pod \"payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.254127 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.254099    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzdj\" (UniqueName: \"kubernetes.io/projected/48759637-543c-4c34-9a7c-071342b88127-kube-api-access-pmzdj\") pod \"payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") " pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.385568 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.385480    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:02.420286 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.420250    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:02.659024 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.658999    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"]
Sep 06 01:25:02.659991 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:25:02.659963    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d40615_a658_4125_b834_3ae4c7d7bf47.slice/crio-0e52293301ad75869404f2d63a727ddb8d8785d5365d2d57236fc885f32d9587 WatchSource:0}: Error finding container 0e52293301ad75869404f2d63a727ddb8d8785d5365d2d57236fc885f32d9587: Status 404 returned error can't find the container with id 0e52293301ad75869404f2d63a727ddb8d8785d5365d2d57236fc885f32d9587
Sep 06 01:25:02.705557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:02.705523    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"]
Sep 06 01:25:02.710571 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:25:02.710547    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48759637_543c_4c34_9a7c_071342b88127.slice/crio-287af50ab3fdda8d0024b673bba9672caebd3c47c5752aa81e97a801332eb435 WatchSource:0}: Error finding container 287af50ab3fdda8d0024b673bba9672caebd3c47c5752aa81e97a801332eb435: Status 404 returned error can't find the container with id 287af50ab3fdda8d0024b673bba9672caebd3c47c5752aa81e97a801332eb435
Sep 06 01:25:03.212495 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.212455    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr" event={"ID":"48759637-543c-4c34-9a7c-071342b88127","Type":"ContainerStarted","Data":"c65d3fc2889cc1acd471a18f5afc33c0d24372d56194fcba82827cc95be313b3"}
Sep 06 01:25:03.212992 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.212519    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr" event={"ID":"48759637-543c-4c34-9a7c-071342b88127","Type":"ContainerStarted","Data":"287af50ab3fdda8d0024b673bba9672caebd3c47c5752aa81e97a801332eb435"}
Sep 06 01:25:03.212992 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.212550    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:03.214124 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.214100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7" event={"ID":"a8d40615-a658-4125-b834-3ae4c7d7bf47","Type":"ContainerStarted","Data":"e1330ff5541f5890464a0acb01f3840c295168916abe66510a51e9262a1146dc"}
Sep 06 01:25:03.214227 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.214141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7" event={"ID":"a8d40615-a658-4125-b834-3ae4c7d7bf47","Type":"ContainerStarted","Data":"0e52293301ad75869404f2d63a727ddb8d8785d5365d2d57236fc885f32d9587"}
Sep 06 01:25:03.214227 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.214163    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:03.235026 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.234973    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr" podStartSLOduration=1.234956517 podStartE2EDuration="1.234956517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:03.233751519 +0000 UTC m=+956.509136685" watchObservedRunningTime="2026-09-06 01:25:03.234956517 +0000 UTC m=+956.510341680"
Sep 06 01:25:03.254304 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:03.254239    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7" podStartSLOduration=1.254219209 podStartE2EDuration="1.254219209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:03.250570869 +0000 UTC m=+956.525956028" watchObservedRunningTime="2026-09-06 01:25:03.254219209 +0000 UTC m=+956.529604387"
Sep 06 01:25:05.088088 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.088053    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"]
Sep 06 01:25:05.088510 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.088297    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6" podUID="28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" containerName="payload-processing" containerID="cri-o://f44fadb767c0241fddbb7b83efb89f3fac4d15150b9cba554e60c385a6caf2ee" gracePeriod=30
Sep 06 01:25:05.233688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.233647    2567 generic.go:356] "Generic (PLEG): container finished" podID="28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" containerID="f44fadb767c0241fddbb7b83efb89f3fac4d15150b9cba554e60c385a6caf2ee" exitCode=0
Sep 06 01:25:05.233869 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.233719    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6" event={"ID":"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4","Type":"ContainerDied","Data":"f44fadb767c0241fddbb7b83efb89f3fac4d15150b9cba554e60c385a6caf2ee"}
Sep 06 01:25:05.266460 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.266429    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"]
Sep 06 01:25:05.270208 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.270186    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b217a-dgp6l"]
Sep 06 01:25:05.358262 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.358235    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:25:05.475327 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.475290    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg2dq\" (UniqueName: \"kubernetes.io/projected/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-kube-api-access-vg2dq\") pod \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") "
Sep 06 01:25:05.475499 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.475349    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-plugins-config-volume\") pod \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\" (UID: \"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4\") "
Sep 06 01:25:05.475728 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.475699    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" (UID: "28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:05.477415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.477395    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-kube-api-access-vg2dq" (OuterVolumeSpecName: "kube-api-access-vg2dq") pod "28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" (UID: "28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4"). InnerVolumeSpecName "kube-api-access-vg2dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:05.576143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.576112    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:05.576143 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:05.576137    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg2dq\" (UniqueName: \"kubernetes.io/projected/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4-kube-api-access-vg2dq\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:06.240799 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:06.240758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6" event={"ID":"28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4","Type":"ContainerDied","Data":"3ef018a6cb59a9ff750bd82cdf2ddd1963bf67b269a342529523898c36eb127d"}
Sep 06 01:25:06.241239 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:06.240821    2567 scope.go:117] "RemoveContainer" containerID="f44fadb767c0241fddbb7b83efb89f3fac4d15150b9cba554e60c385a6caf2ee"
Sep 06 01:25:06.241239 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:06.240766    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"
Sep 06 01:25:06.263097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:06.263071    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"]
Sep 06 01:25:06.268603 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:06.268582    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4b217a-6599df97cc-n72f6"]
Sep 06 01:25:07.212711 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:07.212679    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" path="/var/lib/kubelet/pods/28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4/volumes"
Sep 06 01:25:07.213071 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:07.213057    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3da0c09-bdb4-4e60-8003-c601822daf95" path="/var/lib/kubelet/pods/b3da0c09-bdb4-4e60-8003-c601822daf95/volumes"
Sep 06 01:25:14.224015 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:14.223973    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:14.224372 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:14.224057    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:17.345618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.345576    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"]
Sep 06 01:25:17.346079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.345974    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" containerName="payload-processing"
Sep 06 01:25:17.346079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.345986    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" containerName="payload-processing"
Sep 06 01:25:17.346079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.346061    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="28f2d5e7-f88f-4b4c-bb03-6fb15b4459a4" containerName="payload-processing"
Sep 06 01:25:17.352504 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.352485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.354997 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.354972    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-5833d5\""
Sep 06 01:25:17.355118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.355021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-5833d5-dockercfg-vqmnf\""
Sep 06 01:25:17.362054 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.362028    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"]
Sep 06 01:25:17.392406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.392381    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"]
Sep 06 01:25:17.395859 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.395843    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.406802 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.406780    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"]
Sep 06 01:25:17.478759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.478725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.478972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.478812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vs8k\" (UniqueName: \"kubernetes.io/projected/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-kube-api-access-8vs8k\") pod \"payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.478972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.478878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252c89bc-4ba8-4cbd-a420-5d0c441694a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.478972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.478910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcrs\" (UniqueName: \"kubernetes.io/projected/252c89bc-4ba8-4cbd-a420-5d0c441694a6-kube-api-access-ztcrs\") pod \"payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.580423 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.580387    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.580581 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.580438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vs8k\" (UniqueName: \"kubernetes.io/projected/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-kube-api-access-8vs8k\") pod \"payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.580581 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.580481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252c89bc-4ba8-4cbd-a420-5d0c441694a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.580581 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.580509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcrs\" (UniqueName: \"kubernetes.io/projected/252c89bc-4ba8-4cbd-a420-5d0c441694a6-kube-api-access-ztcrs\") pod \"payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.581343 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.581319    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.581401 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.581326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252c89bc-4ba8-4cbd-a420-5d0c441694a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.588501 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.588473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcrs\" (UniqueName: \"kubernetes.io/projected/252c89bc-4ba8-4cbd-a420-5d0c441694a6-kube-api-access-ztcrs\") pod \"payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.588663 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.588645    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vs8k\" (UniqueName: \"kubernetes.io/projected/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-kube-api-access-8vs8k\") pod \"payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.664581 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.664522    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:17.707051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.707024    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:17.940726 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.940696    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"]
Sep 06 01:25:17.941585 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:25:17.941560    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b1543b_0c19_4a59_8668_8b1e19bb6d3d.slice/crio-9c9e4ee45ddbeff11fa5b19d111dd69d70bef03e8d9a5a65053b42dd3a9e1eac WatchSource:0}: Error finding container 9c9e4ee45ddbeff11fa5b19d111dd69d70bef03e8d9a5a65053b42dd3a9e1eac: Status 404 returned error can't find the container with id 9c9e4ee45ddbeff11fa5b19d111dd69d70bef03e8d9a5a65053b42dd3a9e1eac
Sep 06 01:25:17.989445 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:17.989421    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"]
Sep 06 01:25:17.997014 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:25:17.996991    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252c89bc_4ba8_4cbd_a420_5d0c441694a6.slice/crio-7e5b5771add00a88491cfb42b394b662f3e46427815ad85aa1f3762fe6d7f992 WatchSource:0}: Error finding container 7e5b5771add00a88491cfb42b394b662f3e46427815ad85aa1f3762fe6d7f992: Status 404 returned error can't find the container with id 7e5b5771add00a88491cfb42b394b662f3e46427815ad85aa1f3762fe6d7f992
Sep 06 01:25:18.306996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.306892    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr" event={"ID":"252c89bc-4ba8-4cbd-a420-5d0c441694a6","Type":"ContainerStarted","Data":"c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5"}
Sep 06 01:25:18.306996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.306970    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:18.306996 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.306994    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr" event={"ID":"252c89bc-4ba8-4cbd-a420-5d0c441694a6","Type":"ContainerStarted","Data":"7e5b5771add00a88491cfb42b394b662f3e46427815ad85aa1f3762fe6d7f992"}
Sep 06 01:25:18.308598 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.308566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k" event={"ID":"72b1543b-0c19-4a59-8668-8b1e19bb6d3d","Type":"ContainerStarted","Data":"11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f"}
Sep 06 01:25:18.308738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.308616    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:18.308738 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.308632    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k" event={"ID":"72b1543b-0c19-4a59-8668-8b1e19bb6d3d","Type":"ContainerStarted","Data":"9c9e4ee45ddbeff11fa5b19d111dd69d70bef03e8d9a5a65053b42dd3a9e1eac"}
Sep 06 01:25:18.326211 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.326163    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr" podStartSLOduration=1.326145379 podStartE2EDuration="1.326145379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:18.3235713 +0000 UTC m=+971.598956488" watchObservedRunningTime="2026-09-06 01:25:18.326145379 +0000 UTC m=+971.601530547"
Sep 06 01:25:18.343554 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:18.343513    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k" podStartSLOduration=1.343500588 podStartE2EDuration="1.343500588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:18.341128417 +0000 UTC m=+971.616513582" watchObservedRunningTime="2026-09-06 01:25:18.343500588 +0000 UTC m=+971.618885749"
Sep 06 01:25:26.617406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.617372    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"]
Sep 06 01:25:26.617898 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.617674    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz" podUID="96feec36-d18f-48ab-a09e-14c6b1c4c8e2" containerName="payload-pre-processing" containerID="cri-o://f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c" gracePeriod=30
Sep 06 01:25:26.882246 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.882186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:25:26.963924 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.963896    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-plugins-config-volume\") pod \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") "
Sep 06 01:25:26.964095 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.963975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54lbf\" (UniqueName: \"kubernetes.io/projected/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-kube-api-access-54lbf\") pod \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\" (UID: \"96feec36-d18f-48ab-a09e-14c6b1c4c8e2\") "
Sep 06 01:25:26.964302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.964279    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96feec36-d18f-48ab-a09e-14c6b1c4c8e2" (UID: "96feec36-d18f-48ab-a09e-14c6b1c4c8e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:26.966008 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:26.965972    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-kube-api-access-54lbf" (OuterVolumeSpecName: "kube-api-access-54lbf") pod "96feec36-d18f-48ab-a09e-14c6b1c4c8e2" (UID: "96feec36-d18f-48ab-a09e-14c6b1c4c8e2"). InnerVolumeSpecName "kube-api-access-54lbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:27.064623 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.064597    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:27.064623 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.064619    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54lbf\" (UniqueName: \"kubernetes.io/projected/96feec36-d18f-48ab-a09e-14c6b1c4c8e2-kube-api-access-54lbf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:27.356301 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.356268    2567 generic.go:356] "Generic (PLEG): container finished" podID="96feec36-d18f-48ab-a09e-14c6b1c4c8e2" containerID="f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c" exitCode=0
Sep 06 01:25:27.356462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.356312    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"
Sep 06 01:25:27.356462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.356349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz" event={"ID":"96feec36-d18f-48ab-a09e-14c6b1c4c8e2","Type":"ContainerDied","Data":"f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c"}
Sep 06 01:25:27.356462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.356404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz" event={"ID":"96feec36-d18f-48ab-a09e-14c6b1c4c8e2","Type":"ContainerDied","Data":"c0d13a0307fa8adf075a816afa4a9b533ef515ef202ffbe0f74c1d799b5d1845"}
Sep 06 01:25:27.356462 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.356427    2567 scope.go:117] "RemoveContainer" containerID="f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c"
Sep 06 01:25:27.365099 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.365083    2567 scope.go:117] "RemoveContainer" containerID="f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c"
Sep 06 01:25:27.365318 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:25:27.365299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c\": container with ID starting with f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c not found: ID does not exist" containerID="f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c"
Sep 06 01:25:27.365378 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.365323    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c"} err="failed to get container status \"f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c\": rpc error: code = NotFound desc = could not find container \"f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c\": container with ID starting with f373f52bb3d12ade23589cf3d7fbb59466e2e175264ada8835dcd2b0ab54ff9c not found: ID does not exist"
Sep 06 01:25:27.372921 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.372898    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"]
Sep 06 01:25:27.376378 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:27.376358    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-109eb6-765c594f8b-6pmhz"]
Sep 06 01:25:29.208069 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:29.208030    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96feec36-d18f-48ab-a09e-14c6b1c4c8e2" path="/var/lib/kubelet/pods/96feec36-d18f-48ab-a09e-14c6b1c4c8e2/volumes"
Sep 06 01:25:29.315701 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:29.315668    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:25:29.315886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:29.315869    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:25:43.307717 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.307671    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"]
Sep 06 01:25:43.308183 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.307968    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr" podUID="48759637-543c-4c34-9a7c-071342b88127" containerName="payload-processing" containerID="cri-o://c65d3fc2889cc1acd471a18f5afc33c0d24372d56194fcba82827cc95be313b3" gracePeriod=30
Sep 06 01:25:43.313193 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.313150    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"]
Sep 06 01:25:43.313873 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.313840    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7" podUID="a8d40615-a658-4125-b834-3ae4c7d7bf47" containerName="payload-pre-processing" containerID="cri-o://e1330ff5541f5890464a0acb01f3840c295168916abe66510a51e9262a1146dc" gracePeriod=30
Sep 06 01:25:43.448583 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.448549    2567 generic.go:356] "Generic (PLEG): container finished" podID="a8d40615-a658-4125-b834-3ae4c7d7bf47" containerID="e1330ff5541f5890464a0acb01f3840c295168916abe66510a51e9262a1146dc" exitCode=0
Sep 06 01:25:43.448754 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.448604    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7" event={"ID":"a8d40615-a658-4125-b834-3ae4c7d7bf47","Type":"ContainerDied","Data":"e1330ff5541f5890464a0acb01f3840c295168916abe66510a51e9262a1146dc"}
Sep 06 01:25:43.450922 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.450892    2567 generic.go:356] "Generic (PLEG): container finished" podID="48759637-543c-4c34-9a7c-071342b88127" containerID="c65d3fc2889cc1acd471a18f5afc33c0d24372d56194fcba82827cc95be313b3" exitCode=0
Sep 06 01:25:43.451086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.450964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr" event={"ID":"48759637-543c-4c34-9a7c-071342b88127","Type":"ContainerDied","Data":"c65d3fc2889cc1acd471a18f5afc33c0d24372d56194fcba82827cc95be313b3"}
Sep 06 01:25:43.584567 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.584545    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:43.588164 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.588142    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:43.713830 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.713800    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dtk4\" (UniqueName: \"kubernetes.io/projected/a8d40615-a658-4125-b834-3ae4c7d7bf47-kube-api-access-9dtk4\") pod \"a8d40615-a658-4125-b834-3ae4c7d7bf47\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") "
Sep 06 01:25:43.713997 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.713868    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmzdj\" (UniqueName: \"kubernetes.io/projected/48759637-543c-4c34-9a7c-071342b88127-kube-api-access-pmzdj\") pod \"48759637-543c-4c34-9a7c-071342b88127\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") "
Sep 06 01:25:43.713997 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.713894    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d40615-a658-4125-b834-3ae4c7d7bf47-plugins-config-volume\") pod \"a8d40615-a658-4125-b834-3ae4c7d7bf47\" (UID: \"a8d40615-a658-4125-b834-3ae4c7d7bf47\") "
Sep 06 01:25:43.713997 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.713972    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48759637-543c-4c34-9a7c-071342b88127-plugins-config-volume\") pod \"48759637-543c-4c34-9a7c-071342b88127\" (UID: \"48759637-543c-4c34-9a7c-071342b88127\") "
Sep 06 01:25:43.714337 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.714309    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48759637-543c-4c34-9a7c-071342b88127-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48759637-543c-4c34-9a7c-071342b88127" (UID: "48759637-543c-4c34-9a7c-071342b88127"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:43.714337 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.714327    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8d40615-a658-4125-b834-3ae4c7d7bf47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8d40615-a658-4125-b834-3ae4c7d7bf47" (UID: "a8d40615-a658-4125-b834-3ae4c7d7bf47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:43.716083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.716055    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48759637-543c-4c34-9a7c-071342b88127-kube-api-access-pmzdj" (OuterVolumeSpecName: "kube-api-access-pmzdj") pod "48759637-543c-4c34-9a7c-071342b88127" (UID: "48759637-543c-4c34-9a7c-071342b88127"). InnerVolumeSpecName "kube-api-access-pmzdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:43.716201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.716186    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d40615-a658-4125-b834-3ae4c7d7bf47-kube-api-access-9dtk4" (OuterVolumeSpecName: "kube-api-access-9dtk4") pod "a8d40615-a658-4125-b834-3ae4c7d7bf47" (UID: "a8d40615-a658-4125-b834-3ae4c7d7bf47"). InnerVolumeSpecName "kube-api-access-9dtk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:43.815618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.815554    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48759637-543c-4c34-9a7c-071342b88127-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.815618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.815578    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dtk4\" (UniqueName: \"kubernetes.io/projected/a8d40615-a658-4125-b834-3ae4c7d7bf47-kube-api-access-9dtk4\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.815618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.815587    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmzdj\" (UniqueName: \"kubernetes.io/projected/48759637-543c-4c34-9a7c-071342b88127-kube-api-access-pmzdj\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.815618 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:43.815596    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d40615-a658-4125-b834-3ae4c7d7bf47-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:25:44.457580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.457496    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"
Sep 06 01:25:44.457580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.457486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr" event={"ID":"48759637-543c-4c34-9a7c-071342b88127","Type":"ContainerDied","Data":"287af50ab3fdda8d0024b673bba9672caebd3c47c5752aa81e97a801332eb435"}
Sep 06 01:25:44.458096 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.457647    2567 scope.go:117] "RemoveContainer" containerID="c65d3fc2889cc1acd471a18f5afc33c0d24372d56194fcba82827cc95be313b3"
Sep 06 01:25:44.459082 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.459051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7" event={"ID":"a8d40615-a658-4125-b834-3ae4c7d7bf47","Type":"ContainerDied","Data":"0e52293301ad75869404f2d63a727ddb8d8785d5365d2d57236fc885f32d9587"}
Sep 06 01:25:44.459211 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.459066    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"
Sep 06 01:25:44.467719 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.467694    2567 scope.go:117] "RemoveContainer" containerID="e1330ff5541f5890464a0acb01f3840c295168916abe66510a51e9262a1146dc"
Sep 06 01:25:44.484077 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.484058    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"]
Sep 06 01:25:44.487656 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.487634    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2686adc-5bd97ccfd6-jwkh7"]
Sep 06 01:25:44.499438 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.499413    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"]
Sep 06 01:25:44.503517 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:44.503499    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2686adc-77556f975c-qtmpr"]
Sep 06 01:25:45.209693 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:45.209658    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48759637-543c-4c34-9a7c-071342b88127" path="/var/lib/kubelet/pods/48759637-543c-4c34-9a7c-071342b88127/volumes"
Sep 06 01:25:45.210194 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:25:45.210176    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8d40615-a658-4125-b834-3ae4c7d7bf47" path="/var/lib/kubelet/pods/a8d40615-a658-4125-b834-3ae4c7d7bf47/volumes"
Sep 06 01:26:08.760321 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760281    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"]
Sep 06 01:26:08.760838 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760818    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96feec36-d18f-48ab-a09e-14c6b1c4c8e2" containerName="payload-pre-processing"
Sep 06 01:26:08.760919 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760841    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="96feec36-d18f-48ab-a09e-14c6b1c4c8e2" containerName="payload-pre-processing"
Sep 06 01:26:08.760919 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760871    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48759637-543c-4c34-9a7c-071342b88127" containerName="payload-processing"
Sep 06 01:26:08.760919 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760881    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="48759637-543c-4c34-9a7c-071342b88127" containerName="payload-processing"
Sep 06 01:26:08.760919 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760901    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8d40615-a658-4125-b834-3ae4c7d7bf47" containerName="payload-pre-processing"
Sep 06 01:26:08.760919 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.760911    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8d40615-a658-4125-b834-3ae4c7d7bf47" containerName="payload-pre-processing"
Sep 06 01:26:08.761264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.761035    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="96feec36-d18f-48ab-a09e-14c6b1c4c8e2" containerName="payload-pre-processing"
Sep 06 01:26:08.761264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.761051    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="48759637-543c-4c34-9a7c-071342b88127" containerName="payload-processing"
Sep 06 01:26:08.761264 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.761059    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8d40615-a658-4125-b834-3ae4c7d7bf47" containerName="payload-pre-processing"
Sep 06 01:26:08.765649 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.765628    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:08.768300 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.768282    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-49c9de\""
Sep 06 01:26:08.768400 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.768320    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-49c9de-dockercfg-rv4nc\""
Sep 06 01:26:08.776852 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.776834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"]
Sep 06 01:26:08.806351 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.806327    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"]
Sep 06 01:26:08.809480 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.809464    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:08.819060 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.819032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhjsw\" (UniqueName: \"kubernetes.io/projected/39eabec5-eadc-4b47-8fb0-1f3211139c00-kube-api-access-mhjsw\") pod \"payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:08.819199 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.819182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39eabec5-eadc-4b47-8fb0-1f3211139c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:08.820885 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.820864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"]
Sep 06 01:26:08.919998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.919958    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39eabec5-eadc-4b47-8fb0-1f3211139c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:08.920172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.920016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhjsw\" (UniqueName: \"kubernetes.io/projected/39eabec5-eadc-4b47-8fb0-1f3211139c00-kube-api-access-mhjsw\") pod \"payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:08.920172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.920074    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39784e2-16f8-4451-91a2-dcfc30880499-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:08.920172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.920099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7wr\" (UniqueName: \"kubernetes.io/projected/e39784e2-16f8-4451-91a2-dcfc30880499-kube-api-access-4k7wr\") pod \"payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:08.920688 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.920667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39eabec5-eadc-4b47-8fb0-1f3211139c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:08.927880 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:08.927838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhjsw\" (UniqueName: \"kubernetes.io/projected/39eabec5-eadc-4b47-8fb0-1f3211139c00-kube-api-access-mhjsw\") pod \"payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:09.021184 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.021108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39784e2-16f8-4451-91a2-dcfc30880499-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:09.021184 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.021139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7wr\" (UniqueName: \"kubernetes.io/projected/e39784e2-16f8-4451-91a2-dcfc30880499-kube-api-access-4k7wr\") pod \"payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:09.021770 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.021750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39784e2-16f8-4451-91a2-dcfc30880499-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:09.028794 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.028771    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7wr\" (UniqueName: \"kubernetes.io/projected/e39784e2-16f8-4451-91a2-dcfc30880499-kube-api-access-4k7wr\") pod \"payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:09.077471 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.077448    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:09.118785 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.118755    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:09.352218 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.352195    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"]
Sep 06 01:26:09.353379 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:26:09.353351    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39eabec5_eadc_4b47_8fb0_1f3211139c00.slice/crio-54f1add5ea6752b5005e9929508660b6158a76faf56920509496259601069b4f WatchSource:0}: Error finding container 54f1add5ea6752b5005e9929508660b6158a76faf56920509496259601069b4f: Status 404 returned error can't find the container with id 54f1add5ea6752b5005e9929508660b6158a76faf56920509496259601069b4f
Sep 06 01:26:09.411506 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.411484    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"]
Sep 06 01:26:09.412765 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:26:09.412735    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39784e2_16f8_4451_91a2_dcfc30880499.slice/crio-e995ba68f0239528b59c9f4866ca8d36268f9ebb29d42d99029c0f67d96d6721 WatchSource:0}: Error finding container e995ba68f0239528b59c9f4866ca8d36268f9ebb29d42d99029c0f67d96d6721: Status 404 returned error can't find the container with id e995ba68f0239528b59c9f4866ca8d36268f9ebb29d42d99029c0f67d96d6721
Sep 06 01:26:09.603433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.603342    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg" event={"ID":"39eabec5-eadc-4b47-8fb0-1f3211139c00","Type":"ContainerStarted","Data":"c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a"}
Sep 06 01:26:09.603433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.603398    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg" event={"ID":"39eabec5-eadc-4b47-8fb0-1f3211139c00","Type":"ContainerStarted","Data":"54f1add5ea6752b5005e9929508660b6158a76faf56920509496259601069b4f"}
Sep 06 01:26:09.603433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.603427    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:09.605105 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.605079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx" event={"ID":"e39784e2-16f8-4451-91a2-dcfc30880499","Type":"ContainerStarted","Data":"9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b"}
Sep 06 01:26:09.605229 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.605121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx" event={"ID":"e39784e2-16f8-4451-91a2-dcfc30880499","Type":"ContainerStarted","Data":"e995ba68f0239528b59c9f4866ca8d36268f9ebb29d42d99029c0f67d96d6721"}
Sep 06 01:26:09.605229 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.605195    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:09.630441 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.630397    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg" podStartSLOduration=1.63038504 podStartE2EDuration="1.63038504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:09.628312402 +0000 UTC m=+1022.903697565" watchObservedRunningTime="2026-09-06 01:26:09.63038504 +0000 UTC m=+1022.905770202"
Sep 06 01:26:09.647985 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:09.647907    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx" podStartSLOduration=1.6478911790000002 podStartE2EDuration="1.647891179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:09.645781746 +0000 UTC m=+1022.921166911" watchObservedRunningTime="2026-09-06 01:26:09.647891179 +0000 UTC m=+1022.923276345"
Sep 06 01:26:20.612717 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:20.612683    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:26:20.613118 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:20.612756    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:26:37.697073 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.697040    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"]
Sep 06 01:26:37.700393 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.700321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:37.702874 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.702853    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-bff89d\""
Sep 06 01:26:37.711288 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.711267    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"]
Sep 06 01:26:37.884450 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.884408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbxrk\" (UniqueName: \"kubernetes.io/projected/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-kube-api-access-gbxrk\") pod \"payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:37.884629 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.884521    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:37.985149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.985066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbxrk\" (UniqueName: \"kubernetes.io/projected/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-kube-api-access-gbxrk\") pod \"payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:37.985149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.985134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:37.985805 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.985779    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:37.992756 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:37.992736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbxrk\" (UniqueName: \"kubernetes.io/projected/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-kube-api-access-gbxrk\") pod \"payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:38.011260 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:38.011241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:38.282160 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:38.282137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"]
Sep 06 01:26:38.283651 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:26:38.283621    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3434950_8cf7_4a9b_bdbb_097ca39f0c49.slice/crio-e00078201891d83d0aa9015dd910ec05db964cb67da54f72ff97163c8ed60dbf WatchSource:0}: Error finding container e00078201891d83d0aa9015dd910ec05db964cb67da54f72ff97163c8ed60dbf: Status 404 returned error can't find the container with id e00078201891d83d0aa9015dd910ec05db964cb67da54f72ff97163c8ed60dbf
Sep 06 01:26:38.763170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:38.763132    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp" event={"ID":"d3434950-8cf7-4a9b-bdbb-097ca39f0c49","Type":"ContainerStarted","Data":"81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e"}
Sep 06 01:26:38.763550 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:38.763189    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp" event={"ID":"d3434950-8cf7-4a9b-bdbb-097ca39f0c49","Type":"ContainerStarted","Data":"e00078201891d83d0aa9015dd910ec05db964cb67da54f72ff97163c8ed60dbf"}
Sep 06 01:26:38.763550 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:38.763225    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:26:38.780210 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:38.780165    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp" podStartSLOduration=1.780152175 podStartE2EDuration="1.780152175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:38.778776497 +0000 UTC m=+1052.054161685" watchObservedRunningTime="2026-09-06 01:26:38.780152175 +0000 UTC m=+1052.055537374"
Sep 06 01:26:49.771293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:26:49.771258    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:27:19.173879 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.173804    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"]
Sep 06 01:27:19.179761 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.179723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.182758 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.182732    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2c9b203a\""
Sep 06 01:27:19.182961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.182862    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2c9b203a-dockercfg-k75j2\""
Sep 06 01:27:19.189453 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.189428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"]
Sep 06 01:27:19.210260 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.210239    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"]
Sep 06 01:27:19.213631 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.213614    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.220781 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.220757    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"]
Sep 06 01:27:19.249405 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.249376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4jk\" (UniqueName: \"kubernetes.io/projected/ccede27b-3e63-44dd-b680-76294925f562-kube-api-access-7t4jk\") pod \"payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") " pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.249532 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.249456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccede27b-3e63-44dd-b680-76294925f562-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") " pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.350898 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.350864    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xl9k\" (UniqueName: \"kubernetes.io/projected/fcfb687d-bbce-4279-bab1-58705489bcb5-kube-api-access-7xl9k\") pod \"payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.351114 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.350916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4jk\" (UniqueName: \"kubernetes.io/projected/ccede27b-3e63-44dd-b680-76294925f562-kube-api-access-7t4jk\") pod \"payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") " pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.351114 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.351063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccede27b-3e63-44dd-b680-76294925f562-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") " pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.351114 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.351100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcfb687d-bbce-4279-bab1-58705489bcb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.351706 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.351679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccede27b-3e63-44dd-b680-76294925f562-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") " pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.359278 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.359258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4jk\" (UniqueName: \"kubernetes.io/projected/ccede27b-3e63-44dd-b680-76294925f562-kube-api-access-7t4jk\") pod \"payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") " pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.451599 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.451537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcfb687d-bbce-4279-bab1-58705489bcb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.451599 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.451588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl9k\" (UniqueName: \"kubernetes.io/projected/fcfb687d-bbce-4279-bab1-58705489bcb5-kube-api-access-7xl9k\") pod \"payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.452178 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.452160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcfb687d-bbce-4279-bab1-58705489bcb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.459044 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.459023    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xl9k\" (UniqueName: \"kubernetes.io/projected/fcfb687d-bbce-4279-bab1-58705489bcb5-kube-api-access-7xl9k\") pod \"payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.491403 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.491381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.525162 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.525131    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.768204 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.768182    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"]
Sep 06 01:27:19.770266 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:27:19.770241    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfb687d_bbce_4279_bab1_58705489bcb5.slice/crio-e6d2c4ba2ea34f67ae82f930fac6179ae4ffa4709c28429e808059f559567655 WatchSource:0}: Error finding container e6d2c4ba2ea34f67ae82f930fac6179ae4ffa4709c28429e808059f559567655: Status 404 returned error can't find the container with id e6d2c4ba2ea34f67ae82f930fac6179ae4ffa4709c28429e808059f559567655
Sep 06 01:27:19.814634 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.814610    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"]
Sep 06 01:27:19.818962 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:27:19.818922    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccede27b_3e63_44dd_b680_76294925f562.slice/crio-1ba415e2a3ce662038193c847d762cd635956cc840b5c2207501f7cea932a3fc WatchSource:0}: Error finding container 1ba415e2a3ce662038193c847d762cd635956cc840b5c2207501f7cea932a3fc: Status 404 returned error can't find the container with id 1ba415e2a3ce662038193c847d762cd635956cc840b5c2207501f7cea932a3fc
Sep 06 01:27:19.980865 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.980833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr" event={"ID":"ccede27b-3e63-44dd-b680-76294925f562","Type":"ContainerStarted","Data":"ce0bb5308b19749ffffbb82be3907e96108b63e9a66c0dba944f321a4a233f9c"}
Sep 06 01:27:19.981075 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.980884    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr" event={"ID":"ccede27b-3e63-44dd-b680-76294925f562","Type":"ContainerStarted","Data":"1ba415e2a3ce662038193c847d762cd635956cc840b5c2207501f7cea932a3fc"}
Sep 06 01:27:19.981075 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.980966    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:27:19.982580 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.982555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7" event={"ID":"fcfb687d-bbce-4279-bab1-58705489bcb5","Type":"ContainerStarted","Data":"48c751c256bdf3c246c065da7d2e9afb91294e8003d06bc50c34407e02906e7c"}
Sep 06 01:27:19.982713 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.982602    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:19.982713 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.982627    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7" event={"ID":"fcfb687d-bbce-4279-bab1-58705489bcb5","Type":"ContainerStarted","Data":"e6d2c4ba2ea34f67ae82f930fac6179ae4ffa4709c28429e808059f559567655"}
Sep 06 01:27:19.999961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:19.999895    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr" podStartSLOduration=0.999878333 podStartE2EDuration="999.878333ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:27:19.995728483 +0000 UTC m=+1093.271113650" watchObservedRunningTime="2026-09-06 01:27:19.999878333 +0000 UTC m=+1093.275263503"
Sep 06 01:27:20.011869 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:20.011830    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7" podStartSLOduration=1.011818598 podStartE2EDuration="1.011818598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:27:20.009991871 +0000 UTC m=+1093.285377036" watchObservedRunningTime="2026-09-06 01:27:20.011818598 +0000 UTC m=+1093.287203786"
Sep 06 01:27:30.990888 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:30.990858    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:27:30.991369 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:27:30.990939    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:28:27.829737 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:27.829703    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"]
Sep 06 01:28:27.833392 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:27.833373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:27.835853 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:27.835827    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:28:27.835974 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:27.835851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:28:27.840197 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:27.840176    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"]
Sep 06 01:28:27.940840 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:27.940808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2826160a-1636-4a53-ab28-c8f6fdd5515c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6\" (UID: \"2826160a-1636-4a53-ab28-c8f6fdd5515c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:28.041420 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:28.041391    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2826160a-1636-4a53-ab28-c8f6fdd5515c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6\" (UID: \"2826160a-1636-4a53-ab28-c8f6fdd5515c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:28.042092 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:28.042073    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2826160a-1636-4a53-ab28-c8f6fdd5515c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6\" (UID: \"2826160a-1636-4a53-ab28-c8f6fdd5515c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:28.145873 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:28.145806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:28.414238 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:28.414211    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"]
Sep 06 01:28:28.415588 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:28:28.415562    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2826160a_1636_4a53_ab28_c8f6fdd5515c.slice/crio-05b3e7ec9c79a83e1170f93d530a63ab3b3cba306da2ef869b72cdaac249e16f WatchSource:0}: Error finding container 05b3e7ec9c79a83e1170f93d530a63ab3b3cba306da2ef869b72cdaac249e16f: Status 404 returned error can't find the container with id 05b3e7ec9c79a83e1170f93d530a63ab3b3cba306da2ef869b72cdaac249e16f
Sep 06 01:28:29.367978 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:29.367948    2567 generic.go:356] "Generic (PLEG): container finished" podID="2826160a-1636-4a53-ab28-c8f6fdd5515c" containerID="c7bf4ed05a1d6646f1ddd83eb1492d3524ac4250737d2a9484ebde91465b222c" exitCode=0
Sep 06 01:28:29.368345 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:29.368033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6" event={"ID":"2826160a-1636-4a53-ab28-c8f6fdd5515c","Type":"ContainerDied","Data":"c7bf4ed05a1d6646f1ddd83eb1492d3524ac4250737d2a9484ebde91465b222c"}
Sep 06 01:28:29.368345 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:29.368085    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6" event={"ID":"2826160a-1636-4a53-ab28-c8f6fdd5515c","Type":"ContainerStarted","Data":"05b3e7ec9c79a83e1170f93d530a63ab3b3cba306da2ef869b72cdaac249e16f"}
Sep 06 01:28:30.501359 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:30.501336    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:30.562203 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:30.562180    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2826160a-1636-4a53-ab28-c8f6fdd5515c-maas-api-service-ca\") pod \"2826160a-1636-4a53-ab28-c8f6fdd5515c\" (UID: \"2826160a-1636-4a53-ab28-c8f6fdd5515c\") "
Sep 06 01:28:30.562527 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:30.562504    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2826160a-1636-4a53-ab28-c8f6fdd5515c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2826160a-1636-4a53-ab28-c8f6fdd5515c" (UID: "2826160a-1636-4a53-ab28-c8f6fdd5515c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:28:30.663701 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:30.663636    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2826160a-1636-4a53-ab28-c8f6fdd5515c-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:28:31.380197 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:31.380165    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"
Sep 06 01:28:31.380371 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:31.380201    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6" event={"ID":"2826160a-1636-4a53-ab28-c8f6fdd5515c","Type":"ContainerDied","Data":"05b3e7ec9c79a83e1170f93d530a63ab3b3cba306da2ef869b72cdaac249e16f"}
Sep 06 01:28:31.380371 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:31.380246    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05b3e7ec9c79a83e1170f93d530a63ab3b3cba306da2ef869b72cdaac249e16f"
Sep 06 01:28:43.244142 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.244103    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"]
Sep 06 01:28:43.244707 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.244442    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr" podUID="ccede27b-3e63-44dd-b680-76294925f562" containerName="payload-processing" containerID="cri-o://ce0bb5308b19749ffffbb82be3907e96108b63e9a66c0dba944f321a4a233f9c" gracePeriod=30
Sep 06 01:28:43.249077 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.249053    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"]
Sep 06 01:28:43.249444 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.249397    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7" podUID="fcfb687d-bbce-4279-bab1-58705489bcb5" containerName="payload-pre-processing" containerID="cri-o://48c751c256bdf3c246c065da7d2e9afb91294e8003d06bc50c34407e02906e7c" gracePeriod=30
Sep 06 01:28:43.456666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.456441    2567 generic.go:356] "Generic (PLEG): container finished" podID="fcfb687d-bbce-4279-bab1-58705489bcb5" containerID="48c751c256bdf3c246c065da7d2e9afb91294e8003d06bc50c34407e02906e7c" exitCode=0
Sep 06 01:28:43.456666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.456600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7" event={"ID":"fcfb687d-bbce-4279-bab1-58705489bcb5","Type":"ContainerDied","Data":"48c751c256bdf3c246c065da7d2e9afb91294e8003d06bc50c34407e02906e7c"}
Sep 06 01:28:43.462320 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.462178    2567 generic.go:356] "Generic (PLEG): container finished" podID="ccede27b-3e63-44dd-b680-76294925f562" containerID="ce0bb5308b19749ffffbb82be3907e96108b63e9a66c0dba944f321a4a233f9c" exitCode=0
Sep 06 01:28:43.462464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.462238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr" event={"ID":"ccede27b-3e63-44dd-b680-76294925f562","Type":"ContainerDied","Data":"ce0bb5308b19749ffffbb82be3907e96108b63e9a66c0dba944f321a4a233f9c"}
Sep 06 01:28:43.492762 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.492723    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"]
Sep 06 01:28:43.495374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.495309    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c9b203a-8l9t6"]
Sep 06 01:28:43.532753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.532730    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:28:43.535695 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.535670    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:28:43.570828 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.570794    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t4jk\" (UniqueName: \"kubernetes.io/projected/ccede27b-3e63-44dd-b680-76294925f562-kube-api-access-7t4jk\") pod \"ccede27b-3e63-44dd-b680-76294925f562\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") "
Sep 06 01:28:43.571028 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.570902    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccede27b-3e63-44dd-b680-76294925f562-plugins-config-volume\") pod \"ccede27b-3e63-44dd-b680-76294925f562\" (UID: \"ccede27b-3e63-44dd-b680-76294925f562\") "
Sep 06 01:28:43.571028 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.570953    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xl9k\" (UniqueName: \"kubernetes.io/projected/fcfb687d-bbce-4279-bab1-58705489bcb5-kube-api-access-7xl9k\") pod \"fcfb687d-bbce-4279-bab1-58705489bcb5\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") "
Sep 06 01:28:43.571153 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.571035    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcfb687d-bbce-4279-bab1-58705489bcb5-plugins-config-volume\") pod \"fcfb687d-bbce-4279-bab1-58705489bcb5\" (UID: \"fcfb687d-bbce-4279-bab1-58705489bcb5\") "
Sep 06 01:28:43.571608 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.571557    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccede27b-3e63-44dd-b680-76294925f562-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccede27b-3e63-44dd-b680-76294925f562" (UID: "ccede27b-3e63-44dd-b680-76294925f562"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:28:43.571736 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.571696    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcfb687d-bbce-4279-bab1-58705489bcb5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fcfb687d-bbce-4279-bab1-58705489bcb5" (UID: "fcfb687d-bbce-4279-bab1-58705489bcb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:28:43.573256 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.573218    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccede27b-3e63-44dd-b680-76294925f562-kube-api-access-7t4jk" (OuterVolumeSpecName: "kube-api-access-7t4jk") pod "ccede27b-3e63-44dd-b680-76294925f562" (UID: "ccede27b-3e63-44dd-b680-76294925f562"). InnerVolumeSpecName "kube-api-access-7t4jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:28:43.573598 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.573579    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcfb687d-bbce-4279-bab1-58705489bcb5-kube-api-access-7xl9k" (OuterVolumeSpecName: "kube-api-access-7xl9k") pod "fcfb687d-bbce-4279-bab1-58705489bcb5" (UID: "fcfb687d-bbce-4279-bab1-58705489bcb5"). InnerVolumeSpecName "kube-api-access-7xl9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:28:43.672325 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.672294    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccede27b-3e63-44dd-b680-76294925f562-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:28:43.672325 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.672320    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xl9k\" (UniqueName: \"kubernetes.io/projected/fcfb687d-bbce-4279-bab1-58705489bcb5-kube-api-access-7xl9k\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:28:43.672325 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.672329    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcfb687d-bbce-4279-bab1-58705489bcb5-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:28:43.672539 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:43.672338    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t4jk\" (UniqueName: \"kubernetes.io/projected/ccede27b-3e63-44dd-b680-76294925f562-kube-api-access-7t4jk\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:28:44.469283 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.469207    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"
Sep 06 01:28:44.469697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.469207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7" event={"ID":"fcfb687d-bbce-4279-bab1-58705489bcb5","Type":"ContainerDied","Data":"e6d2c4ba2ea34f67ae82f930fac6179ae4ffa4709c28429e808059f559567655"}
Sep 06 01:28:44.469697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.469338    2567 scope.go:117] "RemoveContainer" containerID="48c751c256bdf3c246c065da7d2e9afb91294e8003d06bc50c34407e02906e7c"
Sep 06 01:28:44.470702 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.470637    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"
Sep 06 01:28:44.470761 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.470689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr" event={"ID":"ccede27b-3e63-44dd-b680-76294925f562","Type":"ContainerDied","Data":"1ba415e2a3ce662038193c847d762cd635956cc840b5c2207501f7cea932a3fc"}
Sep 06 01:28:44.479105 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.479089    2567 scope.go:117] "RemoveContainer" containerID="ce0bb5308b19749ffffbb82be3907e96108b63e9a66c0dba944f321a4a233f9c"
Sep 06 01:28:44.496616 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.496595    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"]
Sep 06 01:28:44.503466 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.503444    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c9b203a-9fbf886d9-9bdtr"]
Sep 06 01:28:44.514342 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.514323    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"]
Sep 06 01:28:44.516530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:44.516507    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c9b203a-6dc4c76d66-lldt7"]
Sep 06 01:28:45.207775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:45.207741    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2826160a-1636-4a53-ab28-c8f6fdd5515c" path="/var/lib/kubelet/pods/2826160a-1636-4a53-ab28-c8f6fdd5515c/volumes"
Sep 06 01:28:45.208182 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:45.208165    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccede27b-3e63-44dd-b680-76294925f562" path="/var/lib/kubelet/pods/ccede27b-3e63-44dd-b680-76294925f562/volumes"
Sep 06 01:28:45.208527 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:45.208515    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcfb687d-bbce-4279-bab1-58705489bcb5" path="/var/lib/kubelet/pods/fcfb687d-bbce-4279-bab1-58705489bcb5/volumes"
Sep 06 01:28:50.124912 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.124877    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"]
Sep 06 01:28:50.125374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125292    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcfb687d-bbce-4279-bab1-58705489bcb5" containerName="payload-pre-processing"
Sep 06 01:28:50.125374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125305    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfb687d-bbce-4279-bab1-58705489bcb5" containerName="payload-pre-processing"
Sep 06 01:28:50.125374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125315    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2826160a-1636-4a53-ab28-c8f6fdd5515c" containerName="revoke-keys"
Sep 06 01:28:50.125374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125321    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2826160a-1636-4a53-ab28-c8f6fdd5515c" containerName="revoke-keys"
Sep 06 01:28:50.125374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125328    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccede27b-3e63-44dd-b680-76294925f562" containerName="payload-processing"
Sep 06 01:28:50.125374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125333    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccede27b-3e63-44dd-b680-76294925f562" containerName="payload-processing"
Sep 06 01:28:50.125563 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125399    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcfb687d-bbce-4279-bab1-58705489bcb5" containerName="payload-pre-processing"
Sep 06 01:28:50.125563 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125407    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccede27b-3e63-44dd-b680-76294925f562" containerName="payload-processing"
Sep 06 01:28:50.125563 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.125413    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2826160a-1636-4a53-ab28-c8f6fdd5515c" containerName="revoke-keys"
Sep 06 01:28:50.129839 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.129821    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.133424 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.133387    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"openshift-service-ca.crt\""
Sep 06 01:28:50.133424 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.133415    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"default-dockercfg-phksg\""
Sep 06 01:28:50.133610 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.133402    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"sub-test-model-5833d5-kserve-self-signed-certs\""
Sep 06 01:28:50.133715 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.133693    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"kube-root-ca.crt\""
Sep 06 01:28:50.136587 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.136564    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"]
Sep 06 01:28:50.225189 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.225161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-home\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.225310 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.225196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwlh2\" (UniqueName: \"kubernetes.io/projected/8ca8a427-4b4c-4faa-8662-60b3491755c3-kube-api-access-cwlh2\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.225310 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.225215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-model-cache\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.225310 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.225282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-tmp-dir\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.225412 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.225328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca8a427-4b4c-4faa-8662-60b3491755c3-tls-certs\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.225412 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.225361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-dshm\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.326590 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.326563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca8a427-4b4c-4faa-8662-60b3491755c3-tls-certs\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.326700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.326607    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-dshm\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.326700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.326633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-home\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.326700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.326658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwlh2\" (UniqueName: \"kubernetes.io/projected/8ca8a427-4b4c-4faa-8662-60b3491755c3-kube-api-access-cwlh2\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.326700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.326676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-model-cache\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.326910 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.326707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-tmp-dir\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.327083 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.327060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-home\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.327144 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.327080    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-model-cache\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.327144 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.327116    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-tmp-dir\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.329417 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.329395    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-dshm\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.329623 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.329607    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca8a427-4b4c-4faa-8662-60b3491755c3-tls-certs\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.334735 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.334715    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwlh2\" (UniqueName: \"kubernetes.io/projected/8ca8a427-4b4c-4faa-8662-60b3491755c3-kube-api-access-cwlh2\") pod \"sub-test-model-5833d5-kserve-67d5b4854c-n9mln\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.440515 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.440473    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:28:50.714591 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:50.714564    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"]
Sep 06 01:28:50.715238 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:28:50.715213    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ca8a427_4b4c_4faa_8662_60b3491755c3.slice/crio-40630a01290b46fe7deae01bd382c2257d31e7c7ba0457ed805fbf17997162af WatchSource:0}: Error finding container 40630a01290b46fe7deae01bd382c2257d31e7c7ba0457ed805fbf17997162af: Status 404 returned error can't find the container with id 40630a01290b46fe7deae01bd382c2257d31e7c7ba0457ed805fbf17997162af
Sep 06 01:28:51.520097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:51.520060    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln" event={"ID":"8ca8a427-4b4c-4faa-8662-60b3491755c3","Type":"ContainerStarted","Data":"82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58"}
Sep 06 01:28:51.520461 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:51.520108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln" event={"ID":"8ca8a427-4b4c-4faa-8662-60b3491755c3","Type":"ContainerStarted","Data":"40630a01290b46fe7deae01bd382c2257d31e7c7ba0457ed805fbf17997162af"}
Sep 06 01:28:51.537971 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:28:51.537886    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln" podStartSLOduration=1.537868577 podStartE2EDuration="1.537868577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:28:51.536270805 +0000 UTC m=+1184.811655970" watchObservedRunningTime="2026-09-06 01:28:51.537868577 +0000 UTC m=+1184.813253740"
Sep 06 01:29:00.441503 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:29:00.441471    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:29:00.442011 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:29:00.441520    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:29:00.459965 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:29:00.459922    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:29:00.579597 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:29:00.579573    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:30:00.140484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.140398    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"]
Sep 06 01:30:00.144026 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.144008    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"]
Sep 06 01:30:00.144149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.144131    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"
Sep 06 01:30:00.146355 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.146336    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:30:00.147544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.147363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"
Sep 06 01:30:00.151270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.150764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"]
Sep 06 01:30:00.154697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.154575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"]
Sep 06 01:30:00.159433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.159412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"
Sep 06 01:30:00.166650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.166632    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"
Sep 06 01:30:00.435003 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.434974    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"]
Sep 06 01:30:00.436167 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:30:00.436138    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd49ad3_c980_4b85_81b2_990baea25126.slice/crio-20f93eb113038407e8c1d863eb68f6f326a64a454413846c96ebeec8997dd36f WatchSource:0}: Error finding container 20f93eb113038407e8c1d863eb68f6f326a64a454413846c96ebeec8997dd36f: Status 404 returned error can't find the container with id 20f93eb113038407e8c1d863eb68f6f326a64a454413846c96ebeec8997dd36f
Sep 06 01:30:00.442725 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.442690    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"]
Sep 06 01:30:00.444230 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:30:00.444110    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode965ef81_9d9c_4724_8d1c_866cf2a964c8.slice/crio-ade73011d3466bf27cbb23287c8f5a12c314b60e0ea0668d118159c46e11e73e WatchSource:0}: Error finding container ade73011d3466bf27cbb23287c8f5a12c314b60e0ea0668d118159c46e11e73e: Status 404 returned error can't find the container with id ade73011d3466bf27cbb23287c8f5a12c314b60e0ea0668d118159c46e11e73e
Sep 06 01:30:00.913484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.913445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm" event={"ID":"5dd49ad3-c980-4b85-81b2-990baea25126","Type":"ContainerStarted","Data":"474135dec0cd35c67b53aafc1cd0cadaeda192e6659f05c532647db7201ae95e"}
Sep 06 01:30:00.913703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.913554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm" event={"ID":"5dd49ad3-c980-4b85-81b2-990baea25126","Type":"ContainerStarted","Data":"20f93eb113038407e8c1d863eb68f6f326a64a454413846c96ebeec8997dd36f"}
Sep 06 01:30:00.915166 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.915138    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74" event={"ID":"e965ef81-9d9c-4724-8d1c-866cf2a964c8","Type":"ContainerStarted","Data":"00d8cede53c47fac19f1bf1433a3634e966d75d20d9a834dae9676d6c6bb7507"}
Sep 06 01:30:00.915292 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.915181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74" event={"ID":"e965ef81-9d9c-4724-8d1c-866cf2a964c8","Type":"ContainerStarted","Data":"ade73011d3466bf27cbb23287c8f5a12c314b60e0ea0668d118159c46e11e73e"}
Sep 06 01:30:00.930362 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.930320    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm" podStartSLOduration=0.930308775 podStartE2EDuration="930.308775ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:00.928639151 +0000 UTC m=+1254.204024315" watchObservedRunningTime="2026-09-06 01:30:00.930308775 +0000 UTC m=+1254.205693936"
Sep 06 01:30:00.944491 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:00.944452    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74" podStartSLOduration=0.944438656 podStartE2EDuration="944.438656ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:00.942390959 +0000 UTC m=+1254.217776121" watchObservedRunningTime="2026-09-06 01:30:00.944438656 +0000 UTC m=+1254.219823819"
Sep 06 01:30:01.721064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:01.721029    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"]
Sep 06 01:30:01.923468 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:01.923433    2567 generic.go:356] "Generic (PLEG): container finished" podID="5dd49ad3-c980-4b85-81b2-990baea25126" containerID="474135dec0cd35c67b53aafc1cd0cadaeda192e6659f05c532647db7201ae95e" exitCode=0
Sep 06 01:30:01.923650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:01.923522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm" event={"ID":"5dd49ad3-c980-4b85-81b2-990baea25126","Type":"ContainerDied","Data":"474135dec0cd35c67b53aafc1cd0cadaeda192e6659f05c532647db7201ae95e"}
Sep 06 01:30:01.925091 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:01.925068    2567 generic.go:356] "Generic (PLEG): container finished" podID="e965ef81-9d9c-4724-8d1c-866cf2a964c8" containerID="00d8cede53c47fac19f1bf1433a3634e966d75d20d9a834dae9676d6c6bb7507" exitCode=0
Sep 06 01:30:01.925178 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:01.925130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74" event={"ID":"e965ef81-9d9c-4724-8d1c-866cf2a964c8","Type":"ContainerDied","Data":"00d8cede53c47fac19f1bf1433a3634e966d75d20d9a834dae9676d6c6bb7507"}
Sep 06 01:30:03.059899 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.059876    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"
Sep 06 01:30:03.088085 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.088061    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"
Sep 06 01:30:03.937573 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.937546    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"
Sep 06 01:30:03.937781 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.937576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm" event={"ID":"5dd49ad3-c980-4b85-81b2-990baea25126","Type":"ContainerDied","Data":"20f93eb113038407e8c1d863eb68f6f326a64a454413846c96ebeec8997dd36f"}
Sep 06 01:30:03.937781 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.937633    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20f93eb113038407e8c1d863eb68f6f326a64a454413846c96ebeec8997dd36f"
Sep 06 01:30:03.938965 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.938938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74" event={"ID":"e965ef81-9d9c-4724-8d1c-866cf2a964c8","Type":"ContainerDied","Data":"ade73011d3466bf27cbb23287c8f5a12c314b60e0ea0668d118159c46e11e73e"}
Sep 06 01:30:03.939065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.938967    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"
Sep 06 01:30:03.939065 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:03.938990    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ade73011d3466bf27cbb23287c8f5a12c314b60e0ea0668d118159c46e11e73e"
Sep 06 01:30:16.740747 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:16.740710    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln" podUID="8ca8a427-4b4c-4faa-8662-60b3491755c3" containerName="main" containerID="cri-o://82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58" gracePeriod=45
Sep 06 01:30:16.985318 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:16.985291    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:30:17.014647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.014559    2567 generic.go:356] "Generic (PLEG): container finished" podID="8ca8a427-4b4c-4faa-8662-60b3491755c3" containerID="82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58" exitCode=0
Sep 06 01:30:17.014647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.014617    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"
Sep 06 01:30:17.014870 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.014639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln" event={"ID":"8ca8a427-4b4c-4faa-8662-60b3491755c3","Type":"ContainerDied","Data":"82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58"}
Sep 06 01:30:17.014870 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.014697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln" event={"ID":"8ca8a427-4b4c-4faa-8662-60b3491755c3","Type":"ContainerDied","Data":"40630a01290b46fe7deae01bd382c2257d31e7c7ba0457ed805fbf17997162af"}
Sep 06 01:30:17.014870 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.014720    2567 scope.go:117] "RemoveContainer" containerID="82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58"
Sep 06 01:30:17.026411 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.026363    2567 scope.go:117] "RemoveContainer" containerID="82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58"
Sep 06 01:30:17.026862 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:30:17.026839    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58\": container with ID starting with 82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58 not found: ID does not exist" containerID="82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58"
Sep 06 01:30:17.027021 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.026870    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58"} err="failed to get container status \"82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58\": rpc error: code = NotFound desc = could not find container \"82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58\": container with ID starting with 82c9623e6c4e85f7db5a602b472a5a4a70ddfb010142144c0bcd9e2a07e03f58 not found: ID does not exist"
Sep 06 01:30:17.087003 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.086975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-home\") pod \"8ca8a427-4b4c-4faa-8662-60b3491755c3\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") "
Sep 06 01:30:17.087140 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087030    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwlh2\" (UniqueName: \"kubernetes.io/projected/8ca8a427-4b4c-4faa-8662-60b3491755c3-kube-api-access-cwlh2\") pod \"8ca8a427-4b4c-4faa-8662-60b3491755c3\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") "
Sep 06 01:30:17.087140 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087058    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-tmp-dir\") pod \"8ca8a427-4b4c-4faa-8662-60b3491755c3\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") "
Sep 06 01:30:17.087140 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca8a427-4b4c-4faa-8662-60b3491755c3-tls-certs\") pod \"8ca8a427-4b4c-4faa-8662-60b3491755c3\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") "
Sep 06 01:30:17.087140 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087135    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-dshm\") pod \"8ca8a427-4b4c-4faa-8662-60b3491755c3\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") "
Sep 06 01:30:17.087299 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087170    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-model-cache\") pod \"8ca8a427-4b4c-4faa-8662-60b3491755c3\" (UID: \"8ca8a427-4b4c-4faa-8662-60b3491755c3\") "
Sep 06 01:30:17.087299 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087245    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-home" (OuterVolumeSpecName: "home") pod "8ca8a427-4b4c-4faa-8662-60b3491755c3" (UID: "8ca8a427-4b4c-4faa-8662-60b3491755c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:17.087413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087378    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ca8a427-4b4c-4faa-8662-60b3491755c3" (UID: "8ca8a427-4b4c-4faa-8662-60b3491755c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:17.087520 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087497    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ca8a427-4b4c-4faa-8662-60b3491755c3" (UID: "8ca8a427-4b4c-4faa-8662-60b3491755c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:17.087571 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087524    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-home\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:30:17.087571 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.087561    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-tmp-dir\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:30:17.089351 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.089327    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ca8a427-4b4c-4faa-8662-60b3491755c3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ca8a427-4b4c-4faa-8662-60b3491755c3" (UID: "8ca8a427-4b4c-4faa-8662-60b3491755c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:30:17.089451 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.089388    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-dshm" (OuterVolumeSpecName: "dshm") pod "8ca8a427-4b4c-4faa-8662-60b3491755c3" (UID: "8ca8a427-4b4c-4faa-8662-60b3491755c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:17.089451 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.089397    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca8a427-4b4c-4faa-8662-60b3491755c3-kube-api-access-cwlh2" (OuterVolumeSpecName: "kube-api-access-cwlh2") pod "8ca8a427-4b4c-4faa-8662-60b3491755c3" (UID: "8ca8a427-4b4c-4faa-8662-60b3491755c3"). InnerVolumeSpecName "kube-api-access-cwlh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:30:17.188426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.188387    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-dshm\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:30:17.188426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.188419    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca8a427-4b4c-4faa-8662-60b3491755c3-model-cache\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:30:17.188426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.188430    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwlh2\" (UniqueName: \"kubernetes.io/projected/8ca8a427-4b4c-4faa-8662-60b3491755c3-kube-api-access-cwlh2\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:30:17.188657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.188439    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca8a427-4b4c-4faa-8662-60b3491755c3-tls-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:30:17.333885 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.333813    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"]
Sep 06 01:30:17.338064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:17.338036    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/sub-test-model-5833d5-kserve-67d5b4854c-n9mln"]
Sep 06 01:30:19.207795 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:19.207761    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca8a427-4b4c-4faa-8662-60b3491755c3" path="/var/lib/kubelet/pods/8ca8a427-4b4c-4faa-8662-60b3491755c3/volumes"
Sep 06 01:30:27.845158 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845126    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"]
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845486    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca8a427-4b4c-4faa-8662-60b3491755c3" containerName="main"
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845496    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca8a427-4b4c-4faa-8662-60b3491755c3" containerName="main"
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845511    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e965ef81-9d9c-4724-8d1c-866cf2a964c8" containerName="cleanup"
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845516    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e965ef81-9d9c-4724-8d1c-866cf2a964c8" containerName="cleanup"
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845530    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd49ad3-c980-4b85-81b2-990baea25126" containerName="cleanup"
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845536    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd49ad3-c980-4b85-81b2-990baea25126" containerName="cleanup"
Sep 06 01:30:27.845606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845607    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca8a427-4b4c-4faa-8662-60b3491755c3" containerName="main"
Sep 06 01:30:27.845989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845616    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd49ad3-c980-4b85-81b2-990baea25126" containerName="cleanup"
Sep 06 01:30:27.845989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.845622    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e965ef81-9d9c-4724-8d1c-866cf2a964c8" containerName="cleanup"
Sep 06 01:30:27.850223 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.850202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:27.852589 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.852567    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"openshift-service-ca.crt\""
Sep 06 01:30:27.853512 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.853491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"default-dockercfg-8kzkj\""
Sep 06 01:30:27.853624 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.853598    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"kube-root-ca.crt\""
Sep 06 01:30:27.853624 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.853598    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"rate-test-model-41f259-kserve-self-signed-certs\""
Sep 06 01:30:27.858600 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.858576    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"]
Sep 06 01:30:27.983226 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.983197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-model-cache\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:27.983401 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.983236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqmcf\" (UniqueName: \"kubernetes.io/projected/a58c4b05-1cc9-4b39-b873-92f41507cd2d-kube-api-access-rqmcf\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:27.983401 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.983270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-home\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:27.983401 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.983310    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tls-certs\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:27.983401 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.983345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-dshm\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:27.983588 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:27.983392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tmp-dir\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.084626 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.084597    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqmcf\" (UniqueName: \"kubernetes.io/projected/a58c4b05-1cc9-4b39-b873-92f41507cd2d-kube-api-access-rqmcf\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.084757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.084630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-home\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.084757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.084659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tls-certs\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.084757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.084682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-dshm\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.084757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.084700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tmp-dir\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.084911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.084875    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-model-cache\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.085092 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.085067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-home\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.085092 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.085084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tmp-dir\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.085226 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.085182    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-model-cache\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.086860 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.086840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-dshm\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.087149 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.087132    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tls-certs\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.092962 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.092944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqmcf\" (UniqueName: \"kubernetes.io/projected/a58c4b05-1cc9-4b39-b873-92f41507cd2d-kube-api-access-rqmcf\") pod \"rate-test-model-41f259-kserve-669496cbc-4d7j6\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") " pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.160861 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.160775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:28.431647 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:28.431625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"]
Sep 06 01:30:28.433557 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:30:28.433530    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda58c4b05_1cc9_4b39_b873_92f41507cd2d.slice/crio-0e9123bc6da20ca2df1f5d6a4621a7ca91169727c9dd5b4affb80dc0d507aa41 WatchSource:0}: Error finding container 0e9123bc6da20ca2df1f5d6a4621a7ca91169727c9dd5b4affb80dc0d507aa41: Status 404 returned error can't find the container with id 0e9123bc6da20ca2df1f5d6a4621a7ca91169727c9dd5b4affb80dc0d507aa41
Sep 06 01:30:29.089405 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:29.089363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6" event={"ID":"a58c4b05-1cc9-4b39-b873-92f41507cd2d","Type":"ContainerStarted","Data":"3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89"}
Sep 06 01:30:29.089841 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:29.089419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6" event={"ID":"a58c4b05-1cc9-4b39-b873-92f41507cd2d","Type":"ContainerStarted","Data":"0e9123bc6da20ca2df1f5d6a4621a7ca91169727c9dd5b4affb80dc0d507aa41"}
Sep 06 01:30:29.110785 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:29.110741    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6" podStartSLOduration=2.110724106 podStartE2EDuration="2.110724106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:29.108273942 +0000 UTC m=+1282.383659130" watchObservedRunningTime="2026-09-06 01:30:29.110724106 +0000 UTC m=+1282.386109271"
Sep 06 01:30:34.468269 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.468233    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"]
Sep 06 01:30:34.472018 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.471993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.475786 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.475761    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a7b006\""
Sep 06 01:30:34.476139 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.475778    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a7b006-dockercfg-7whvn\""
Sep 06 01:30:34.486993 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.486973    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"]
Sep 06 01:30:34.542654 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.542624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9g2\" (UniqueName: \"kubernetes.io/projected/08cbd983-4094-488a-9c6b-1015f3cf84df-kube-api-access-tn9g2\") pod \"payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.542847 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.542689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cbd983-4094-488a-9c6b-1015f3cf84df-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.643846 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.643812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cbd983-4094-488a-9c6b-1015f3cf84df-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.644074 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.643876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9g2\" (UniqueName: \"kubernetes.io/projected/08cbd983-4094-488a-9c6b-1015f3cf84df-kube-api-access-tn9g2\") pod \"payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.644640 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.644613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cbd983-4094-488a-9c6b-1015f3cf84df-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.651785 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.651759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9g2\" (UniqueName: \"kubernetes.io/projected/08cbd983-4094-488a-9c6b-1015f3cf84df-kube-api-access-tn9g2\") pod \"payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:34.788870 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:34.788779    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:35.062521 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:35.062491    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"]
Sep 06 01:30:35.063872 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:30:35.063844    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cbd983_4094_488a_9c6b_1015f3cf84df.slice/crio-dd4764b6a13daf5538c6dfa7d3b64dcd395c5757cf774ded7b6e1ccbc0865d19 WatchSource:0}: Error finding container dd4764b6a13daf5538c6dfa7d3b64dcd395c5757cf774ded7b6e1ccbc0865d19: Status 404 returned error can't find the container with id dd4764b6a13daf5538c6dfa7d3b64dcd395c5757cf774ded7b6e1ccbc0865d19
Sep 06 01:30:35.125033 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:35.125007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l" event={"ID":"08cbd983-4094-488a-9c6b-1015f3cf84df","Type":"ContainerStarted","Data":"dd4764b6a13daf5538c6dfa7d3b64dcd395c5757cf774ded7b6e1ccbc0865d19"}
Sep 06 01:30:36.131903 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:36.131865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l" event={"ID":"08cbd983-4094-488a-9c6b-1015f3cf84df","Type":"ContainerStarted","Data":"aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344"}
Sep 06 01:30:36.132357 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:36.131959    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:30:36.151297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:36.151246    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l" podStartSLOduration=2.151228651 podStartE2EDuration="2.151228651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:36.147736753 +0000 UTC m=+1289.423121920" watchObservedRunningTime="2026-09-06 01:30:36.151228651 +0000 UTC m=+1289.426613818"
Sep 06 01:30:38.161014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:38.160983    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:38.161014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:38.161024    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:38.173549 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:38.173526    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:39.160973 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:39.160943    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:30:47.141160 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:30:47.141129    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:31:03.435606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.435571    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"]
Sep 06 01:31:03.439081 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.439061    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.441522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.441496    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-20a262\""
Sep 06 01:31:03.441645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.441508    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-20a262-dockercfg-kn7qt\""
Sep 06 01:31:03.450084 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.450053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"]
Sep 06 01:31:03.506445 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.506175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e493a9cb-adca-4d06-99e9-4fccec3f75d5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") " pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.506445 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.506274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhfpz\" (UniqueName: \"kubernetes.io/projected/e493a9cb-adca-4d06-99e9-4fccec3f75d5-kube-api-access-lhfpz\") pod \"payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") " pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.606958 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.606887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e493a9cb-adca-4d06-99e9-4fccec3f75d5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") " pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.607192 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.606965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhfpz\" (UniqueName: \"kubernetes.io/projected/e493a9cb-adca-4d06-99e9-4fccec3f75d5-kube-api-access-lhfpz\") pod \"payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") " pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.607605 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.607585    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e493a9cb-adca-4d06-99e9-4fccec3f75d5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") " pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.615547 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.615522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhfpz\" (UniqueName: \"kubernetes.io/projected/e493a9cb-adca-4d06-99e9-4fccec3f75d5-kube-api-access-lhfpz\") pod \"payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") " pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:03.750645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:03.750553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:04.030406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:04.030374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"]
Sep 06 01:31:04.032334 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:31:04.032291    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode493a9cb_adca_4d06_99e9_4fccec3f75d5.slice/crio-6a1b90e4f6c46b0364c54b24f2eec0e6dd3eb70cd2c093fce1a557966b750c2a WatchSource:0}: Error finding container 6a1b90e4f6c46b0364c54b24f2eec0e6dd3eb70cd2c093fce1a557966b750c2a: Status 404 returned error can't find the container with id 6a1b90e4f6c46b0364c54b24f2eec0e6dd3eb70cd2c093fce1a557966b750c2a
Sep 06 01:31:04.299889 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:04.299781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9" event={"ID":"e493a9cb-adca-4d06-99e9-4fccec3f75d5","Type":"ContainerStarted","Data":"eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4"}
Sep 06 01:31:04.299889 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:04.299855    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:04.299889 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:04.299879    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9" event={"ID":"e493a9cb-adca-4d06-99e9-4fccec3f75d5","Type":"ContainerStarted","Data":"6a1b90e4f6c46b0364c54b24f2eec0e6dd3eb70cd2c093fce1a557966b750c2a"}
Sep 06 01:31:04.316714 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:04.316659    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9" podStartSLOduration=1.316639533 podStartE2EDuration="1.316639533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:04.31421109 +0000 UTC m=+1317.589596253" watchObservedRunningTime="2026-09-06 01:31:04.316639533 +0000 UTC m=+1317.592024698"
Sep 06 01:31:07.348476 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:07.348372    2567 scope.go:117] "RemoveContainer" containerID="ae1ca0a9c22972354a8faf3fd4d2b3504327b2bd5d927c05b441166d5e500931"
Sep 06 01:31:15.308501 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:15.308464    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:31:18.052366 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.052331    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"]
Sep 06 01:31:18.846833 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.846797    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"]
Sep 06 01:31:18.851940 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.851903    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.854269 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.854249    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-de7322-openshift-default-dockercfg-r2bxj\""
Sep 06 01:31:18.863033 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.863013    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"]
Sep 06 01:31:18.947710 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-envoy\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.947710 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947710    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-data\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.947911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-certs\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.947911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-socket\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.947911 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-podinfo\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.948056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istiod-ca-cert\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.948056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.947957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-credential-socket\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.948056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.948042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-token\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:18.948162 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:18.948067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n48xb\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-kube-api-access-n48xb\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048563 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-podinfo\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048563 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istiod-ca-cert\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-credential-socket\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-token\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048651    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n48xb\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-kube-api-access-n48xb\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-envoy\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-data\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-certs\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.048817 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.048768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-socket\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.049394 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.049367    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-socket\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.049484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.049435    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-credential-socket\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.049484 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.049460    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istiod-ca-cert\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.049568 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.049502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-data\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.049768 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.049743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-certs\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.051667 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.051571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-podinfo\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.052085 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.052048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-envoy\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.057018 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.056995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-token\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.057430 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.057358    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n48xb\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-kube-api-access-n48xb\") pod \"e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") " pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.163670 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.163604    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:19.439937 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.439894    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"]
Sep 06 01:31:19.441241 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:31:19.441215    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f50970f_ea1d_483c_a7dd_7ae3cbeae0f8.slice/crio-deb0b6c69ccedff07a375b6dd60c110b74114e49bbd23eec3b0a3427edab456b WatchSource:0}: Error finding container deb0b6c69ccedff07a375b6dd60c110b74114e49bbd23eec3b0a3427edab456b: Status 404 returned error can't find the container with id deb0b6c69ccedff07a375b6dd60c110b74114e49bbd23eec3b0a3427edab456b
Sep 06 01:31:19.444074 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.444039    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:19.444200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.444118    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:19.444200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:19.444161    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:20.393052 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:20.393010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" event={"ID":"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8","Type":"ContainerStarted","Data":"6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"}
Sep 06 01:31:20.393498 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:20.393086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" event={"ID":"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8","Type":"ContainerStarted","Data":"deb0b6c69ccedff07a375b6dd60c110b74114e49bbd23eec3b0a3427edab456b"}
Sep 06 01:31:20.414997 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:20.414924    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podStartSLOduration=2.414910872 podStartE2EDuration="2.414910872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:20.413204321 +0000 UTC m=+1333.688589484" watchObservedRunningTime="2026-09-06 01:31:20.414910872 +0000 UTC m=+1333.690296033"
Sep 06 01:31:21.164634 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:21.164593    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:21.169848 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:21.169824    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:21.399086 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:21.399054    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:21.400200 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:21.400179    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:33.071720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.071651    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6" podUID="a58c4b05-1cc9-4b39-b873-92f41507cd2d" containerName="main" containerID="cri-o://3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89" gracePeriod=45
Sep 06 01:31:33.320093 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.320066    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:31:33.468101 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.468067    2567 generic.go:356] "Generic (PLEG): container finished" podID="a58c4b05-1cc9-4b39-b873-92f41507cd2d" containerID="3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89" exitCode=0
Sep 06 01:31:33.468258 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.468113    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"
Sep 06 01:31:33.468258 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.468150    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6" event={"ID":"a58c4b05-1cc9-4b39-b873-92f41507cd2d","Type":"ContainerDied","Data":"3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89"}
Sep 06 01:31:33.468258 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.468193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6" event={"ID":"a58c4b05-1cc9-4b39-b873-92f41507cd2d","Type":"ContainerDied","Data":"0e9123bc6da20ca2df1f5d6a4621a7ca91169727c9dd5b4affb80dc0d507aa41"}
Sep 06 01:31:33.468258 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.468215    2567 scope.go:117] "RemoveContainer" containerID="3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89"
Sep 06 01:31:33.477061 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.477043    2567 scope.go:117] "RemoveContainer" containerID="3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89"
Sep 06 01:31:33.477326 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:31:33.477310    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89\": container with ID starting with 3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89 not found: ID does not exist" containerID="3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89"
Sep 06 01:31:33.477365 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.477338    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89"} err="failed to get container status \"3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89\": rpc error: code = NotFound desc = could not find container \"3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89\": container with ID starting with 3695cf9946d3e438f19e77736d28b5bb7b52d371ba2261358eab64c40e226b89 not found: ID does not exist"
Sep 06 01:31:33.483639 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483622    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-model-cache\") pod \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") "
Sep 06 01:31:33.483705 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483659    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-home\") pod \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") "
Sep 06 01:31:33.483753 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483739    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tls-certs\") pod \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") "
Sep 06 01:31:33.483797 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483784    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tmp-dir\") pod \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") "
Sep 06 01:31:33.483840 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483818    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqmcf\" (UniqueName: \"kubernetes.io/projected/a58c4b05-1cc9-4b39-b873-92f41507cd2d-kube-api-access-rqmcf\") pod \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") "
Sep 06 01:31:33.483893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483839    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a58c4b05-1cc9-4b39-b873-92f41507cd2d" (UID: "a58c4b05-1cc9-4b39-b873-92f41507cd2d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:33.483893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483853    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-dshm\") pod \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\" (UID: \"a58c4b05-1cc9-4b39-b873-92f41507cd2d\") "
Sep 06 01:31:33.484022 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.483959    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-home" (OuterVolumeSpecName: "home") pod "a58c4b05-1cc9-4b39-b873-92f41507cd2d" (UID: "a58c4b05-1cc9-4b39-b873-92f41507cd2d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:33.484096 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.484076    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a58c4b05-1cc9-4b39-b873-92f41507cd2d" (UID: "a58c4b05-1cc9-4b39-b873-92f41507cd2d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:33.484174 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.484158    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tmp-dir\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.484230 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.484175    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-model-cache\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.484230 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.484184    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-home\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.485961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.485913    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a58c4b05-1cc9-4b39-b873-92f41507cd2d" (UID: "a58c4b05-1cc9-4b39-b873-92f41507cd2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:31:33.486060 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.485955    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-dshm" (OuterVolumeSpecName: "dshm") pod "a58c4b05-1cc9-4b39-b873-92f41507cd2d" (UID: "a58c4b05-1cc9-4b39-b873-92f41507cd2d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:33.486107 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.486080    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a58c4b05-1cc9-4b39-b873-92f41507cd2d-kube-api-access-rqmcf" (OuterVolumeSpecName: "kube-api-access-rqmcf") pod "a58c4b05-1cc9-4b39-b873-92f41507cd2d" (UID: "a58c4b05-1cc9-4b39-b873-92f41507cd2d"). InnerVolumeSpecName "kube-api-access-rqmcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:33.585340 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.585302    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqmcf\" (UniqueName: \"kubernetes.io/projected/a58c4b05-1cc9-4b39-b873-92f41507cd2d-kube-api-access-rqmcf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.585340 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.585331    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a58c4b05-1cc9-4b39-b873-92f41507cd2d-dshm\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.585340 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.585345    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a58c4b05-1cc9-4b39-b873-92f41507cd2d-tls-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.789811 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.789779    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"]
Sep 06 01:31:33.794113 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:33.794093    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/rate-test-model-41f259-kserve-669496cbc-4d7j6"]
Sep 06 01:31:35.208754 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:35.208724    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a58c4b05-1cc9-4b39-b873-92f41507cd2d" path="/var/lib/kubelet/pods/a58c4b05-1cc9-4b39-b873-92f41507cd2d/volumes"
Sep 06 01:31:43.532754 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:43.532714    2567 generic.go:356] "Generic (PLEG): container finished" podID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerID="6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba" exitCode=0
Sep 06 01:31:43.533219 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:43.532786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" event={"ID":"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8","Type":"ContainerDied","Data":"6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"}
Sep 06 01:31:43.533272 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:43.533227    2567 scope.go:117] "RemoveContainer" containerID="6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"
Sep 06 01:31:43.534398 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:43.534363    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:43.534494 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:43.534450    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:43.534494 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:43.534486    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:44.544667 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:44.544566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" event={"ID":"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8","Type":"ContainerStarted","Data":"a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572"}
Sep 06 01:31:45.164504 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.164471    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:45.164712 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.164670    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:31:45.164771 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.164736    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 01:31:45.514521 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.514480    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"]
Sep 06 01:31:45.514811 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.514762    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l" podUID="08cbd983-4094-488a-9c6b-1015f3cf84df" containerName="payload-processing" containerID="cri-o://aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344" gracePeriod=30
Sep 06 01:31:45.833415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.833387    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:31:45.903864 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.903835    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cbd983-4094-488a-9c6b-1015f3cf84df-plugins-config-volume\") pod \"08cbd983-4094-488a-9c6b-1015f3cf84df\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") "
Sep 06 01:31:45.904042 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.903920    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn9g2\" (UniqueName: \"kubernetes.io/projected/08cbd983-4094-488a-9c6b-1015f3cf84df-kube-api-access-tn9g2\") pod \"08cbd983-4094-488a-9c6b-1015f3cf84df\" (UID: \"08cbd983-4094-488a-9c6b-1015f3cf84df\") "
Sep 06 01:31:45.904286 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.904261    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08cbd983-4094-488a-9c6b-1015f3cf84df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08cbd983-4094-488a-9c6b-1015f3cf84df" (UID: "08cbd983-4094-488a-9c6b-1015f3cf84df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:31:45.905853 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:45.905836    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08cbd983-4094-488a-9c6b-1015f3cf84df-kube-api-access-tn9g2" (OuterVolumeSpecName: "kube-api-access-tn9g2") pod "08cbd983-4094-488a-9c6b-1015f3cf84df" (UID: "08cbd983-4094-488a-9c6b-1015f3cf84df"). InnerVolumeSpecName "kube-api-access-tn9g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:46.004947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.004902    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cbd983-4094-488a-9c6b-1015f3cf84df-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:46.004947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.004949    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn9g2\" (UniqueName: \"kubernetes.io/projected/08cbd983-4094-488a-9c6b-1015f3cf84df-kube-api-access-tn9g2\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:31:46.164665 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.164569    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:31:46.164665 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.164630    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 01:31:46.571877 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.571843    2567 generic.go:356] "Generic (PLEG): container finished" podID="08cbd983-4094-488a-9c6b-1015f3cf84df" containerID="aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344" exitCode=0
Sep 06 01:31:46.572115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.571909    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"
Sep 06 01:31:46.572115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.571949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l" event={"ID":"08cbd983-4094-488a-9c6b-1015f3cf84df","Type":"ContainerDied","Data":"aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344"}
Sep 06 01:31:46.572115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.572005    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l" event={"ID":"08cbd983-4094-488a-9c6b-1015f3cf84df","Type":"ContainerDied","Data":"dd4764b6a13daf5538c6dfa7d3b64dcd395c5757cf774ded7b6e1ccbc0865d19"}
Sep 06 01:31:46.572115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.572036    2567 scope.go:117] "RemoveContainer" containerID="aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344"
Sep 06 01:31:46.582023 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.582005    2567 scope.go:117] "RemoveContainer" containerID="aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344"
Sep 06 01:31:46.582309 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:31:46.582287    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344\": container with ID starting with aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344 not found: ID does not exist" containerID="aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344"
Sep 06 01:31:46.582374 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.582320    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344"} err="failed to get container status \"aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344\": rpc error: code = NotFound desc = could not find container \"aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344\": container with ID starting with aa21a8efa2fb6ffa2752cf30792562d6eee9e23d74ae694da3a873ebb2c32344 not found: ID does not exist"
Sep 06 01:31:46.594454 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.594433    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"]
Sep 06 01:31:46.602125 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:46.602097    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7b006-58bfd7756c-t5q2l"]
Sep 06 01:31:47.164331 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:47.164292    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:31:47.164768 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:47.164354    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 01:31:47.209724 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:47.209692    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08cbd983-4094-488a-9c6b-1015f3cf84df" path="/var/lib/kubelet/pods/08cbd983-4094-488a-9c6b-1015f3cf84df/volumes"
Sep 06 01:31:48.164305 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.164273    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:31:48.164499 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.164321    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 01:31:48.360831 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.360781    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"]
Sep 06 01:31:48.370971 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.361677    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08cbd983-4094-488a-9c6b-1015f3cf84df" containerName="payload-processing"
Sep 06 01:31:48.371176 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.371158    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08cbd983-4094-488a-9c6b-1015f3cf84df" containerName="payload-processing"
Sep 06 01:31:48.371311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.371298    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a58c4b05-1cc9-4b39-b873-92f41507cd2d" containerName="main"
Sep 06 01:31:48.371467 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.371453    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58c4b05-1cc9-4b39-b873-92f41507cd2d" containerName="main"
Sep 06 01:31:48.371683 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.371659    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a58c4b05-1cc9-4b39-b873-92f41507cd2d" containerName="main"
Sep 06 01:31:48.371803 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.371790    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="08cbd983-4094-488a-9c6b-1015f3cf84df" containerName="payload-processing"
Sep 06 01:31:48.380728 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.380703    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"]
Sep 06 01:31:48.381025 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.381007    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.384053 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.384032    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-0b81e1-openshift-default-dockercfg-8dpgb\""
Sep 06 01:31:48.428478 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-envoy\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-istio-token\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428661 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ae1b5b3-1230-4840-beca-263db731984d-istiod-ca-cert\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428661 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-data\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428772 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428697    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-credential-socket\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428772 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-certs\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428850 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rnf\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-kube-api-access-c7rnf\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428899 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-socket\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.428899 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.428886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ae1b5b3-1230-4840-beca-263db731984d-istio-podinfo\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.529622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ae1b5b3-1230-4840-beca-263db731984d-istiod-ca-cert\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.529796 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-data\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.529796 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-credential-socket\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.529796 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-certs\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.529796 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rnf\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-kube-api-access-c7rnf\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.529796 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-socket\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530052 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ae1b5b3-1230-4840-beca-263db731984d-istio-podinfo\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530052 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529833    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-envoy\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530052 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.529938    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-istio-token\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530170 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.530123    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-credential-socket\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530436 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.530408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ae1b5b3-1230-4840-beca-263db731984d-istiod-ca-cert\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.530464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-certs\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.530473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-data\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.530675 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.530566    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-socket\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.532413 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.532382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-envoy\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.532502 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.532460    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ae1b5b3-1230-4840-beca-263db731984d-istio-podinfo\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.542442 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.542412    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-istio-token\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.542590 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.542566    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rnf\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-kube-api-access-c7rnf\") pod \"e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") " pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.692545 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.692455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:48.997567 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:48.997539    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"]
Sep 06 01:31:49.000082 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:31:49.000052    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae1b5b3_1230_4840_beca_263db731984d.slice/crio-4f57b8d93e54f0ac90b222692f18bd0f7e29681799d533a534d11955a5ffa52b WatchSource:0}: Error finding container 4f57b8d93e54f0ac90b222692f18bd0f7e29681799d533a534d11955a5ffa52b: Status 404 returned error can't find the container with id 4f57b8d93e54f0ac90b222692f18bd0f7e29681799d533a534d11955a5ffa52b
Sep 06 01:31:49.002816 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.002780    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:49.002912 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.002845    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:49.002912 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.002873    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:31:49.165055 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.164588    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:31:49.165055 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.164651    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 01:31:49.591590 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.591550    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" event={"ID":"8ae1b5b3-1230-4840-beca-263db731984d","Type":"ContainerStarted","Data":"c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"}
Sep 06 01:31:49.591832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.591610    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" event={"ID":"8ae1b5b3-1230-4840-beca-263db731984d","Type":"ContainerStarted","Data":"4f57b8d93e54f0ac90b222692f18bd0f7e29681799d533a534d11955a5ffa52b"}
Sep 06 01:31:49.613376 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.613323    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podStartSLOduration=1.613306696 podStartE2EDuration="1.613306696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:49.61159532 +0000 UTC m=+1362.886980481" watchObservedRunningTime="2026-09-06 01:31:49.613306696 +0000 UTC m=+1362.888691921"
Sep 06 01:31:49.693411 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:49.693380    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:50.168267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:50.168239    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:50.168659 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:50.168492    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:50.169239 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:50.169220    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:31:50.699253 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:50.699223    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:51.603823 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:51.603793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:31:51.604610 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:31:51.604588    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:32:06.605172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.605095    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 06 01:32:06.605172 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.605156    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 06 01:32:06.703507 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.703478    2567 generic.go:356] "Generic (PLEG): container finished" podID="8ae1b5b3-1230-4840-beca-263db731984d" containerID="c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006" exitCode=0
Sep 06 01:32:06.703663 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.703523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" event={"ID":"8ae1b5b3-1230-4840-beca-263db731984d","Type":"ContainerDied","Data":"c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"}
Sep 06 01:32:06.703940 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.703915    2567 scope.go:117] "RemoveContainer" containerID="c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"
Sep 06 01:32:06.705064 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.705034    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:32:06.705135 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.705105    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:32:06.705171 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:06.705141    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 01:32:07.711490 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:07.711455    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" event={"ID":"8ae1b5b3-1230-4840-beca-263db731984d","Type":"ContainerStarted","Data":"1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20"}
Sep 06 01:32:08.693317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:08.693280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:32:08.693496 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:08.693475    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 06 01:32:08.693549 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:08.693533    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 06 01:32:08.872441 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:08.872409    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"]
Sep 06 01:32:08.872891 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:08.872651    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9" podUID="e493a9cb-adca-4d06-99e9-4fccec3f75d5" containerName="payload-processing" containerID="cri-o://eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4" gracePeriod=30
Sep 06 01:32:09.180101 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.180077    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:32:09.351297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.351197    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e493a9cb-adca-4d06-99e9-4fccec3f75d5-plugins-config-volume\") pod \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") "
Sep 06 01:32:09.351297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.351261    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhfpz\" (UniqueName: \"kubernetes.io/projected/e493a9cb-adca-4d06-99e9-4fccec3f75d5-kube-api-access-lhfpz\") pod \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\" (UID: \"e493a9cb-adca-4d06-99e9-4fccec3f75d5\") "
Sep 06 01:32:09.352784 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.352748    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e493a9cb-adca-4d06-99e9-4fccec3f75d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e493a9cb-adca-4d06-99e9-4fccec3f75d5" (UID: "e493a9cb-adca-4d06-99e9-4fccec3f75d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:09.356947 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.355467    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e493a9cb-adca-4d06-99e9-4fccec3f75d5-kube-api-access-lhfpz" (OuterVolumeSpecName: "kube-api-access-lhfpz") pod "e493a9cb-adca-4d06-99e9-4fccec3f75d5" (UID: "e493a9cb-adca-4d06-99e9-4fccec3f75d5"). InnerVolumeSpecName "kube-api-access-lhfpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:09.453119 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.453085    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e493a9cb-adca-4d06-99e9-4fccec3f75d5-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:09.453119 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.453120    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhfpz\" (UniqueName: \"kubernetes.io/projected/e493a9cb-adca-4d06-99e9-4fccec3f75d5-kube-api-access-lhfpz\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:09.692890 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.692852    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 06 01:32:09.693087 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.692951    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 06 01:32:09.724245 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.724214    2567 generic.go:356] "Generic (PLEG): container finished" podID="e493a9cb-adca-4d06-99e9-4fccec3f75d5" containerID="eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4" exitCode=0
Sep 06 01:32:09.724421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.724260    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"
Sep 06 01:32:09.724421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.724294    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9" event={"ID":"e493a9cb-adca-4d06-99e9-4fccec3f75d5","Type":"ContainerDied","Data":"eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4"}
Sep 06 01:32:09.724421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.724353    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9" event={"ID":"e493a9cb-adca-4d06-99e9-4fccec3f75d5","Type":"ContainerDied","Data":"6a1b90e4f6c46b0364c54b24f2eec0e6dd3eb70cd2c093fce1a557966b750c2a"}
Sep 06 01:32:09.724421 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.724381    2567 scope.go:117] "RemoveContainer" containerID="eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4"
Sep 06 01:32:09.733658 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.733642    2567 scope.go:117] "RemoveContainer" containerID="eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4"
Sep 06 01:32:09.733910 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:32:09.733893    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4\": container with ID starting with eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4 not found: ID does not exist" containerID="eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4"
Sep 06 01:32:09.733997 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.733920    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4"} err="failed to get container status \"eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4\": rpc error: code = NotFound desc = could not find container \"eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4\": container with ID starting with eb63c6805af59c762fac28d35d93303b070f569e6e94240ac5bc6034a6b836a4 not found: ID does not exist"
Sep 06 01:32:09.747529 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.747491    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"]
Sep 06 01:32:09.763432 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:09.763405    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-20a262-6fd6dbc5f9-ngfn9"]
Sep 06 01:32:10.693057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:10.693021    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 06 01:32:10.693425 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:10.693076    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 06 01:32:11.208482 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:11.208439    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e493a9cb-adca-4d06-99e9-4fccec3f75d5" path="/var/lib/kubelet/pods/e493a9cb-adca-4d06-99e9-4fccec3f75d5/volumes"
Sep 06 01:32:11.693609 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:11.693577    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 06 01:32:11.693989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:11.693646    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 06 01:32:12.705848 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:12.705815    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:32:12.706319 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:12.706195    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:32:12.707036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:12.707013    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:32:16.060132 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.060097    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"]
Sep 06 01:32:16.060537 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.060524    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e493a9cb-adca-4d06-99e9-4fccec3f75d5" containerName="payload-processing"
Sep 06 01:32:16.060579 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.060538    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e493a9cb-adca-4d06-99e9-4fccec3f75d5" containerName="payload-processing"
Sep 06 01:32:16.060621 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.060612    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e493a9cb-adca-4d06-99e9-4fccec3f75d5" containerName="payload-processing"
Sep 06 01:32:16.063773 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.063756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:16.066074 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.066053    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:32:16.066174 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.066062    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:32:16.071285 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.071253    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"]
Sep 06 01:32:16.118673 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.118645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f54fffc-9d67-4f58-a2b9-3be7aa94e193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb\" (UID: \"2f54fffc-9d67-4f58-a2b9-3be7aa94e193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:16.219299 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.219274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f54fffc-9d67-4f58-a2b9-3be7aa94e193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb\" (UID: \"2f54fffc-9d67-4f58-a2b9-3be7aa94e193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:16.219902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.219883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f54fffc-9d67-4f58-a2b9-3be7aa94e193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb\" (UID: \"2f54fffc-9d67-4f58-a2b9-3be7aa94e193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:16.376531 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.376460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:16.644415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.644382    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"]
Sep 06 01:32:16.645167 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:32:16.645140    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f54fffc_9d67_4f58_a2b9_3be7aa94e193.slice/crio-e9b1f7bc535e237b2ab4422727c94b8bd19ae9fe0688d402736a68fa90bc0b2f WatchSource:0}: Error finding container e9b1f7bc535e237b2ab4422727c94b8bd19ae9fe0688d402736a68fa90bc0b2f: Status 404 returned error can't find the container with id e9b1f7bc535e237b2ab4422727c94b8bd19ae9fe0688d402736a68fa90bc0b2f
Sep 06 01:32:16.766079 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:16.766043    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb" event={"ID":"2f54fffc-9d67-4f58-a2b9-3be7aa94e193","Type":"ContainerStarted","Data":"e9b1f7bc535e237b2ab4422727c94b8bd19ae9fe0688d402736a68fa90bc0b2f"}
Sep 06 01:32:17.385536 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:32:17.385508    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f54fffc_9d67_4f58_a2b9_3be7aa94e193.slice/crio-25ad806705a9bf95eca1989d1c4822312e8d34cbc8ee6803bc7f9aae2c8d2046.scope\": RecentStats: unable to find data in memory cache]"
Sep 06 01:32:17.773326 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:17.773290    2567 generic.go:356] "Generic (PLEG): container finished" podID="2f54fffc-9d67-4f58-a2b9-3be7aa94e193" containerID="25ad806705a9bf95eca1989d1c4822312e8d34cbc8ee6803bc7f9aae2c8d2046" exitCode=0
Sep 06 01:32:17.773490 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:17.773373    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb" event={"ID":"2f54fffc-9d67-4f58-a2b9-3be7aa94e193","Type":"ContainerDied","Data":"25ad806705a9bf95eca1989d1c4822312e8d34cbc8ee6803bc7f9aae2c8d2046"}
Sep 06 01:32:18.913492 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:18.913469    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:18.942325 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:18.942301    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f54fffc-9d67-4f58-a2b9-3be7aa94e193-maas-api-service-ca\") pod \"2f54fffc-9d67-4f58-a2b9-3be7aa94e193\" (UID: \"2f54fffc-9d67-4f58-a2b9-3be7aa94e193\") "
Sep 06 01:32:18.942673 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:18.942650    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f54fffc-9d67-4f58-a2b9-3be7aa94e193-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f54fffc-9d67-4f58-a2b9-3be7aa94e193" (UID: "2f54fffc-9d67-4f58-a2b9-3be7aa94e193"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:18.942730 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:18.942709    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f54fffc-9d67-4f58-a2b9-3be7aa94e193-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:19.786173 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:19.786143    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"
Sep 06 01:32:19.786345 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:19.786187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb" event={"ID":"2f54fffc-9d67-4f58-a2b9-3be7aa94e193","Type":"ContainerDied","Data":"e9b1f7bc535e237b2ab4422727c94b8bd19ae9fe0688d402736a68fa90bc0b2f"}
Sep 06 01:32:19.786345 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:19.786231    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9b1f7bc535e237b2ab4422727c94b8bd19ae9fe0688d402736a68fa90bc0b2f"
Sep 06 01:32:21.744243 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:21.744213    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dwbm4_db0b0d71-b56d-49ef-a3ed-eaa7acce9c60/payload-processing/0.log"
Sep 06 01:32:26.464084 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.464043    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"]
Sep 06 01:32:26.464542 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.464305    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx" podUID="e39784e2-16f8-4451-91a2-dcfc30880499" containerName="payload-processing" containerID="cri-o://9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b" gracePeriod=30
Sep 06 01:32:26.473224 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.473049    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"]
Sep 06 01:32:26.473306 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.473243    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg" podUID="39eabec5-eadc-4b47-8fb0-1f3211139c00" containerName="payload-pre-processing" containerID="cri-o://c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a" gracePeriod=30
Sep 06 01:32:26.619511 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.619465    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"]
Sep 06 01:32:26.623343 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.623312    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-49c9de-wskwb"]
Sep 06 01:32:26.748367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.748345    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:32:26.776716 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.776692    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:32:26.811266 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.811235    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39eabec5-eadc-4b47-8fb0-1f3211139c00-plugins-config-volume\") pod \"39eabec5-eadc-4b47-8fb0-1f3211139c00\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") "
Sep 06 01:32:26.811385 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.811279    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39784e2-16f8-4451-91a2-dcfc30880499-plugins-config-volume\") pod \"e39784e2-16f8-4451-91a2-dcfc30880499\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") "
Sep 06 01:32:26.811385 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.811374    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhjsw\" (UniqueName: \"kubernetes.io/projected/39eabec5-eadc-4b47-8fb0-1f3211139c00-kube-api-access-mhjsw\") pod \"39eabec5-eadc-4b47-8fb0-1f3211139c00\" (UID: \"39eabec5-eadc-4b47-8fb0-1f3211139c00\") "
Sep 06 01:32:26.811509 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.811428    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k7wr\" (UniqueName: \"kubernetes.io/projected/e39784e2-16f8-4451-91a2-dcfc30880499-kube-api-access-4k7wr\") pod \"e39784e2-16f8-4451-91a2-dcfc30880499\" (UID: \"e39784e2-16f8-4451-91a2-dcfc30880499\") "
Sep 06 01:32:26.811703 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.811665    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39eabec5-eadc-4b47-8fb0-1f3211139c00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39eabec5-eadc-4b47-8fb0-1f3211139c00" (UID: "39eabec5-eadc-4b47-8fb0-1f3211139c00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:26.811818 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.811719    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e39784e2-16f8-4451-91a2-dcfc30880499-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e39784e2-16f8-4451-91a2-dcfc30880499" (UID: "e39784e2-16f8-4451-91a2-dcfc30880499"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:26.813422 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.813402    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39784e2-16f8-4451-91a2-dcfc30880499-kube-api-access-4k7wr" (OuterVolumeSpecName: "kube-api-access-4k7wr") pod "e39784e2-16f8-4451-91a2-dcfc30880499" (UID: "e39784e2-16f8-4451-91a2-dcfc30880499"). InnerVolumeSpecName "kube-api-access-4k7wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:26.813495 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.813481    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39eabec5-eadc-4b47-8fb0-1f3211139c00-kube-api-access-mhjsw" (OuterVolumeSpecName: "kube-api-access-mhjsw") pod "39eabec5-eadc-4b47-8fb0-1f3211139c00" (UID: "39eabec5-eadc-4b47-8fb0-1f3211139c00"). InnerVolumeSpecName "kube-api-access-mhjsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:26.825832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.825810    2567 generic.go:356] "Generic (PLEG): container finished" podID="e39784e2-16f8-4451-91a2-dcfc30880499" containerID="9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b" exitCode=0
Sep 06 01:32:26.825917 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.825850    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"
Sep 06 01:32:26.825917 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.825887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx" event={"ID":"e39784e2-16f8-4451-91a2-dcfc30880499","Type":"ContainerDied","Data":"9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b"}
Sep 06 01:32:26.826041 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.825985    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx" event={"ID":"e39784e2-16f8-4451-91a2-dcfc30880499","Type":"ContainerDied","Data":"e995ba68f0239528b59c9f4866ca8d36268f9ebb29d42d99029c0f67d96d6721"}
Sep 06 01:32:26.826041 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.826015    2567 scope.go:117] "RemoveContainer" containerID="9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b"
Sep 06 01:32:26.827256 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.827231    2567 generic.go:356] "Generic (PLEG): container finished" podID="39eabec5-eadc-4b47-8fb0-1f3211139c00" containerID="c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a" exitCode=0
Sep 06 01:32:26.827365 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.827256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg" event={"ID":"39eabec5-eadc-4b47-8fb0-1f3211139c00","Type":"ContainerDied","Data":"c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a"}
Sep 06 01:32:26.827365 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.827273    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"
Sep 06 01:32:26.827365 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.827295    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg" event={"ID":"39eabec5-eadc-4b47-8fb0-1f3211139c00","Type":"ContainerDied","Data":"54f1add5ea6752b5005e9929508660b6158a76faf56920509496259601069b4f"}
Sep 06 01:32:26.836081 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.836064    2567 scope.go:117] "RemoveContainer" containerID="9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b"
Sep 06 01:32:26.836397 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:32:26.836380    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b\": container with ID starting with 9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b not found: ID does not exist" containerID="9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b"
Sep 06 01:32:26.836449 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.836404    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b"} err="failed to get container status \"9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b\": rpc error: code = NotFound desc = could not find container \"9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b\": container with ID starting with 9fb5aeb41c53bc6184339f6c9d1ba31eefa41dcac6590c461fdb497cc5da477b not found: ID does not exist"
Sep 06 01:32:26.836449 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.836421    2567 scope.go:117] "RemoveContainer" containerID="c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a"
Sep 06 01:32:26.844234 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.844219    2567 scope.go:117] "RemoveContainer" containerID="c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a"
Sep 06 01:32:26.844487 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:32:26.844471    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a\": container with ID starting with c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a not found: ID does not exist" containerID="c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a"
Sep 06 01:32:26.844522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.844496    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a"} err="failed to get container status \"c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a\": rpc error: code = NotFound desc = could not find container \"c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a\": container with ID starting with c319ca1e6631335a4fd54e5b00978cb206e4716182644b18ad50591f0078825a not found: ID does not exist"
Sep 06 01:32:26.850967 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.850946    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"]
Sep 06 01:32:26.854728 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.854710    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-49c9de-585c88bc7d-7q5kg"]
Sep 06 01:32:26.864270 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.864242    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"]
Sep 06 01:32:26.868123 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.868105    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-49c9de-79779fcd5c-n5zgx"]
Sep 06 01:32:26.912697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.912677    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39eabec5-eadc-4b47-8fb0-1f3211139c00-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:26.912697 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.912695    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39784e2-16f8-4451-91a2-dcfc30880499-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:26.912806 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.912705    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhjsw\" (UniqueName: \"kubernetes.io/projected/39eabec5-eadc-4b47-8fb0-1f3211139c00-kube-api-access-mhjsw\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:26.912806 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:26.912712    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k7wr\" (UniqueName: \"kubernetes.io/projected/e39784e2-16f8-4451-91a2-dcfc30880499-kube-api-access-4k7wr\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:27.214442 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:27.214402    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f54fffc-9d67-4f58-a2b9-3be7aa94e193" path="/var/lib/kubelet/pods/2f54fffc-9d67-4f58-a2b9-3be7aa94e193/volumes"
Sep 06 01:32:27.214858 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:27.214839    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39eabec5-eadc-4b47-8fb0-1f3211139c00" path="/var/lib/kubelet/pods/39eabec5-eadc-4b47-8fb0-1f3211139c00/volumes"
Sep 06 01:32:27.215262 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:27.215245    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39784e2-16f8-4451-91a2-dcfc30880499" path="/var/lib/kubelet/pods/e39784e2-16f8-4451-91a2-dcfc30880499/volumes"
Sep 06 01:32:33.300883 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.300846    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"]
Sep 06 01:32:33.301293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301277    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39784e2-16f8-4451-91a2-dcfc30880499" containerName="payload-processing"
Sep 06 01:32:33.301293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301289    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39784e2-16f8-4451-91a2-dcfc30880499" containerName="payload-processing"
Sep 06 01:32:33.301367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301306    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39eabec5-eadc-4b47-8fb0-1f3211139c00" containerName="payload-pre-processing"
Sep 06 01:32:33.301367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301312    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="39eabec5-eadc-4b47-8fb0-1f3211139c00" containerName="payload-pre-processing"
Sep 06 01:32:33.301367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301319    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f54fffc-9d67-4f58-a2b9-3be7aa94e193" containerName="revoke-keys"
Sep 06 01:32:33.301367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301324    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f54fffc-9d67-4f58-a2b9-3be7aa94e193" containerName="revoke-keys"
Sep 06 01:32:33.301487 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301382    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f54fffc-9d67-4f58-a2b9-3be7aa94e193" containerName="revoke-keys"
Sep 06 01:32:33.301487 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301392    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39784e2-16f8-4451-91a2-dcfc30880499" containerName="payload-processing"
Sep 06 01:32:33.301487 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.301398    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="39eabec5-eadc-4b47-8fb0-1f3211139c00" containerName="payload-pre-processing"
Sep 06 01:32:33.304242 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.304226    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:33.306786 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.306764    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:32:33.306902 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.306765    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:32:33.312693 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.312671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"]
Sep 06 01:32:33.368073 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.368040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e2feea-9eac-45c9-b1ae-53e38a50c5db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9\" (UID: \"79e2feea-9eac-45c9-b1ae-53e38a50c5db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:33.469216 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.469188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e2feea-9eac-45c9-b1ae-53e38a50c5db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9\" (UID: \"79e2feea-9eac-45c9-b1ae-53e38a50c5db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:33.469803 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.469786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e2feea-9eac-45c9-b1ae-53e38a50c5db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9\" (UID: \"79e2feea-9eac-45c9-b1ae-53e38a50c5db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:33.616530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.616451    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:33.885961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:33.885920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"]
Sep 06 01:32:33.886759 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:32:33.886733    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e2feea_9eac_45c9_b1ae_53e38a50c5db.slice/crio-34e2b77ea1150c468b65784db5175330b83b0ab1c7e019fc54e3801980968cb9 WatchSource:0}: Error finding container 34e2b77ea1150c468b65784db5175330b83b0ab1c7e019fc54e3801980968cb9: Status 404 returned error can't find the container with id 34e2b77ea1150c468b65784db5175330b83b0ab1c7e019fc54e3801980968cb9
Sep 06 01:32:34.874829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:34.874749    2567 generic.go:356] "Generic (PLEG): container finished" podID="79e2feea-9eac-45c9-b1ae-53e38a50c5db" containerID="43b0a1c52d69ed72f380148d021d55556ded4cbbb161d9cb16222fe4e251584c" exitCode=0
Sep 06 01:32:34.874829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:34.874796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9" event={"ID":"79e2feea-9eac-45c9-b1ae-53e38a50c5db","Type":"ContainerDied","Data":"43b0a1c52d69ed72f380148d021d55556ded4cbbb161d9cb16222fe4e251584c"}
Sep 06 01:32:34.875218 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:34.874837    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9" event={"ID":"79e2feea-9eac-45c9-b1ae-53e38a50c5db","Type":"ContainerStarted","Data":"34e2b77ea1150c468b65784db5175330b83b0ab1c7e019fc54e3801980968cb9"}
Sep 06 01:32:36.011121 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.011098    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:36.093394 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.093370    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e2feea-9eac-45c9-b1ae-53e38a50c5db-maas-api-service-ca\") pod \"79e2feea-9eac-45c9-b1ae-53e38a50c5db\" (UID: \"79e2feea-9eac-45c9-b1ae-53e38a50c5db\") "
Sep 06 01:32:36.093700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.093681    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79e2feea-9eac-45c9-b1ae-53e38a50c5db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79e2feea-9eac-45c9-b1ae-53e38a50c5db" (UID: "79e2feea-9eac-45c9-b1ae-53e38a50c5db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:36.194171 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.194150    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e2feea-9eac-45c9-b1ae-53e38a50c5db-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:36.887272 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.887244    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"
Sep 06 01:32:36.887500 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.887284    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9" event={"ID":"79e2feea-9eac-45c9-b1ae-53e38a50c5db","Type":"ContainerDied","Data":"34e2b77ea1150c468b65784db5175330b83b0ab1c7e019fc54e3801980968cb9"}
Sep 06 01:32:36.887500 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:36.887331    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34e2b77ea1150c468b65784db5175330b83b0ab1c7e019fc54e3801980968cb9"
Sep 06 01:32:43.835045 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:43.835008    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"]
Sep 06 01:32:43.837448 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:43.837423    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-bff89d-29810970-bnszm"]
Sep 06 01:32:43.869711 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:43.869674    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"]
Sep 06 01:32:43.869989 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:43.869962    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp" podUID="d3434950-8cf7-4a9b-bdbb-097ca39f0c49" containerName="payload-pre-processing" containerID="cri-o://81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e" gracePeriod=30
Sep 06 01:32:44.028023 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.027991    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"]
Sep 06 01:32:44.034068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.034039    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-bff89d-6ptf9"]
Sep 06 01:32:44.112784 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.112752    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:32:44.173642 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.173610    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbxrk\" (UniqueName: \"kubernetes.io/projected/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-kube-api-access-gbxrk\") pod \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") "
Sep 06 01:32:44.173811 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.173656    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-plugins-config-volume\") pod \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\" (UID: \"d3434950-8cf7-4a9b-bdbb-097ca39f0c49\") "
Sep 06 01:32:44.174102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.174072    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3434950-8cf7-4a9b-bdbb-097ca39f0c49" (UID: "d3434950-8cf7-4a9b-bdbb-097ca39f0c49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:44.175784 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.175757    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-kube-api-access-gbxrk" (OuterVolumeSpecName: "kube-api-access-gbxrk") pod "d3434950-8cf7-4a9b-bdbb-097ca39f0c49" (UID: "d3434950-8cf7-4a9b-bdbb-097ca39f0c49"). InnerVolumeSpecName "kube-api-access-gbxrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:44.274751 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.274720    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbxrk\" (UniqueName: \"kubernetes.io/projected/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-kube-api-access-gbxrk\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.274751 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.274745    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3434950-8cf7-4a9b-bdbb-097ca39f0c49-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.938907 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.938873    2567 generic.go:356] "Generic (PLEG): container finished" podID="d3434950-8cf7-4a9b-bdbb-097ca39f0c49" containerID="81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e" exitCode=0
Sep 06 01:32:44.939403 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.938924    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"
Sep 06 01:32:44.939403 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.938967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp" event={"ID":"d3434950-8cf7-4a9b-bdbb-097ca39f0c49","Type":"ContainerDied","Data":"81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e"}
Sep 06 01:32:44.939403 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.939035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp" event={"ID":"d3434950-8cf7-4a9b-bdbb-097ca39f0c49","Type":"ContainerDied","Data":"e00078201891d83d0aa9015dd910ec05db964cb67da54f72ff97163c8ed60dbf"}
Sep 06 01:32:44.939403 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.939072    2567 scope.go:117] "RemoveContainer" containerID="81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e"
Sep 06 01:32:44.948433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.948416    2567 scope.go:117] "RemoveContainer" containerID="81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e"
Sep 06 01:32:44.948708 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:32:44.948689    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e\": container with ID starting with 81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e not found: ID does not exist" containerID="81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e"
Sep 06 01:32:44.948759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.948717    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e"} err="failed to get container status \"81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e\": rpc error: code = NotFound desc = could not find container \"81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e\": container with ID starting with 81e73a50427feee0550ae3a5882ea24e3c69cbe9456d27ee18357c5901428d6e not found: ID does not exist"
Sep 06 01:32:44.960941 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.960900    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"]
Sep 06 01:32:44.966452 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:44.966432    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff89d-d9b59cf6b-wg8kp"]
Sep 06 01:32:45.208197 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:45.208117    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd49ad3-c980-4b85-81b2-990baea25126" path="/var/lib/kubelet/pods/5dd49ad3-c980-4b85-81b2-990baea25126/volumes"
Sep 06 01:32:45.208408 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:45.208395    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79e2feea-9eac-45c9-b1ae-53e38a50c5db" path="/var/lib/kubelet/pods/79e2feea-9eac-45c9-b1ae-53e38a50c5db/volumes"
Sep 06 01:32:45.208709 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:32:45.208698    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3434950-8cf7-4a9b-bdbb-097ca39f0c49" path="/var/lib/kubelet/pods/d3434950-8cf7-4a9b-bdbb-097ca39f0c49/volumes"
Sep 06 01:33:23.299967 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:23.299910    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dwbm4_db0b0d71-b56d-49ef-a3ed-eaa7acce9c60/payload-processing/0.log"
Sep 06 01:33:29.289411 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289377    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"]
Sep 06 01:33:29.289791 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289778    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3434950-8cf7-4a9b-bdbb-097ca39f0c49" containerName="payload-pre-processing"
Sep 06 01:33:29.289835 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289792    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3434950-8cf7-4a9b-bdbb-097ca39f0c49" containerName="payload-pre-processing"
Sep 06 01:33:29.289835 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289805    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e2feea-9eac-45c9-b1ae-53e38a50c5db" containerName="revoke-keys"
Sep 06 01:33:29.289835 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289814    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e2feea-9eac-45c9-b1ae-53e38a50c5db" containerName="revoke-keys"
Sep 06 01:33:29.289958 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289870    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3434950-8cf7-4a9b-bdbb-097ca39f0c49" containerName="payload-pre-processing"
Sep 06 01:33:29.289958 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.289879    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e2feea-9eac-45c9-b1ae-53e38a50c5db" containerName="revoke-keys"
Sep 06 01:33:29.293037 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.293020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.295669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.295647    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-e805e0\""
Sep 06 01:33:29.295669 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.295658    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-e805e0-dockercfg-r5gww\""
Sep 06 01:33:29.304428 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.304407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"]
Sep 06 01:33:29.327036 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.327015    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"]
Sep 06 01:33:29.330454 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.330429    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.340460 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.340433    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"]
Sep 06 01:33:29.359458 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.359432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkr5k\" (UniqueName: \"kubernetes.io/projected/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-kube-api-access-fkr5k\") pod \"payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.359574 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.359500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.460367 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.460329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0e334c-f07d-44c5-819f-378efe4c55fd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.460557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.460379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fhn\" (UniqueName: \"kubernetes.io/projected/dc0e334c-f07d-44c5-819f-378efe4c55fd-kube-api-access-w2fhn\") pod \"payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.460557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.460469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkr5k\" (UniqueName: \"kubernetes.io/projected/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-kube-api-access-fkr5k\") pod \"payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.460557 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.460524    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.461274 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.461256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.470694 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.470664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkr5k\" (UniqueName: \"kubernetes.io/projected/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-kube-api-access-fkr5k\") pod \"payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.561626 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.561560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fhn\" (UniqueName: \"kubernetes.io/projected/dc0e334c-f07d-44c5-819f-378efe4c55fd-kube-api-access-w2fhn\") pod \"payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.561759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.561662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0e334c-f07d-44c5-819f-378efe4c55fd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.562299 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.562280    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0e334c-f07d-44c5-819f-378efe4c55fd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.573776 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.573758    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fhn\" (UniqueName: \"kubernetes.io/projected/dc0e334c-f07d-44c5-819f-378efe4c55fd-kube-api-access-w2fhn\") pod \"payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.603716 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.603691    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:29.640949 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.640247    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:29.876592 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.876562    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"]
Sep 06 01:33:29.877829 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:33:29.877774    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a24bf8_31ba_4a35_b1a2_0cee72d454b0.slice/crio-44e57b36c6c77e5b8ba7ae630406794f7aa18dfb7927f67abdeaba02cb8bf83d WatchSource:0}: Error finding container 44e57b36c6c77e5b8ba7ae630406794f7aa18dfb7927f67abdeaba02cb8bf83d: Status 404 returned error can't find the container with id 44e57b36c6c77e5b8ba7ae630406794f7aa18dfb7927f67abdeaba02cb8bf83d
Sep 06 01:33:29.925254 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:33:29.925229    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0e334c_f07d_44c5_819f_378efe4c55fd.slice/crio-8a94f01657330459fdf07e8f6bc8674ab900a61b226580e0e40d444e3bd525ac WatchSource:0}: Error finding container 8a94f01657330459fdf07e8f6bc8674ab900a61b226580e0e40d444e3bd525ac: Status 404 returned error can't find the container with id 8a94f01657330459fdf07e8f6bc8674ab900a61b226580e0e40d444e3bd525ac
Sep 06 01:33:29.926135 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:29.926110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"]
Sep 06 01:33:30.207451 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.207418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl" event={"ID":"dc0e334c-f07d-44c5-819f-378efe4c55fd","Type":"ContainerStarted","Data":"ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678"}
Sep 06 01:33:30.207632 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.207559    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:30.207632 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.207595    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl" event={"ID":"dc0e334c-f07d-44c5-819f-378efe4c55fd","Type":"ContainerStarted","Data":"8a94f01657330459fdf07e8f6bc8674ab900a61b226580e0e40d444e3bd525ac"}
Sep 06 01:33:30.209068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.209046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2" event={"ID":"04a24bf8-31ba-4a35-b1a2-0cee72d454b0","Type":"ContainerStarted","Data":"7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8"}
Sep 06 01:33:30.209191 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.209083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2" event={"ID":"04a24bf8-31ba-4a35-b1a2-0cee72d454b0","Type":"ContainerStarted","Data":"44e57b36c6c77e5b8ba7ae630406794f7aa18dfb7927f67abdeaba02cb8bf83d"}
Sep 06 01:33:30.209191 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.209126    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:30.225790 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.225751    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl" podStartSLOduration=1.225738258 podStartE2EDuration="1.225738258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:33:30.222184723 +0000 UTC m=+1463.497569888" watchObservedRunningTime="2026-09-06 01:33:30.225738258 +0000 UTC m=+1463.501123420"
Sep 06 01:33:30.237732 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:30.237698    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2" podStartSLOduration=1.237686744 podStartE2EDuration="1.237686744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:33:30.236218961 +0000 UTC m=+1463.511604126" watchObservedRunningTime="2026-09-06 01:33:30.237686744 +0000 UTC m=+1463.513071907"
Sep 06 01:33:41.216360 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:41.216332    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:41.216732 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:41.216386    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:53.187375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.187341    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"]
Sep 06 01:33:53.191185 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.191163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:53.193553 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.193524    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:33:53.193664 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.193557    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:33:53.198373 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.198349    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"]
Sep 06 01:33:53.373740 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.373709    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01726d6b-b4e8-4512-b48b-863be2917f3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2\" (UID: \"01726d6b-b4e8-4512-b48b-863be2917f3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:53.474643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.474553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01726d6b-b4e8-4512-b48b-863be2917f3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2\" (UID: \"01726d6b-b4e8-4512-b48b-863be2917f3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:53.475171 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.475153    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01726d6b-b4e8-4512-b48b-863be2917f3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2\" (UID: \"01726d6b-b4e8-4512-b48b-863be2917f3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:53.504108 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.504082    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:53.773986 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:53.773962    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"]
Sep 06 01:33:53.775828 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:33:53.775799    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01726d6b_b4e8_4512_b48b_863be2917f3b.slice/crio-c42f82adfd1990385235163ff741f8ae5da2eb2d8f7654d47f580d39086b1b11 WatchSource:0}: Error finding container c42f82adfd1990385235163ff741f8ae5da2eb2d8f7654d47f580d39086b1b11: Status 404 returned error can't find the container with id c42f82adfd1990385235163ff741f8ae5da2eb2d8f7654d47f580d39086b1b11
Sep 06 01:33:54.344660 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:54.344573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2" event={"ID":"01726d6b-b4e8-4512-b48b-863be2917f3b","Type":"ContainerStarted","Data":"ff809d5cc0514dae00422df52e73ceb5ee9d46b00c90400424ed149fcdf3bdfc"}
Sep 06 01:33:54.344660 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:54.344635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2" event={"ID":"01726d6b-b4e8-4512-b48b-863be2917f3b","Type":"ContainerStarted","Data":"c42f82adfd1990385235163ff741f8ae5da2eb2d8f7654d47f580d39086b1b11"}
Sep 06 01:33:54.364066 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:54.364013    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2" podStartSLOduration=1.3639986020000001 podStartE2EDuration="1.363998602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:33:54.362809363 +0000 UTC m=+1487.638194537" watchObservedRunningTime="2026-09-06 01:33:54.363998602 +0000 UTC m=+1487.639383796"
Sep 06 01:33:55.351415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:55.351379    2567 generic.go:356] "Generic (PLEG): container finished" podID="01726d6b-b4e8-4512-b48b-863be2917f3b" containerID="ff809d5cc0514dae00422df52e73ceb5ee9d46b00c90400424ed149fcdf3bdfc" exitCode=0
Sep 06 01:33:55.351845 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:55.351423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2" event={"ID":"01726d6b-b4e8-4512-b48b-863be2917f3b","Type":"ContainerDied","Data":"ff809d5cc0514dae00422df52e73ceb5ee9d46b00c90400424ed149fcdf3bdfc"}
Sep 06 01:33:56.495407 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:56.495386    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:56.601457 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:56.601425    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01726d6b-b4e8-4512-b48b-863be2917f3b-maas-api-service-ca\") pod \"01726d6b-b4e8-4512-b48b-863be2917f3b\" (UID: \"01726d6b-b4e8-4512-b48b-863be2917f3b\") "
Sep 06 01:33:56.601755 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:56.601733    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01726d6b-b4e8-4512-b48b-863be2917f3b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01726d6b-b4e8-4512-b48b-863be2917f3b" (UID: "01726d6b-b4e8-4512-b48b-863be2917f3b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:33:56.702399 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:56.702375    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01726d6b-b4e8-4512-b48b-863be2917f3b-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:33:57.363604 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:57.363576    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"
Sep 06 01:33:57.363789 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:57.363614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2" event={"ID":"01726d6b-b4e8-4512-b48b-863be2917f3b","Type":"ContainerDied","Data":"c42f82adfd1990385235163ff741f8ae5da2eb2d8f7654d47f580d39086b1b11"}
Sep 06 01:33:57.363789 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:57.363661    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c42f82adfd1990385235163ff741f8ae5da2eb2d8f7654d47f580d39086b1b11"
Sep 06 01:33:59.306759 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.306728    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"]
Sep 06 01:33:59.307271 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.306961    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl" podUID="dc0e334c-f07d-44c5-819f-378efe4c55fd" containerName="payload-processing" containerID="cri-o://ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678" gracePeriod=30
Sep 06 01:33:59.317625 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.317601    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"]
Sep 06 01:33:59.318491 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.318120    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2" podUID="04a24bf8-31ba-4a35-b1a2-0cee72d454b0" containerName="payload-pre-processing" containerID="cri-o://7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8" gracePeriod=30
Sep 06 01:33:59.457494 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.457448    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"]
Sep 06 01:33:59.460878 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.460851    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e805e0-4q7z2"]
Sep 06 01:33:59.609603 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.609583    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:33:59.612652 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.612635    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:33:59.727575 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.727545    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2fhn\" (UniqueName: \"kubernetes.io/projected/dc0e334c-f07d-44c5-819f-378efe4c55fd-kube-api-access-w2fhn\") pod \"dc0e334c-f07d-44c5-819f-378efe4c55fd\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") "
Sep 06 01:33:59.727760 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.727653    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkr5k\" (UniqueName: \"kubernetes.io/projected/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-kube-api-access-fkr5k\") pod \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") "
Sep 06 01:33:59.727760 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.727687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-plugins-config-volume\") pod \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\" (UID: \"04a24bf8-31ba-4a35-b1a2-0cee72d454b0\") "
Sep 06 01:33:59.727760 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.727745    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0e334c-f07d-44c5-819f-378efe4c55fd-plugins-config-volume\") pod \"dc0e334c-f07d-44c5-819f-378efe4c55fd\" (UID: \"dc0e334c-f07d-44c5-819f-378efe4c55fd\") "
Sep 06 01:33:59.728180 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.728152    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04a24bf8-31ba-4a35-b1a2-0cee72d454b0" (UID: "04a24bf8-31ba-4a35-b1a2-0cee72d454b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:33:59.728293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.728236    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc0e334c-f07d-44c5-819f-378efe4c55fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc0e334c-f07d-44c5-819f-378efe4c55fd" (UID: "dc0e334c-f07d-44c5-819f-378efe4c55fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:33:59.729693 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.729665    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc0e334c-f07d-44c5-819f-378efe4c55fd-kube-api-access-w2fhn" (OuterVolumeSpecName: "kube-api-access-w2fhn") pod "dc0e334c-f07d-44c5-819f-378efe4c55fd" (UID: "dc0e334c-f07d-44c5-819f-378efe4c55fd"). InnerVolumeSpecName "kube-api-access-w2fhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:33:59.729788 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.729691    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-kube-api-access-fkr5k" (OuterVolumeSpecName: "kube-api-access-fkr5k") pod "04a24bf8-31ba-4a35-b1a2-0cee72d454b0" (UID: "04a24bf8-31ba-4a35-b1a2-0cee72d454b0"). InnerVolumeSpecName "kube-api-access-fkr5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:33:59.829406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.829371    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkr5k\" (UniqueName: \"kubernetes.io/projected/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-kube-api-access-fkr5k\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:33:59.829406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.829402    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04a24bf8-31ba-4a35-b1a2-0cee72d454b0-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:33:59.829406 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.829411    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0e334c-f07d-44c5-819f-378efe4c55fd-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:33:59.829623 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:33:59.829420    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2fhn\" (UniqueName: \"kubernetes.io/projected/dc0e334c-f07d-44c5-819f-378efe4c55fd-kube-api-access-w2fhn\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:34:00.383024 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.382984    2567 generic.go:356] "Generic (PLEG): container finished" podID="04a24bf8-31ba-4a35-b1a2-0cee72d454b0" containerID="7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8" exitCode=0
Sep 06 01:34:00.383464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.383040    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"
Sep 06 01:34:00.383464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.383073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2" event={"ID":"04a24bf8-31ba-4a35-b1a2-0cee72d454b0","Type":"ContainerDied","Data":"7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8"}
Sep 06 01:34:00.383464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.383126    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2" event={"ID":"04a24bf8-31ba-4a35-b1a2-0cee72d454b0","Type":"ContainerDied","Data":"44e57b36c6c77e5b8ba7ae630406794f7aa18dfb7927f67abdeaba02cb8bf83d"}
Sep 06 01:34:00.383464 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.383156    2567 scope.go:117] "RemoveContainer" containerID="7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8"
Sep 06 01:34:00.384752 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.384725    2567 generic.go:356] "Generic (PLEG): container finished" podID="dc0e334c-f07d-44c5-819f-378efe4c55fd" containerID="ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678" exitCode=0
Sep 06 01:34:00.384851 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.384800    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"
Sep 06 01:34:00.384851 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.384833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl" event={"ID":"dc0e334c-f07d-44c5-819f-378efe4c55fd","Type":"ContainerDied","Data":"ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678"}
Sep 06 01:34:00.384984 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.384875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl" event={"ID":"dc0e334c-f07d-44c5-819f-378efe4c55fd","Type":"ContainerDied","Data":"8a94f01657330459fdf07e8f6bc8674ab900a61b226580e0e40d444e3bd525ac"}
Sep 06 01:34:00.392569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.392552    2567 scope.go:117] "RemoveContainer" containerID="7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8"
Sep 06 01:34:00.392886 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:34:00.392865    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8\": container with ID starting with 7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8 not found: ID does not exist" containerID="7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8"
Sep 06 01:34:00.392998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.392898    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8"} err="failed to get container status \"7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8\": rpc error: code = NotFound desc = could not find container \"7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8\": container with ID starting with 7904f69d50657e650db6716bdb97bedeeeea6975b17f6fed9a5d1996d8a625d8 not found: ID does not exist"
Sep 06 01:34:00.392998 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.392921    2567 scope.go:117] "RemoveContainer" containerID="ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678"
Sep 06 01:34:00.401090 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.401074    2567 scope.go:117] "RemoveContainer" containerID="ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678"
Sep 06 01:34:00.401343 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:34:00.401322    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678\": container with ID starting with ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678 not found: ID does not exist" containerID="ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678"
Sep 06 01:34:00.401390 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.401350    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678"} err="failed to get container status \"ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678\": rpc error: code = NotFound desc = could not find container \"ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678\": container with ID starting with ce7809e4177769b4e91461555588a61d9d5bf09410ecd4f0b328f838b1139678 not found: ID does not exist"
Sep 06 01:34:00.409419 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.409400    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"]
Sep 06 01:34:00.412681 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.412662    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e805e0-64fd658c8f-m5rrl"]
Sep 06 01:34:00.423689 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.423663    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"]
Sep 06 01:34:00.426821 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:00.426796    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e805e0-64b5579446-vhjq2"]
Sep 06 01:34:01.207810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:01.207772    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01726d6b-b4e8-4512-b48b-863be2917f3b" path="/var/lib/kubelet/pods/01726d6b-b4e8-4512-b48b-863be2917f3b/volumes"
Sep 06 01:34:01.208337 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:01.208316    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a24bf8-31ba-4a35-b1a2-0cee72d454b0" path="/var/lib/kubelet/pods/04a24bf8-31ba-4a35-b1a2-0cee72d454b0/volumes"
Sep 06 01:34:01.208786 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:01.208770    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc0e334c-f07d-44c5-819f-378efe4c55fd" path="/var/lib/kubelet/pods/dc0e334c-f07d-44c5-819f-378efe4c55fd/volumes"
Sep 06 01:34:09.446540 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446508    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"]
Sep 06 01:34:09.446896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446864    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a24bf8-31ba-4a35-b1a2-0cee72d454b0" containerName="payload-pre-processing"
Sep 06 01:34:09.446896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446874    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a24bf8-31ba-4a35-b1a2-0cee72d454b0" containerName="payload-pre-processing"
Sep 06 01:34:09.446896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446888    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01726d6b-b4e8-4512-b48b-863be2917f3b" containerName="revoke-keys"
Sep 06 01:34:09.446896 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446894    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="01726d6b-b4e8-4512-b48b-863be2917f3b" containerName="revoke-keys"
Sep 06 01:34:09.447051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446912    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0e334c-f07d-44c5-819f-378efe4c55fd" containerName="payload-processing"
Sep 06 01:34:09.447051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446918    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0e334c-f07d-44c5-819f-378efe4c55fd" containerName="payload-processing"
Sep 06 01:34:09.447051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.446992    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc0e334c-f07d-44c5-819f-378efe4c55fd" containerName="payload-processing"
Sep 06 01:34:09.447051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.447000    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="01726d6b-b4e8-4512-b48b-863be2917f3b" containerName="revoke-keys"
Sep 06 01:34:09.447051 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.447010    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a24bf8-31ba-4a35-b1a2-0cee72d454b0" containerName="payload-pre-processing"
Sep 06 01:34:09.449968 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.449951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:09.452233 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.452209    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:34:09.452390 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.452258    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:34:09.456601 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.456577    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"]
Sep 06 01:34:09.512757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.512727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a503541-a0bb-4606-ab48-bc65bad69d01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl\" (UID: \"2a503541-a0bb-4606-ab48-bc65bad69d01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:09.614194 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.614159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a503541-a0bb-4606-ab48-bc65bad69d01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl\" (UID: \"2a503541-a0bb-4606-ab48-bc65bad69d01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:09.614776 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.614752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a503541-a0bb-4606-ab48-bc65bad69d01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl\" (UID: \"2a503541-a0bb-4606-ab48-bc65bad69d01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:09.761645 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:09.761564    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:10.032810 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:10.032778    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"]
Sep 06 01:34:10.034035 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:34:10.034011    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a503541_a0bb_4606_ab48_bc65bad69d01.slice/crio-6c6b84e08dcd3e93f3b6bacef2ca9f2cdd0f846379226548f094767109180678 WatchSource:0}: Error finding container 6c6b84e08dcd3e93f3b6bacef2ca9f2cdd0f846379226548f094767109180678: Status 404 returned error can't find the container with id 6c6b84e08dcd3e93f3b6bacef2ca9f2cdd0f846379226548f094767109180678
Sep 06 01:34:10.444436 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:10.444402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl" event={"ID":"2a503541-a0bb-4606-ab48-bc65bad69d01","Type":"ContainerStarted","Data":"6c06c5d9cde39035f20ab02f82871d6c74a59536aa533643c31aaf4fad09166a"}
Sep 06 01:34:10.444597 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:10.444459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl" event={"ID":"2a503541-a0bb-4606-ab48-bc65bad69d01","Type":"ContainerStarted","Data":"6c6b84e08dcd3e93f3b6bacef2ca9f2cdd0f846379226548f094767109180678"}
Sep 06 01:34:10.465156 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:10.465109    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl" podStartSLOduration=1.465095787 podStartE2EDuration="1.465095787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:34:10.462999246 +0000 UTC m=+1503.738384408" watchObservedRunningTime="2026-09-06 01:34:10.465095787 +0000 UTC m=+1503.740480949"
Sep 06 01:34:11.451156 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:11.451118    2567 generic.go:356] "Generic (PLEG): container finished" podID="2a503541-a0bb-4606-ab48-bc65bad69d01" containerID="6c06c5d9cde39035f20ab02f82871d6c74a59536aa533643c31aaf4fad09166a" exitCode=0
Sep 06 01:34:11.451383 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:11.451197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl" event={"ID":"2a503541-a0bb-4606-ab48-bc65bad69d01","Type":"ContainerDied","Data":"6c06c5d9cde39035f20ab02f82871d6c74a59536aa533643c31aaf4fad09166a"}
Sep 06 01:34:12.587775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:12.587752    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:12.638195 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:12.638169    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a503541-a0bb-4606-ab48-bc65bad69d01-maas-api-service-ca\") pod \"2a503541-a0bb-4606-ab48-bc65bad69d01\" (UID: \"2a503541-a0bb-4606-ab48-bc65bad69d01\") "
Sep 06 01:34:12.638530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:12.638512    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a503541-a0bb-4606-ab48-bc65bad69d01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a503541-a0bb-4606-ab48-bc65bad69d01" (UID: "2a503541-a0bb-4606-ab48-bc65bad69d01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:34:12.739698 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:12.739622    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a503541-a0bb-4606-ab48-bc65bad69d01-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:34:13.464904 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:13.464822    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"
Sep 06 01:34:13.464904 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:13.464873    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl" event={"ID":"2a503541-a0bb-4606-ab48-bc65bad69d01","Type":"ContainerDied","Data":"6c6b84e08dcd3e93f3b6bacef2ca9f2cdd0f846379226548f094767109180678"}
Sep 06 01:34:13.465115 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:13.464943    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c6b84e08dcd3e93f3b6bacef2ca9f2cdd0f846379226548f094767109180678"
Sep 06 01:34:25.209386 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:25.209354    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"]
Sep 06 01:34:25.209386 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:25.209389    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-de7322-wgjsl"]
Sep 06 01:34:27.208415 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:34:27.208385    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a503541-a0bb-4606-ab48-bc65bad69d01" path="/var/lib/kubelet/pods/2a503541-a0bb-4606-ab48-bc65bad69d01/volumes"
Sep 06 01:35:07.439794 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:07.439748    2567 scope.go:117] "RemoveContainer" containerID="c7bf4ed05a1d6646f1ddd83eb1492d3524ac4250737d2a9484ebde91465b222c"
Sep 06 01:35:13.495832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.495799    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"]
Sep 06 01:35:13.496448 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.496035    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy" containerID="cri-o://a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572" gracePeriod=30
Sep 06 01:35:13.870775 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.870683    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"]
Sep 06 01:35:13.871137 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.871123    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a503541-a0bb-4606-ab48-bc65bad69d01" containerName="revoke-keys"
Sep 06 01:35:13.871186 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.871139    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a503541-a0bb-4606-ab48-bc65bad69d01" containerName="revoke-keys"
Sep 06 01:35:13.871227 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.871205    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a503541-a0bb-4606-ab48-bc65bad69d01" containerName="revoke-keys"
Sep 06 01:35:13.874302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.874287    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:13.876898 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.876878    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:35:13.876993 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.876895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:35:13.882137 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.881900    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"]
Sep 06 01:35:13.989467 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:13.989437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1492433-42ef-48ed-8d15-5182788e27d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph\" (UID: \"c1492433-42ef-48ed-8d15-5182788e27d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:14.090087 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.090055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1492433-42ef-48ed-8d15-5182788e27d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph\" (UID: \"c1492433-42ef-48ed-8d15-5182788e27d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:14.090651 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.090634    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1492433-42ef-48ed-8d15-5182788e27d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph\" (UID: \"c1492433-42ef-48ed-8d15-5182788e27d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:14.186097 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.186077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:14.461225 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.461200    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"]
Sep 06 01:35:14.461994 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:35:14.461966    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1492433_42ef_48ed_8d15_5182788e27d6.slice/crio-ea4af38b72d4c80d896a38e274d608b594a5581548c618df729e864dafb1d7fa WatchSource:0}: Error finding container ea4af38b72d4c80d896a38e274d608b594a5581548c618df729e864dafb1d7fa: Status 404 returned error can't find the container with id ea4af38b72d4c80d896a38e274d608b594a5581548c618df729e864dafb1d7fa
Sep 06 01:35:14.810585 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.810548    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph" event={"ID":"c1492433-42ef-48ed-8d15-5182788e27d6","Type":"ContainerStarted","Data":"f549851025506046731d66209942b8f4fb67c5b93af3b45fd6a59c7154785c5a"}
Sep 06 01:35:14.811020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.810643    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph" event={"ID":"c1492433-42ef-48ed-8d15-5182788e27d6","Type":"ContainerStarted","Data":"ea4af38b72d4c80d896a38e274d608b594a5581548c618df729e864dafb1d7fa"}
Sep 06 01:35:14.828302 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:14.828257    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph" podStartSLOduration=1.828241717 podStartE2EDuration="1.828241717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:35:14.826442938 +0000 UTC m=+1568.101828149" watchObservedRunningTime="2026-09-06 01:35:14.828241717 +0000 UTC m=+1568.103626880"
Sep 06 01:35:15.817284 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:15.817245    2567 generic.go:356] "Generic (PLEG): container finished" podID="c1492433-42ef-48ed-8d15-5182788e27d6" containerID="f549851025506046731d66209942b8f4fb67c5b93af3b45fd6a59c7154785c5a" exitCode=0
Sep 06 01:35:15.817679 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:15.817331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph" event={"ID":"c1492433-42ef-48ed-8d15-5182788e27d6","Type":"ContainerDied","Data":"f549851025506046731d66209942b8f4fb67c5b93af3b45fd6a59c7154785c5a"}
Sep 06 01:35:16.951608 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:16.951585    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:17.015127 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:17.015099    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1492433-42ef-48ed-8d15-5182788e27d6-maas-api-service-ca\") pod \"c1492433-42ef-48ed-8d15-5182788e27d6\" (UID: \"c1492433-42ef-48ed-8d15-5182788e27d6\") "
Sep 06 01:35:17.015436 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:17.015411    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1492433-42ef-48ed-8d15-5182788e27d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1492433-42ef-48ed-8d15-5182788e27d6" (UID: "c1492433-42ef-48ed-8d15-5182788e27d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:17.116434 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:17.116361    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1492433-42ef-48ed-8d15-5182788e27d6-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:17.829617 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:17.829579    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"
Sep 06 01:35:17.829804 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:17.829628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph" event={"ID":"c1492433-42ef-48ed-8d15-5182788e27d6","Type":"ContainerDied","Data":"ea4af38b72d4c80d896a38e274d608b594a5581548c618df729e864dafb1d7fa"}
Sep 06 01:35:17.829804 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:17.829684    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea4af38b72d4c80d896a38e274d608b594a5581548c618df729e864dafb1d7fa"
Sep 06 01:35:18.739765 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.739739    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:35:18.833379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833304    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-socket\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833351    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-certs\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833379 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833377    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-podinfo\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833423    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n48xb\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-kube-api-access-n48xb\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833451    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istiod-ca-cert\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833473    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-token\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833516    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-credential-socket\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833553    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-envoy\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833595    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:18.833622 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833618    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-data\") pod \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\" (UID: \"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8\") "
Sep 06 01:35:18.834057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833874    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:18.834057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833972    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.834057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.833991    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.834057 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.834004    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.834252 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.834070    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:18.834252 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.834192    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:18.835660 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.835638    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-kube-api-access-n48xb" (OuterVolumeSpecName: "kube-api-access-n48xb") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "kube-api-access-n48xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:18.836054 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.836034    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:35:18.836191 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.836171    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:18.836257 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.836176    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" (UID: "9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:18.838335 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.838312    2567 generic.go:356] "Generic (PLEG): container finished" podID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerID="a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572" exitCode=0
Sep 06 01:35:18.838410 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.838353    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"
Sep 06 01:35:18.838410 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.838390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" event={"ID":"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8","Type":"ContainerDied","Data":"a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572"}
Sep 06 01:35:18.838489 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.838445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b" event={"ID":"9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8","Type":"ContainerDied","Data":"deb0b6c69ccedff07a375b6dd60c110b74114e49bbd23eec3b0a3427edab456b"}
Sep 06 01:35:18.838489 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.838468    2567 scope.go:117] "RemoveContainer" containerID="a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572"
Sep 06 01:35:18.859339 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.859319    2567 scope.go:117] "RemoveContainer" containerID="6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"
Sep 06 01:35:18.867881 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.867861    2567 scope.go:117] "RemoveContainer" containerID="a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572"
Sep 06 01:35:18.868153 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:35:18.868129    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572\": container with ID starting with a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572 not found: ID does not exist" containerID="a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572"
Sep 06 01:35:18.868242 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.868158    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572"} err="failed to get container status \"a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572\": rpc error: code = NotFound desc = could not find container \"a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572\": container with ID starting with a22cc22ef99ccfc9d70f2478a50a7214efe525a0aa98cda711f35a802be43572 not found: ID does not exist"
Sep 06 01:35:18.868242 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.868178    2567 scope.go:117] "RemoveContainer" containerID="6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"
Sep 06 01:35:18.868443 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:35:18.868426    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba\": container with ID starting with 6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba not found: ID does not exist" containerID="6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"
Sep 06 01:35:18.868492 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.868449    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba"} err="failed to get container status \"6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba\": rpc error: code = NotFound desc = could not find container \"6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba\": container with ID starting with 6a5e4e988ad62b8e3c649186a4685cb9581a2644a28ae08246f19065057859ba not found: ID does not exist"
Sep 06 01:35:18.869924 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.869905    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"]
Sep 06 01:35:18.873820 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.873794    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-de7322-openshift-default-5cb866596-4f92b"]
Sep 06 01:35:18.935134 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.935117    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.935134 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.935134    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n48xb\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-kube-api-access-n48xb\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.935267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.935144    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.935267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.935152    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.935267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.935160    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:18.935267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:18.935167    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:19.207582 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:19.207551    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" path="/var/lib/kubelet/pods/9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8/volumes"
Sep 06 01:35:24.419156 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:24.419123    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"]
Sep 06 01:35:24.421392 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:24.421371    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0b81e1-r5bph"]
Sep 06 01:35:25.209029 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:25.208999    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1492433-42ef-48ed-8d15-5182788e27d6" path="/var/lib/kubelet/pods/c1492433-42ef-48ed-8d15-5182788e27d6/volumes"
Sep 06 01:35:30.844154 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:30.844113    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"]
Sep 06 01:35:30.844547 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:30.844404    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy" containerID="cri-o://1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20" gracePeriod=30
Sep 06 01:35:36.099666 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.099642    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:35:36.188022 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.187995    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7rnf\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-kube-api-access-c7rnf\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188054    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ae1b5b3-1230-4840-beca-263db731984d-istiod-ca-cert\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188076    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-credential-socket\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188116    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-socket\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188136    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-envoy\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188159    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-certs\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188447 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188188    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ae1b5b3-1230-4840-beca-263db731984d-istio-podinfo\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188447 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-istio-token\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188447 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188247    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-data\") pod \"8ae1b5b3-1230-4840-beca-263db731984d\" (UID: \"8ae1b5b3-1230-4840-beca-263db731984d\") "
Sep 06 01:35:36.188606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188446    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:36.188606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188458    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:36.188606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188474    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:36.188606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188541    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae1b5b3-1230-4840-beca-263db731984d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:36.188606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188565    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.188606 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188606    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.188944 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188621    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.188944 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.188655    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:36.190317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.190291    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:36.190408 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.190324    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-kube-api-access-c7rnf" (OuterVolumeSpecName: "kube-api-access-c7rnf") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "kube-api-access-c7rnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:36.190448 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.190405    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:36.190540 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.190525    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ae1b5b3-1230-4840-beca-263db731984d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ae1b5b3-1230-4840-beca-263db731984d" (UID: "8ae1b5b3-1230-4840-beca-263db731984d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:35:36.289763 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.289740    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ae1b5b3-1230-4840-beca-263db731984d-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.289763 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.289760    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.289893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.289769    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ae1b5b3-1230-4840-beca-263db731984d-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.289893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.289776    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.289893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.289784    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b5b3-1230-4840-beca-263db731984d-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.289893 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.289792    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7rnf\" (UniqueName: \"kubernetes.io/projected/8ae1b5b3-1230-4840-beca-263db731984d-kube-api-access-c7rnf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:36.939361 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.939326    2567 generic.go:356] "Generic (PLEG): container finished" podID="8ae1b5b3-1230-4840-beca-263db731984d" containerID="1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20" exitCode=0
Sep 06 01:35:36.939530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.939369    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"
Sep 06 01:35:36.939530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.939402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" event={"ID":"8ae1b5b3-1230-4840-beca-263db731984d","Type":"ContainerDied","Data":"1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20"}
Sep 06 01:35:36.939530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.939456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62" event={"ID":"8ae1b5b3-1230-4840-beca-263db731984d","Type":"ContainerDied","Data":"4f57b8d93e54f0ac90b222692f18bd0f7e29681799d533a534d11955a5ffa52b"}
Sep 06 01:35:36.939530 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.939480    2567 scope.go:117] "RemoveContainer" containerID="1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20"
Sep 06 01:35:36.949433 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.949411    2567 scope.go:117] "RemoveContainer" containerID="c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"
Sep 06 01:35:36.957700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.957683    2567 scope.go:117] "RemoveContainer" containerID="1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20"
Sep 06 01:35:36.958377 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:35:36.957919    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20\": container with ID starting with 1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20 not found: ID does not exist" containerID="1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20"
Sep 06 01:35:36.958429 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.958386    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20"} err="failed to get container status \"1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20\": rpc error: code = NotFound desc = could not find container \"1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20\": container with ID starting with 1de6131aff8b7fdf4d51b4a7b22e954191ad3c76600d3940fbf147a3c09bcd20 not found: ID does not exist"
Sep 06 01:35:36.958429 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.958405    2567 scope.go:117] "RemoveContainer" containerID="c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"
Sep 06 01:35:36.958649 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:35:36.958633    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006\": container with ID starting with c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006 not found: ID does not exist" containerID="c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"
Sep 06 01:35:36.958690 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.958653    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006"} err="failed to get container status \"c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006\": rpc error: code = NotFound desc = could not find container \"c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006\": container with ID starting with c5b79ed91e7a4e2a60a06998a0638b1143b3492be7f9b421f5e976d47949d006 not found: ID does not exist"
Sep 06 01:35:36.962569 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.962549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"]
Sep 06 01:35:36.968426 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:36.968407    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-0b81e1-openshift-default-7cc6b4f4-wrp62"]
Sep 06 01:35:37.209700 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:37.209624    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae1b5b3-1230-4840-beca-263db731984d" path="/var/lib/kubelet/pods/8ae1b5b3-1230-4840-beca-263db731984d/volumes"
Sep 06 01:35:41.615649 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.615618    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"]
Sep 06 01:35:41.617887 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.617860    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5833d5-29810970-ptz74"]
Sep 06 01:35:41.635014 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.634989    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"]
Sep 06 01:35:41.635214 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.635189    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k" podUID="72b1543b-0c19-4a59-8668-8b1e19bb6d3d" containerName="payload-processing" containerID="cri-o://11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f" gracePeriod=30
Sep 06 01:35:41.643583 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.643558    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"]
Sep 06 01:35:41.644220 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.643950    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr" podUID="252c89bc-4ba8-4cbd-a420-5d0c441694a6" containerName="payload-pre-processing" containerID="cri-o://c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5" gracePeriod=30
Sep 06 01:35:41.919031 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.919007    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:35:41.921672 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.921653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:35:41.937886 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.937858    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-plugins-config-volume\") pod \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") "
Sep 06 01:35:41.938044 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.937909    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztcrs\" (UniqueName: \"kubernetes.io/projected/252c89bc-4ba8-4cbd-a420-5d0c441694a6-kube-api-access-ztcrs\") pod \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") "
Sep 06 01:35:41.938044 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.938018    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252c89bc-4ba8-4cbd-a420-5d0c441694a6-plugins-config-volume\") pod \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\" (UID: \"252c89bc-4ba8-4cbd-a420-5d0c441694a6\") "
Sep 06 01:35:41.938167 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.938092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vs8k\" (UniqueName: \"kubernetes.io/projected/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-kube-api-access-8vs8k\") pod \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\" (UID: \"72b1543b-0c19-4a59-8668-8b1e19bb6d3d\") "
Sep 06 01:35:41.938303 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.938280    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72b1543b-0c19-4a59-8668-8b1e19bb6d3d" (UID: "72b1543b-0c19-4a59-8668-8b1e19bb6d3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:41.938474 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.938454    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:41.938559 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.938506    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252c89bc-4ba8-4cbd-a420-5d0c441694a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "252c89bc-4ba8-4cbd-a420-5d0c441694a6" (UID: "252c89bc-4ba8-4cbd-a420-5d0c441694a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:41.940360 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.940338    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252c89bc-4ba8-4cbd-a420-5d0c441694a6-kube-api-access-ztcrs" (OuterVolumeSpecName: "kube-api-access-ztcrs") pod "252c89bc-4ba8-4cbd-a420-5d0c441694a6" (UID: "252c89bc-4ba8-4cbd-a420-5d0c441694a6"). InnerVolumeSpecName "kube-api-access-ztcrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:41.940605 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.940585    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-kube-api-access-8vs8k" (OuterVolumeSpecName: "kube-api-access-8vs8k") pod "72b1543b-0c19-4a59-8668-8b1e19bb6d3d" (UID: "72b1543b-0c19-4a59-8668-8b1e19bb6d3d"). InnerVolumeSpecName "kube-api-access-8vs8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:41.974691 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.974658    2567 generic.go:356] "Generic (PLEG): container finished" podID="252c89bc-4ba8-4cbd-a420-5d0c441694a6" containerID="c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5" exitCode=0
Sep 06 01:35:41.974805 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.974710    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"
Sep 06 01:35:41.974805 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.974747    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr" event={"ID":"252c89bc-4ba8-4cbd-a420-5d0c441694a6","Type":"ContainerDied","Data":"c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5"}
Sep 06 01:35:41.974805 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.974798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr" event={"ID":"252c89bc-4ba8-4cbd-a420-5d0c441694a6","Type":"ContainerDied","Data":"7e5b5771add00a88491cfb42b394b662f3e46427815ad85aa1f3762fe6d7f992"}
Sep 06 01:35:41.975003 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.974824    2567 scope.go:117] "RemoveContainer" containerID="c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5"
Sep 06 01:35:41.976336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.976267    2567 generic.go:356] "Generic (PLEG): container finished" podID="72b1543b-0c19-4a59-8668-8b1e19bb6d3d" containerID="11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f" exitCode=0
Sep 06 01:35:41.976336 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.976316    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"
Sep 06 01:35:41.976502 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.976319    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k" event={"ID":"72b1543b-0c19-4a59-8668-8b1e19bb6d3d","Type":"ContainerDied","Data":"11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f"}
Sep 06 01:35:41.976502 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.976485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k" event={"ID":"72b1543b-0c19-4a59-8668-8b1e19bb6d3d","Type":"ContainerDied","Data":"9c9e4ee45ddbeff11fa5b19d111dd69d70bef03e8d9a5a65053b42dd3a9e1eac"}
Sep 06 01:35:41.983991 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.983973    2567 scope.go:117] "RemoveContainer" containerID="c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5"
Sep 06 01:35:41.984286 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:35:41.984264    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5\": container with ID starting with c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5 not found: ID does not exist" containerID="c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5"
Sep 06 01:35:41.984370 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.984293    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5"} err="failed to get container status \"c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5\": rpc error: code = NotFound desc = could not find container \"c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5\": container with ID starting with c92f60f53b823e80e48ee426abb5de07fa68e1b861807f13ea54bfa1f23fbde5 not found: ID does not exist"
Sep 06 01:35:41.984370 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.984311    2567 scope.go:117] "RemoveContainer" containerID="11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f"
Sep 06 01:35:41.992910 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.992894    2567 scope.go:117] "RemoveContainer" containerID="11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f"
Sep 06 01:35:41.993174 ip-10-0-129-23 kubenswrapper[2567]: E0906 01:35:41.993156    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f\": container with ID starting with 11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f not found: ID does not exist" containerID="11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f"
Sep 06 01:35:41.993224 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.993180    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f"} err="failed to get container status \"11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f\": rpc error: code = NotFound desc = could not find container \"11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f\": container with ID starting with 11e66666f643866a119199b37ceac45441c87aed40af27cec81762ef2786260f not found: ID does not exist"
Sep 06 01:35:41.999813 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:41.999792    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"]
Sep 06 01:35:42.004020 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:42.003994    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5833d5-795d5486db-x92zr"]
Sep 06 01:35:42.014807 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:42.014790    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"]
Sep 06 01:35:42.016829 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:42.016810    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5833d5-86bf65f479-p7p9k"]
Sep 06 01:35:42.039605 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:42.039584    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztcrs\" (UniqueName: \"kubernetes.io/projected/252c89bc-4ba8-4cbd-a420-5d0c441694a6-kube-api-access-ztcrs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:42.039605 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:42.039605    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252c89bc-4ba8-4cbd-a420-5d0c441694a6-plugins-config-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:42.039743 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:42.039615    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vs8k\" (UniqueName: \"kubernetes.io/projected/72b1543b-0c19-4a59-8668-8b1e19bb6d3d-kube-api-access-8vs8k\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:43.207320 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:43.207288    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252c89bc-4ba8-4cbd-a420-5d0c441694a6" path="/var/lib/kubelet/pods/252c89bc-4ba8-4cbd-a420-5d0c441694a6/volumes"
Sep 06 01:35:43.207690 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:43.207618    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72b1543b-0c19-4a59-8668-8b1e19bb6d3d" path="/var/lib/kubelet/pods/72b1543b-0c19-4a59-8668-8b1e19bb6d3d/volumes"
Sep 06 01:35:43.207869 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:43.207856    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e965ef81-9d9c-4724-8d1c-866cf2a964c8" path="/var/lib/kubelet/pods/e965ef81-9d9c-4724-8d1c-866cf2a964c8/volumes"
Sep 06 01:35:48.816229 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816193    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"]
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816550    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816561    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816568    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816574    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816595    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252c89bc-4ba8-4cbd-a420-5d0c441694a6" containerName="payload-pre-processing"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816601    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="252c89bc-4ba8-4cbd-a420-5d0c441694a6" containerName="payload-pre-processing"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816612    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1492433-42ef-48ed-8d15-5182788e27d6" containerName="revoke-keys"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816618    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1492433-42ef-48ed-8d15-5182788e27d6" containerName="revoke-keys"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816624    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72b1543b-0c19-4a59-8668-8b1e19bb6d3d" containerName="payload-processing"
Sep 06 01:35:48.816657 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816629    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="72b1543b-0c19-4a59-8668-8b1e19bb6d3d" containerName="payload-processing"
Sep 06 01:35:48.817056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816678    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="72b1543b-0c19-4a59-8668-8b1e19bb6d3d" containerName="payload-processing"
Sep 06 01:35:48.817056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816685    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy"
Sep 06 01:35:48.817056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816691    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1492433-42ef-48ed-8d15-5182788e27d6" containerName="revoke-keys"
Sep 06 01:35:48.817056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816696    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy"
Sep 06 01:35:48.817056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816704    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="252c89bc-4ba8-4cbd-a420-5d0c441694a6" containerName="payload-pre-processing"
Sep 06 01:35:48.817056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.816710    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy"
Sep 06 01:35:48.821135 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.821118    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:48.824476 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.824030    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:35:48.824476 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.824029    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:35:48.830946 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.827515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"]
Sep 06 01:35:48.901351 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:48.901323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b936769d-7def-4e8b-87cc-9119c8109f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5\" (UID: \"b936769d-7def-4e8b-87cc-9119c8109f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:49.002665 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:49.002635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b936769d-7def-4e8b-87cc-9119c8109f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5\" (UID: \"b936769d-7def-4e8b-87cc-9119c8109f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:49.003230 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:49.003213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b936769d-7def-4e8b-87cc-9119c8109f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5\" (UID: \"b936769d-7def-4e8b-87cc-9119c8109f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:49.138880 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:49.138792    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:49.409287 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:49.409264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"]
Sep 06 01:35:49.411180 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:35:49.411152    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb936769d_7def_4e8b_87cc_9119c8109f8c.slice/crio-237ef70a1f775c9d4b3b3aa5d62433b3aaa4bb1a8d43ccd4607ebc076f21ab4d WatchSource:0}: Error finding container 237ef70a1f775c9d4b3b3aa5d62433b3aaa4bb1a8d43ccd4607ebc076f21ab4d: Status 404 returned error can't find the container with id 237ef70a1f775c9d4b3b3aa5d62433b3aaa4bb1a8d43ccd4607ebc076f21ab4d
Sep 06 01:35:50.031576 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:50.031544    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5" event={"ID":"b936769d-7def-4e8b-87cc-9119c8109f8c","Type":"ContainerStarted","Data":"c34d5d5e21e47238983890182c591cf1f8d7a0f0e1b9d951041a764d4e278d7e"}
Sep 06 01:35:50.032002 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:50.031597    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5" event={"ID":"b936769d-7def-4e8b-87cc-9119c8109f8c","Type":"ContainerStarted","Data":"237ef70a1f775c9d4b3b3aa5d62433b3aaa4bb1a8d43ccd4607ebc076f21ab4d"}
Sep 06 01:35:50.046232 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:50.046162    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5" podStartSLOduration=2.046147135 podStartE2EDuration="2.046147135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:35:50.04556984 +0000 UTC m=+1603.320955007" watchObservedRunningTime="2026-09-06 01:35:50.046147135 +0000 UTC m=+1603.321532298"
Sep 06 01:35:51.038102 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:51.038065    2567 generic.go:356] "Generic (PLEG): container finished" podID="b936769d-7def-4e8b-87cc-9119c8109f8c" containerID="c34d5d5e21e47238983890182c591cf1f8d7a0f0e1b9d951041a764d4e278d7e" exitCode=0
Sep 06 01:35:51.038482 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:51.038142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5" event={"ID":"b936769d-7def-4e8b-87cc-9119c8109f8c","Type":"ContainerDied","Data":"c34d5d5e21e47238983890182c591cf1f8d7a0f0e1b9d951041a764d4e278d7e"}
Sep 06 01:35:52.169522 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:52.169495    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:52.233254 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:52.233222    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b936769d-7def-4e8b-87cc-9119c8109f8c-maas-api-service-ca\") pod \"b936769d-7def-4e8b-87cc-9119c8109f8c\" (UID: \"b936769d-7def-4e8b-87cc-9119c8109f8c\") "
Sep 06 01:35:52.233564 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:52.233535    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b936769d-7def-4e8b-87cc-9119c8109f8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b936769d-7def-4e8b-87cc-9119c8109f8c" (UID: "b936769d-7def-4e8b-87cc-9119c8109f8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:52.334807 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:52.334726    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b936769d-7def-4e8b-87cc-9119c8109f8c-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.054372 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:53.054344    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"
Sep 06 01:35:53.054544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:53.054389    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5" event={"ID":"b936769d-7def-4e8b-87cc-9119c8109f8c","Type":"ContainerDied","Data":"237ef70a1f775c9d4b3b3aa5d62433b3aaa4bb1a8d43ccd4607ebc076f21ab4d"}
Sep 06 01:35:53.054544 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:53.054444    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="237ef70a1f775c9d4b3b3aa5d62433b3aaa4bb1a8d43ccd4607ebc076f21ab4d"
Sep 06 01:35:59.377674 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:59.377641    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"]
Sep 06 01:35:59.379897 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:35:59.379875    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-41f259-cvpr5"]
Sep 06 01:36:01.207204 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:36:01.207167    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b936769d-7def-4e8b-87cc-9119c8109f8c" path="/var/lib/kubelet/pods/b936769d-7def-4e8b-87cc-9119c8109f8c/volumes"
Sep 06 01:36:07.461807 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:36:07.461778    2567 scope.go:117] "RemoveContainer" containerID="00d8cede53c47fac19f1bf1433a3634e966d75d20d9a834dae9676d6c6bb7507"
Sep 06 01:36:07.470187 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:36:07.470166    2567 scope.go:117] "RemoveContainer" containerID="474135dec0cd35c67b53aafc1cd0cadaeda192e6659f05c532647db7201ae95e"
Sep 06 01:39:07.524398 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:39:07.524368    2567 scope.go:117] "RemoveContainer" containerID="43b0a1c52d69ed72f380148d021d55556ded4cbbb161d9cb16222fe4e251584c"
Sep 06 01:39:07.533002 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:39:07.532962    2567 scope.go:117] "RemoveContainer" containerID="25ad806705a9bf95eca1989d1c4822312e8d34cbc8ee6803bc7f9aae2c8d2046"
Sep 06 01:40:07.555898 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:40:07.555865    2567 scope.go:117] "RemoveContainer" containerID="ff809d5cc0514dae00422df52e73ceb5ee9d46b00c90400424ed149fcdf3bdfc"
Sep 06 01:41:07.577224 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:41:07.577195    2567 scope.go:117] "RemoveContainer" containerID="6c06c5d9cde39035f20ab02f82871d6c74a59536aa533643c31aaf4fad09166a"
Sep 06 01:42:07.597293 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:42:07.597221    2567 scope.go:117] "RemoveContainer" containerID="c34d5d5e21e47238983890182c591cf1f8d7a0f0e1b9d951041a764d4e278d7e"
Sep 06 01:42:07.605626 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:42:07.605609    2567 scope.go:117] "RemoveContainer" containerID="f549851025506046731d66209942b8f4fb67c5b93af3b45fd6a59c7154785c5a"
Sep 06 01:44:41.893212 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:41.893182    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4rwc7_e64195fd-7588-460d-81f4-a69902e241a2/manager/0.log"
Sep 06 01:44:42.243297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:42.243268    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-wj62m_24b4ff0e-0884-4185-b4d3-0b1f003a5fdf/copy-manifests/0.log"
Sep 06 01:44:42.254664 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:42.254640    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-wj62m_24b4ff0e-0884-4185-b4d3-0b1f003a5fdf/manager/0.log"
Sep 06 01:44:44.691650 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:44.691620    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz_70a25348-4b45-4628-8590-2e4624f1e752/istio-proxy/0.log"
Sep 06 01:44:44.812027 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:44.811999    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rcd49_29868411-8804-4b28-b55c-c58413fa48dc/discovery/0.log"
Sep 06 01:44:45.171982 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:45.171951    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/1.log"
Sep 06 01:44:45.406459 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:45.406427    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dwbm4_db0b0d71-b56d-49ef-a3ed-eaa7acce9c60/payload-processing/0.log"
Sep 06 01:44:45.871594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:45.871550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-f8q7g_2686f132-4df6-4e1f-b309-dc513a7bc344/main/0.log"
Sep 06 01:44:46.217941 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:46.217907    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vcf7z_6c12ad93-f39e-4b18-b009-f2b8a999fedb/main/0.log"
Sep 06 01:44:46.445285 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:46.445249    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xzckp_06aa6a31-47bb-464c-9a6d-acc93eb6286b/main/0.log"
Sep 06 01:44:55.476201 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:55.476171    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nnkg9_16bc738a-0b7a-49c9-889e-134d75a20581/global-pull-secret-syncer/0.log"
Sep 06 01:44:55.579310 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:55.579283    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g9c79_ef749114-4049-465f-ab1c-8aacce7bc641/konnectivity-agent/0.log"
Sep 06 01:44:55.638677 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:44:55.638645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-23.ec2.internal_cee5ecae58ff184b6f632299c1d231ab/haproxy/0.log"
Sep 06 01:45:00.171405 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171303    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"]
Sep 06 01:45:00.171793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171770    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy"
Sep 06 01:45:00.171793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171785    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f50970f-ea1d-483c-a7dd-7ae3cbeae0f8" containerName="istio-proxy"
Sep 06 01:45:00.171793 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171794    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy"
Sep 06 01:45:00.171955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171815    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy"
Sep 06 01:45:00.171955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171842    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b936769d-7def-4e8b-87cc-9119c8109f8c" containerName="revoke-keys"
Sep 06 01:45:00.171955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171849    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b936769d-7def-4e8b-87cc-9119c8109f8c" containerName="revoke-keys"
Sep 06 01:45:00.171955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171910    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae1b5b3-1230-4840-beca-263db731984d" containerName="istio-proxy"
Sep 06 01:45:00.171955 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.171952    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b936769d-7def-4e8b-87cc-9119c8109f8c" containerName="revoke-keys"
Sep 06 01:45:00.175311 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.175293    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"
Sep 06 01:45:00.178470 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.178450    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:45:00.186577 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.186552    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"]
Sep 06 01:45:00.188123 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.188103    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"
Sep 06 01:45:00.475094 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.475071    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"]
Sep 06 01:45:00.477418 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:45:00.477392    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d2518c_7065_4e10_bcf5_a6e1b96d5942.slice/crio-4fe831984acf6105b1f84285c8c031cdddf0c7cdb05fe57d5a2d9adb40cb00b4 WatchSource:0}: Error finding container 4fe831984acf6105b1f84285c8c031cdddf0c7cdb05fe57d5a2d9adb40cb00b4: Status 404 returned error can't find the container with id 4fe831984acf6105b1f84285c8c031cdddf0c7cdb05fe57d5a2d9adb40cb00b4
Sep 06 01:45:00.950988 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.950949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd" event={"ID":"55d2518c-7065-4e10-bcf5-a6e1b96d5942","Type":"ContainerStarted","Data":"0464df59f9688f511f8b91fb9982c5ea5fc45f6df611f159989d5a692b921e4c"}
Sep 06 01:45:00.951198 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:00.951002    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd" event={"ID":"55d2518c-7065-4e10-bcf5-a6e1b96d5942","Type":"ContainerStarted","Data":"4fe831984acf6105b1f84285c8c031cdddf0c7cdb05fe57d5a2d9adb40cb00b4"}
Sep 06 01:45:01.959056 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:01.959018    2567 generic.go:356] "Generic (PLEG): container finished" podID="55d2518c-7065-4e10-bcf5-a6e1b96d5942" containerID="0464df59f9688f511f8b91fb9982c5ea5fc45f6df611f159989d5a692b921e4c" exitCode=0
Sep 06 01:45:01.959487 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:01.959100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd" event={"ID":"55d2518c-7065-4e10-bcf5-a6e1b96d5942","Type":"ContainerDied","Data":"0464df59f9688f511f8b91fb9982c5ea5fc45f6df611f159989d5a692b921e4c"}
Sep 06 01:45:02.253241 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.253163    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/alertmanager/0.log"
Sep 06 01:45:02.315184 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.315161    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/config-reloader/0.log"
Sep 06 01:45:02.349409 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.349379    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/kube-rbac-proxy-web/0.log"
Sep 06 01:45:02.411704 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.411673    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/kube-rbac-proxy/0.log"
Sep 06 01:45:02.441951 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.441911    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/kube-rbac-proxy-metric/0.log"
Sep 06 01:45:02.473372 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.473339    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/prom-label-proxy/0.log"
Sep 06 01:45:02.499068 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.499041    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_986c236a-0063-4121-9039-c0c8b7c6fc98/init-config-reloader/0.log"
Sep 06 01:45:02.819009 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.818985    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fx7gx_7e7b6946-7cf2-4b78-badd-6617a1eabba7/node-exporter/0.log"
Sep 06 01:45:02.839897 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.839868    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fx7gx_7e7b6946-7cf2-4b78-badd-6617a1eabba7/kube-rbac-proxy/0.log"
Sep 06 01:45:02.865137 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:02.865113    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fx7gx_7e7b6946-7cf2-4b78-badd-6617a1eabba7/init-textfile/0.log"
Sep 06 01:45:03.095951 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.095911    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"
Sep 06 01:45:03.476772 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.476744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55988bcc46-6tsp9_493f6e16-348f-4353-a3f2-661fcaa78c5c/telemeter-client/0.log"
Sep 06 01:45:03.510202 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.510175    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55988bcc46-6tsp9_493f6e16-348f-4353-a3f2-661fcaa78c5c/reload/0.log"
Sep 06 01:45:03.555654 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.555621    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55988bcc46-6tsp9_493f6e16-348f-4353-a3f2-661fcaa78c5c/kube-rbac-proxy/0.log"
Sep 06 01:45:03.971043 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.970995    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd"
Sep 06 01:45:03.971221 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.971046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810985-vqtqd" event={"ID":"55d2518c-7065-4e10-bcf5-a6e1b96d5942","Type":"ContainerDied","Data":"4fe831984acf6105b1f84285c8c031cdddf0c7cdb05fe57d5a2d9adb40cb00b4"}
Sep 06 01:45:03.971221 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:03.971092    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fe831984acf6105b1f84285c8c031cdddf0c7cdb05fe57d5a2d9adb40cb00b4"
Sep 06 01:45:04.986838 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:04.986814    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-rmlkt_0011c0de-f47d-48c1-ae5c-7005535ba710/networking-console-plugin/0.log"
Sep 06 01:45:05.067832 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.067801    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"]
Sep 06 01:45:05.068190 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.068176    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d2518c-7065-4e10-bcf5-a6e1b96d5942" containerName="cleanup"
Sep 06 01:45:05.068238 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.068192    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d2518c-7065-4e10-bcf5-a6e1b96d5942" containerName="cleanup"
Sep 06 01:45:05.068275 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.068245    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d2518c-7065-4e10-bcf5-a6e1b96d5942" containerName="cleanup"
Sep 06 01:45:05.071315 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.071296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.073961 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.073944    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44kv5\"/\"kube-root-ca.crt\""
Sep 06 01:45:05.074717 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.074703    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44kv5\"/\"default-dockercfg-kn5hd\""
Sep 06 01:45:05.074784 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.074712    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44kv5\"/\"openshift-service-ca.crt\""
Sep 06 01:45:05.083298 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.083234    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"]
Sep 06 01:45:05.156208 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.156175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-lib-modules\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.156375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.156220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-proc\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.156375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.156282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-podres\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.156375 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.156360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z75k2\" (UniqueName: \"kubernetes.io/projected/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-kube-api-access-z75k2\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.156485 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.156399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-sys\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z75k2\" (UniqueName: \"kubernetes.io/projected/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-kube-api-access-z75k2\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-sys\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257317 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-lib-modules\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-proc\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-podres\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257425    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-sys\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-proc\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257483    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-lib-modules\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.257594 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.257520    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-podres\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.267465 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.267438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z75k2\" (UniqueName: \"kubernetes.io/projected/c12fd110-8a66-43e0-80c2-4ac9ec048f9c-kube-api-access-z75k2\") pod \"perf-node-gather-daemonset-phq59\" (UID: \"c12fd110-8a66-43e0-80c2-4ac9ec048f9c\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.381315 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.381282    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:05.658504 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.655267    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"]
Sep 06 01:45:05.660193 ip-10-0-129-23 kubenswrapper[2567]: W0906 01:45:05.660160    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc12fd110_8a66_43e0_80c2_4ac9ec048f9c.slice/crio-e38992e89e1e8792cbc5fc82fc85a9f573f07df13e7394fecb46e3ee7ab65a0a WatchSource:0}: Error finding container e38992e89e1e8792cbc5fc82fc85a9f573f07df13e7394fecb46e3ee7ab65a0a: Status 404 returned error can't find the container with id e38992e89e1e8792cbc5fc82fc85a9f573f07df13e7394fecb46e3ee7ab65a0a
Sep 06 01:45:05.983936 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.983899    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59" event={"ID":"c12fd110-8a66-43e0-80c2-4ac9ec048f9c","Type":"ContainerStarted","Data":"81469e7cd9f4d475dfd5388eab9d9f081800004919587522437ed4da484a5da4"}
Sep 06 01:45:05.984091 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.983974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59" event={"ID":"c12fd110-8a66-43e0-80c2-4ac9ec048f9c","Type":"ContainerStarted","Data":"e38992e89e1e8792cbc5fc82fc85a9f573f07df13e7394fecb46e3ee7ab65a0a"}
Sep 06 01:45:05.984091 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:05.984078    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:06.002915 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:06.002866    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59" podStartSLOduration=1.002854044 podStartE2EDuration="1.002854044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:45:06.001439709 +0000 UTC m=+2159.276824872" watchObservedRunningTime="2026-09-06 01:45:06.002854044 +0000 UTC m=+2159.278239207"
Sep 06 01:45:06.243531 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:06.243449    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-5km8n_b7d93543-f806-480e-b623-8b0771e23b3a/download-server/0.log"
Sep 06 01:45:08.154339 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:08.154312    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wk7gs_73b20a23-5d22-43a4-aabe-31648175eee4/dns/0.log"
Sep 06 01:45:08.202702 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:08.202670    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wk7gs_73b20a23-5d22-43a4-aabe-31648175eee4/kube-rbac-proxy/0.log"
Sep 06 01:45:08.302920 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:08.302893    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8l2x4_261aa706-8c29-460e-b6ec-6808712695d4/dns-node-resolver/0.log"
Sep 06 01:45:09.004979 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:09.004951    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c6f5b4677-vpfmd_e7ddadd7-0214-4c38-a723-aa3608351fda/registry/0.log"
Sep 06 01:45:09.163422 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:09.163389    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tjsgp_12258b65-fdef-4b24-ae67-bc0deba5fdac/node-ca/0.log"
Sep 06 01:45:10.351937 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:10.351908    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz_70a25348-4b45-4628-8590-2e4624f1e752/istio-proxy/0.log"
Sep 06 01:45:10.624750 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:10.624667    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rcd49_29868411-8804-4b28-b55c-c58413fa48dc/discovery/0.log"
Sep 06 01:45:10.824628 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:10.824596    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/0.log"
Sep 06 01:45:10.833080 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:10.833055    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/1.log"
Sep 06 01:45:11.023721 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:11.023687    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dwbm4_db0b0d71-b56d-49ef-a3ed-eaa7acce9c60/payload-processing/0.log"
Sep 06 01:45:11.998601 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:11.998571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-phq59"
Sep 06 01:45:12.195267 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:12.195242    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cggfs_30b6af44-d08a-46b7-9715-054d97e55126/serve-healthcheck-canary/0.log"
Sep 06 01:45:12.892826 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:12.892785    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77sth_33a271a3-491d-4b96-81eb-eb0845197960/kube-rbac-proxy/0.log"
Sep 06 01:45:12.920457 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:12.920437    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77sth_33a271a3-491d-4b96-81eb-eb0845197960/exporter/0.log"
Sep 06 01:45:12.947297 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:12.947265    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77sth_33a271a3-491d-4b96-81eb-eb0845197960/extractor/0.log"
Sep 06 01:45:15.618589 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:15.618507    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz_70a25348-4b45-4628-8590-2e4624f1e752/istio-proxy/0.log"
Sep 06 01:45:15.840798 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:15.840753    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rcd49_29868411-8804-4b28-b55c-c58413fa48dc/discovery/0.log"
Sep 06 01:45:15.931918 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:15.931884    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/0.log"
Sep 06 01:45:15.944246 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:15.944223    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/1.log"
Sep 06 01:45:16.027203 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:16.027178    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dwbm4_db0b0d71-b56d-49ef-a3ed-eaa7acce9c60/payload-processing/0.log"
Sep 06 01:45:16.111713 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:16.111688    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4rwc7_e64195fd-7588-460d-81f4-a69902e241a2/manager/0.log"
Sep 06 01:45:16.339972 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:16.339940    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-wj62m_24b4ff0e-0884-4185-b4d3-0b1f003a5fdf/manager/0.log"
Sep 06 01:45:16.378841 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:16.378814    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-wj62m_24b4ff0e-0884-4185-b4d3-0b1f003a5fdf/copy-manifests/0.log"
Sep 06 01:45:17.657720 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:17.657693    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-2lhtz_70a25348-4b45-4628-8590-2e4624f1e752/istio-proxy/0.log"
Sep 06 01:45:17.761101 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:17.761077    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68cb9d866d-vc6t6_2ad07e34-0952-48fa-a84d-abf9d9e2f612/manager/0.log"
Sep 06 01:45:17.867246 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:17.867216    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rcd49_29868411-8804-4b28-b55c-c58413fa48dc/discovery/0.log"
Sep 06 01:45:17.938643 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:17.938611    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/0.log"
Sep 06 01:45:17.949757 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:17.949727    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4jh69_1dbc75b2-ba36-4a25-bca5-1a9e127087e4/istio-proxy/1.log"
Sep 06 01:45:18.036231 ip-10-0-129-23 kubenswrapper[2567]: I0906 01:45:18.036190    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dwbm4_db0b0d71-b56d-49ef-a3ed-eaa7acce9c60/payload-processing/0.log"